2022-03-24T09:45:48.864 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-24T09:45:48.866 INFO:teuthology.results:subset: '111/120000'
2022-03-24T09:45:48.866 INFO:teuthology.results:seed: '3648'
2022-03-24T12:06:29.190 INFO:root:teuthology version: 1.1.0-a4e18662
2022-03-24T12:06:29.200 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-03-24T17:39:56.693 INFO:teuthology.results:Tests finished! gathering results...
2022-03-24T17:40:13.260 INFO:scrape:Found 168 jobs
2022-03-24T17:40:18.328 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/remote/smithi170/log/ceph-mgr.z.log.gz
2022-03-24T17:40:18.329 WARNING:scrape:Not-understood crash indication 
2022-03-24T17:40:18.366 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/remote/smithi170/log/ceph-mgr.z.log.gz
2022-03-24T17:40:18.367 WARNING:scrape:Not-understood crash indication 
2022-03-24T17:40:18.402 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/remote/smithi170/log/ceph-mgr.z.log.gz
2022-03-24T17:40:18.404 WARNING:scrape:Not-understood crash indication 
2022-03-24T17:40:18.442 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/remote/smithi170/log/ceph-mgr.z.log.gz
2022-03-24T17:40:18.443 WARNING:scrape:Not-understood crash indication 
2022-03-24T17:40:18.477 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/remote/smithi170/log/ceph-mgr.z.log.gz
2022-03-24T17:40:18.479 WARNING:scrape:Not-understood crash indication 
2022-03-24T17:40:18.519 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/remote/smithi170/log/ceph-mgr.z.log.gz
2022-03-24T17:40:18.520 WARNING:scrape:Not-understood crash indication 
2022-03-24T17:40:18.565 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/remote/smithi170/log/ceph-mgr.z.log.gz
2022-03-24T17:40:18.567 WARNING:scrape:Not-understood crash indication 
2022-03-24T17:40:18.601 WARNING:scrape:Missing log /home/teuthworker/archive/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/remote/smithi170/log/ceph-mgr.z.log.gz
2022-03-24T17:40:18.602 WARNING:scrape:Not-understood crash indication 
2022-03-24T17:40:25.116 INFO:scrape:Found 12 distinct failure reasons
2022-03-24T17:40:25.117 INFO:scrape:Failure: Command failed on smithi080 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.7-706-g4a75cefe-1focal ceph-mds=16.2.7-706-g4a75cefe-1focal ceph-common=16.2.7-706-g4a75cefe-1focal ceph-fuse=16.2.7-706-g4a75cefe-1focal ceph-test=16.2.7-706-g4a75cefe-1focal radosgw=16.2.7-706-g4a75cefe-1focal python-ceph=16.2.7-706-g4a75cefe-1focal libcephfs1=16.2.7-706-g4a75cefe-1focal libcephfs-java=16.2.7-706-g4a75cefe-1focal libcephfs-jni=16.2.7-706-g4a75cefe-1focal librados2=16.2.7-706-g4a75cefe-1focal librbd1=16.2.7-706-g4a75cefe-1focal rbd-fuse=16.2.7-706-g4a75cefe-1focal python3-cephfs=16.2.7-706-g4a75cefe-1focal cephfs-shell=16.2.7-706-g4a75cefe-1focal cephfs-top=16.2.7-706-g4a75cefe-1focal cephfs-mirror=16.2.7-706-g4a75cefe-1focal'
2022-03-24T17:40:25.118 INFO:scrape:2 jobs: ['6755933', '6755934']
2022-03-24T17:40:25.118 INFO:scrape:suites intersection: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{no_client_pidfile', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.119 INFO:scrape:suites union: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'fs/volumes/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{no_client_pidfile', 'tasks/exports}', 'tasks/volumes/{overrides', 'test/misc}}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.119 INFO:scrape:
2022-03-24T17:40:25.120 INFO:scrape:Failure: Command failed on smithi022 with status 1: "sudo nsenter --net=/var/run/netns/ceph-ns-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id vol_data_isolated --client_mountpoint=/volumes/_nogroup/vol_isolated mnt.0"
2022-03-24T17:40:25.120 INFO:scrape:1 jobs: ['6755894']
2022-03-24T17:40:25.121 INFO:scrape:suites: ['1-client', '2-upgrade', '3-verify}', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs/upgrade/volumes/import-legacy/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'tasks/{0-nautilus', 'ubuntu_18.04}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.121 INFO:scrape:
2022-03-24T17:40:25.122 INFO:scrape:Failure: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi085 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4a75cefe3c8858fb889356f1791131eeda6cf9e4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/snaps/snaptest-git-ceph.sh'
2022-03-24T17:40:25.122 INFO:scrape:1 jobs: ['6755798']
2022-03-24T17:40:25.123 INFO:scrape:suites: ['2-workunit/cfuse_workunit_snaptests}}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_8}', 'fs/thrash/multifs/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/none', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag', 'session_timeout', 'tasks/{1-thrash/mon', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.123 INFO:scrape:
2022-03-24T17:40:25.124 INFO:scrape:Failure: No module named 'tasks.ceph'
2022-03-24T17:40:25.124 INFO:scrape:2 jobs: ['6755931', '6755930']
2022-03-24T17:40:25.125 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.125 INFO:scrape:suites union: ['1-client', '2-upgrade', '2-workunit/suites/fsstress}}', '3-compat_client/pacific}}', 'centos_latest', 'clusters/1-mds-2-client-micro', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/thrash/workloads/{begin', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{frag', 'overrides/{multimds/yes', 'pg-warn', 'prefetch_dirfrags/no', 'races', 'ranks/5', 'session_timeout', 'tasks/{0-nautilus', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.126 INFO:scrape:
2022-03-24T17:40:25.126 INFO:scrape:Failure: Command failed on smithi204 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'
2022-03-24T17:40:25.127 INFO:scrape:3 jobs: ['6755937', '6755927', '6755938']
2022-03-24T17:40:25.127 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'osd}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.128 INFO:scrape:suites union: ['2-workunit/cfuse_workunit_snaptests}}', '2-workunit/fs/trivial_sync}}', 'clusters/1a3s-mds-2c-client', 'clusters/1a3s-mds-4c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'fs/thrash/multifs/{begin', 'fs/thrash/workloads/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore-ec/bluestore-bitmap', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag', 'overrides/{no_client_pidfile', 'prefetch_dirfrags/yes', 'races', 'ranks/1', 'rhel_8}', 'session_timeout', 'tasks/fragment}', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.128 INFO:scrape:
2022-03-24T17:40:25.129 INFO:scrape:Failure: 
2022-03-24T17:40:25.129 INFO:scrape:1 jobs: ['6755908']
2022-03-24T17:40:25.130 INFO:scrape:suites: ['2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag', 'prefetch_dirfrags/no', 'races', 'ranks/1', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.130 INFO:scrape:
2022-03-24T17:40:25.131 INFO:scrape:Failure: Test failure: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays)
2022-03-24T17:40:25.131 INFO:scrape:1 jobs: ['6755848']
2022-03-24T17:40:25.132 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{no_client_pidfile', 'tasks/strays}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.132 INFO:scrape:
2022-03-24T17:40:25.133 INFO:scrape:Dead: b'2022-03-24T16:59:43.709 DEBUG:teuthology.exit:Finished running handlers'
2022-03-24T17:40:25.133 INFO:scrape:2 jobs: ['6755824', '6755873']
2022-03-24T17:40:25.133 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.134 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.134 INFO:scrape:
2022-03-24T17:40:25.135 INFO:scrape:Failure: SSH connection to smithi122 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'
2022-03-24T17:40:25.135 INFO:scrape:2 jobs: ['6755960', '6755797']
2022-03-24T17:40:25.136 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'session_timeout', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.136 INFO:scrape:suites union: ['clusters/1a11s-mds-1c-client-3node', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'fs/verify/{begin', 'fs/workload/{begin', 'k-testing}', 'mds', 'mon', 'mount', 'mount/kclient/{k-testing', 'mount/kclient/{mount', 'ms-die-on-skipped}', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag', 'overrides/{mon-debug', 'ranks/1', 'ranks/3', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/fsstress', 'tasks/{0-check-counter', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/iogen}', 'wsync/{no}}']
2022-03-24T17:40:25.137 INFO:scrape:
2022-03-24T17:40:25.137 INFO:scrape:Failure: Test failure: test_mirroring_init_failure_with_recovery (tasks.cephfs.test_mirroring.TestMirroring)
2022-03-24T17:40:25.138 INFO:scrape:1 jobs: ['6755865']
2022-03-24T17:40:25.138 INFO:scrape:suites: ['centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/whitelist_health', 'tasks/mirror}}']
2022-03-24T17:40:25.139 INFO:scrape:
2022-03-24T17:40:25.139 INFO:scrape:Failure: "2022-03-24T11:01:09.067687+0000 mon.a (mon.0) 1188 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
2022-03-24T17:40:25.140 INFO:scrape:1 jobs: ['6755843']
2022-03-24T17:40:25.140 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'mds', 'mon', 'mount/fuse', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{no_client_pidfile', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.141 INFO:scrape:
2022-03-24T17:40:25.141 INFO:scrape:Failure: Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
2022-03-24T17:40:25.142 INFO:scrape:1 jobs: ['6755916']
2022-03-24T17:40:25.142 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{no_client_pidfile', 'tasks/client-readahead}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-03-24T17:40:25.143 INFO:scrape:
2022-03-24T17:40:25.150 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/
failed:  14
dead:    4
running: 0
waiting: 0
queued:  0
passed:  150


Fail
=================================================================
[6755798]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
-----------------------------------------------------------------
time:   00:23:36
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755798/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755798/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f70bbd4b8ccd447ebc3dc79b0eef0843

    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi085
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd
    -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=4a75cefe3c8858fb889356f1791131eeda6cf9e4
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1
    CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/snaps/snaptest-git-
    ceph.sh'

[6755843]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:15:09
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755843/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755843/

    "2022-03-24T11:01:09.067687+0000 mon.a (mon.0) 1188 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in
    cluster log

[6755848]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays}
-----------------------------------------------------------------
time:   00:14:07
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755848/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755848/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e30c62071cc4475fa1a07c4eea344e2f

    Test failure: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays)

[6755865]  fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}}
-----------------------------------------------------------------
time:   02:09:09
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755865/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755865/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a98a25e8b03e4d798aac6926055b52cf

    Test failure: test_mirroring_init_failure_with_recovery
    (tasks.cephfs.test_mirroring.TestMirroring)

[6755894]  fs/upgrade/volumes/import-legacy/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04}
-----------------------------------------------------------------
time:   00:09:42
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755894/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755894/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b36ea7e408e447c3b1122c65d3d9bdab

    Command failed on smithi022 with status 1: "sudo nsenter
    --net=/var/run/netns/ceph-ns-mnt.0 sudo adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f
    --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id
    vol_data_isolated --client_mountpoint=/volumes/_nogroup/vol_isolated mnt.0"

[6755908]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
-----------------------------------------------------------------
time:   00:13:02
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755908/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755908/
sentry: https://sentry.ceph.com/organizations/ceph/?query=53f64390f2e84e3da94bcc5e42cd6277

[6755916]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
-----------------------------------------------------------------
time:   00:11:56
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755916/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755916/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c586271d28484c949eb107b827ee9c1a

    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)

[6755927]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
-----------------------------------------------------------------
time:   00:07:13
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755927/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755927/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bd87812b8df1422f9e198a5baa4ab4d3

    Command failed on smithi055 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1
    librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-
    mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager
    iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-
    devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel
    xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel'

[6755930]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
-----------------------------------------------------------------
time:   00:07:12
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755930/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755930/
sentry: https://sentry.ceph.com/organizations/ceph/?query=251639d42d374bc6af8df034f82502bd

    No module named 'tasks.cephfs.fuse_mount'

[6755931]  fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}}
-----------------------------------------------------------------
time:   00:06:58
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755931/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755931/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f8a4e2d8c9bc46c7a7028a7433682fb0

    No module named 'tasks.ceph'

[6755933]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
-----------------------------------------------------------------
time:   00:04:54
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755933/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755933/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a5ba0510fd6c446095d90b578305f7b7

    Command failed on smithi080 with status 100: 'sudo
    DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="
    --force-confdef" -o Dpkg::Options::="--force-confold" install
    ceph=16.2.7-706-g4a75cefe-1focal ceph-mds=16.2.7-706-g4a75cefe-1focal ceph-
    common=16.2.7-706-g4a75cefe-1focal ceph-fuse=16.2.7-706-g4a75cefe-1focal
    ceph-test=16.2.7-706-g4a75cefe-1focal radosgw=16.2.7-706-g4a75cefe-1focal
    python-ceph=16.2.7-706-g4a75cefe-1focal
    libcephfs1=16.2.7-706-g4a75cefe-1focal libcephfs-
    java=16.2.7-706-g4a75cefe-1focal libcephfs-jni=16.2.7-706-g4a75cefe-1focal
    librados2=16.2.7-706-g4a75cefe-1focal librbd1=16.2.7-706-g4a75cefe-1focal
    rbd-fuse=16.2.7-706-g4a75cefe-1focal
    python3-cephfs=16.2.7-706-g4a75cefe-1focal cephfs-
    shell=16.2.7-706-g4a75cefe-1focal cephfs-top=16.2.7-706-g4a75cefe-1focal
    cephfs-mirror=16.2.7-706-g4a75cefe-1focal'

[6755934]  fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}}
-----------------------------------------------------------------
time:   00:04:55
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755934/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755934/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fe7b7658f1ea40e9955015df6bc3a1d2

    Command failed on smithi105 with status 100: 'sudo
    DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="
    --force-confdef" -o Dpkg::Options::="--force-confold" install
    ceph=16.2.7-706-g4a75cefe-1focal ceph-mds=16.2.7-706-g4a75cefe-1focal ceph-
    common=16.2.7-706-g4a75cefe-1focal ceph-fuse=16.2.7-706-g4a75cefe-1focal
    ceph-test=16.2.7-706-g4a75cefe-1focal radosgw=16.2.7-706-g4a75cefe-1focal
    python-ceph=16.2.7-706-g4a75cefe-1focal
    libcephfs1=16.2.7-706-g4a75cefe-1focal libcephfs-
    java=16.2.7-706-g4a75cefe-1focal libcephfs-jni=16.2.7-706-g4a75cefe-1focal
    librados2=16.2.7-706-g4a75cefe-1focal librbd1=16.2.7-706-g4a75cefe-1focal
    rbd-fuse=16.2.7-706-g4a75cefe-1focal
    python3-cephfs=16.2.7-706-g4a75cefe-1focal cephfs-
    shell=16.2.7-706-g4a75cefe-1focal cephfs-top=16.2.7-706-g4a75cefe-1focal
    cephfs-mirror=16.2.7-706-g4a75cefe-1focal'

[6755937]  fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
-----------------------------------------------------------------
time:   00:05:09
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755937/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755937/
sentry: https://sentry.ceph.com/organizations/ceph/?query=438921c1fb6b404493f83bc164f6ba7e

    Command failed on smithi204 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1
    librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-
    mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager
    iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-
    devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel
    xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel'

[6755938]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment}
-----------------------------------------------------------------
time:   00:05:05
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755938/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755938/
sentry: https://sentry.ceph.com/organizations/ceph/?query=07e7b2b133d34c08b633d071e16c888e

    Command failed on smithi106 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1
    librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-
    mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager
    iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-
    devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel
    xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel'



Dead
=================================================================
[6755797]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}}
-----------------------------------------------------------------
time:   00:28:23
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755797/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3751163a1cf46489545d1b29bc79096

    SSH connection to smithi114 was lost: 'sudo rm -rf --
    /home/ubuntu/cephtest/workunits.list.client.0
    /home/ubuntu/cephtest/clone.client.0'

[6755824]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755824/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755824/

    hit max job timeout

[6755873]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755873/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755873/

    hit max job timeout

[6755960]  fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/fsstress validater/valgrind}
-----------------------------------------------------------------
time:   01:22:06
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755960/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755960/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f67ebf0988354fd09bc28e5c82e92561

    SSH connection to smithi122 was lost: 'sudo rm -rf --
    /home/ubuntu/cephtest/workunits.list.client.0
    /home/ubuntu/cephtest/clone.client.0'



Pass
=================================================================
[6755794] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
time:   00:47:55
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755794/

[6755795] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:27:31
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755795/

[6755796] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/dbench validater/valgrind}
time:   00:58:05
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755796/

[6755799] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
time:   00:17:46
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755799/

[6755800] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:31:55
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755800/

[6755801] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:10:24
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755801/

[6755802] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
time:   00:13:07
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755802/

[6755803] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
time:   00:20:41
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755803/

[6755804] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:44
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755804/

[6755805] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
time:   00:24:15
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755805/

[6755806] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}}
time:   00:19:27
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755806/

[6755807] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:21:59
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755807/

[6755808] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{yes}}
time:   00:15:32
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755808/

[6755809] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry}
time:   00:11:02
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755809/

[6755810] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
time:   00:14:28
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755810/

[6755811] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:07
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755811/

[6755812] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python}
time:   00:10:51
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755812/

[6755813] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:32
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755813/

[6755814] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:19:33
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755814/

[6755815] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics}
time:   00:21:08
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755815/

[6755816] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:15:21
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755816/

[6755817] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}}
time:   00:12:43
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755817/

[6755818] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc}
time:   00:20:05
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755818/

[6755819] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
time:   00:23:22
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755819/

[6755820] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable}
time:   00:13:57
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755820/

[6755821] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
time:   00:32:10
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755821/

[6755822] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   01:16:09
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755822/

[6755823] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
time:   00:15:15
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755823/

[6755825] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/lockdep}
time:   00:16:23
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755825/

[6755826] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:15:50
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755826/

[6755827] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm}
time:   00:11:10
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755827/

[6755828] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:30:15
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755828/

[6755829] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/mdtest}
time:   00:12:03
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755829/

[6755830] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{yes}}
time:   00:13:00
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755830/

[6755831] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}}
time:   00:24:57
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755831/

[6755832] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota}
time:   00:10:42
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755832/

[6755833] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
time:   00:16:59
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755833/

[6755834] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:16
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755834/

[6755835] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:12:37
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755835/

[6755836] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}}
time:   00:23:24
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755836/

[6755837] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub}
time:   00:23:47
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755837/

[6755838] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}}
time:   00:24:53
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755838/

[6755839] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}}
time:   00:41:17
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755839/

[6755840] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap}
time:   00:15:43
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755840/

[6755841] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
time:   01:52:34
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755841/

[6755842] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:29:41
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755842/

[6755844] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}}
time:   00:15:25
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755844/

[6755845] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots}
time:   00:20:11
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755845/

[6755846] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}}
time:   00:39:35
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755846/

[6755847] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
time:   00:24:34
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755847/

[6755849] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:17
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755849/

[6755850] fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137}
time:   00:12:39
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755850/

[6755851] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest}
time:   00:42:56
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755851/

[6755852] fs/full/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full}
time:   00:16:19
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755852/

[6755853] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client}
time:   00:10:10
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755853/

[6755854] fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror}
time:   01:58:11
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755854/

[6755855] fs/mirror-ha/{begin cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{rhel_8} workloads/cephfs-mirror-ha-workunit}
time:   02:34:49
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755855/

[6755856] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:29:31
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755856/

[6755857] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
time:   00:19:49
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755857/

[6755858] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
time:   00:31:41
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755858/

[6755859] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:12:54
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755859/

[6755860] fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell}
time:   00:35:04
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755860/

[6755861] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:40:57
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755861/

[6755862] fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/whitelist_health supported-random-distros$/{rhel_8} tasks/fstop}
time:   00:09:54
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755862/

[6755863] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
time:   00:20:13
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755863/

[6755864] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}}
time:   00:27:30
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755864/

[6755866] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}
time:   00:30:04
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755866/

[6755867] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration}
time:   00:18:09
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755867/

[6755868] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
time:   01:47:25
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755868/

[6755869] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/dbench validater/valgrind}
time:   00:53:44
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755869/

[6755870] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}}
time:   00:22:30
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755870/

[6755871] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay}
time:   00:11:43
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755871/

[6755872] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
time:   00:29:31
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755872/

[6755874] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/dir-max-entries}
time:   00:12:34
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755874/

[6755875] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:19:14
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755875/

[6755876] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota}
time:   00:15:10
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755876/

[6755877] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{yes}}
time:   01:23:21
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755877/

[6755878] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
time:   00:13:52
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755878/

[6755879] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls}
time:   00:17:37
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755879/

[6755880] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:24
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755880/

[6755881] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:14
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755881/

[6755882] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}}
time:   00:10:30
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755882/

[6755883] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:18:51
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755883/

[6755884] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}
time:   00:47:23
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755884/

[6755885] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin}
time:   00:49:42
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755885/

[6755886] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:34:37
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755886/

[6755887] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:09:57
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755887/

[6755888] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
time:   00:14:50
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755888/

[6755889] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}}
time:   00:42:07
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755889/

[6755890] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool}
time:   00:10:21
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755890/

[6755891] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
time:   00:46:05
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755891/

[6755892] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:51:18
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755892/

[6755893] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}
time:   01:02:54
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755893/

[6755895] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree}
time:   00:24:48
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755895/

[6755896] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:14:36
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755896/

[6755897] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/lockdep}
time:   00:17:03
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755897/

[6755898] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
time:   00:12:55
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755898/

[6755899] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
time:   00:13:46
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755899/

[6755900] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{yes}}
time:   00:16:35
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755900/

[6755901] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:02
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755901/

[6755902] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb}
time:   00:09:52
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755902/

[6755903] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:10:37
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755903/

[6755904] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:30:14
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755904/

[6755905] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
time:   00:09:01
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755905/

[6755906] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:33:15
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755906/

[6755907] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush}
time:   00:10:22
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755907/

[6755909] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}}
time:   00:47:54
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755909/

[6755910] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}}
time:   00:14:33
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755910/

[6755911] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
time:   00:22:22
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755911/

[6755912] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:20:04
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755912/

[6755913] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:14:59
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755913/

[6755914] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:31:57
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755914/

[6755915] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/mdtest}
time:   00:16:45
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755915/

[6755917] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
time:   00:39:53
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755917/

[6755918] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
time:   00:34:00
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755918/

[6755919] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}}
time:   00:23:42
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755919/

[6755920] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:55
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755920/

[6755921] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
time:   00:26:15
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755921/

[6755922] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:02
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755922/

[6755923] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:43:16
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755923/

[6755924] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
time:   00:50:58
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755924/

[6755925] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:29:59
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755925/

[6755926] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
time:   00:18:46
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755926/

[6755928] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
time:   00:30:41
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755928/

[6755929] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/dbench validater/valgrind}
time:   00:54:47
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755929/

[6755932] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}}
time:   00:14:55
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755932/

[6755935] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:19:47
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755935/

[6755936] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:14:31
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755936/

[6755939] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:19
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755939/

[6755940] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs/{frag test}}
time:   00:14:08
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755940/

[6755941] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:02:29
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755941/

[6755942] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
time:   00:19:20
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755942/

[6755943] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:14
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755943/

[6755944] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:27:15
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755944/

[6755945] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}}
time:   00:23:34
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755945/

[6755946] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:16:20
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755946/

[6755947] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
time:   00:21:17
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755947/

[6755948] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
time:   00:12:10
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755948/

[6755949] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
time:   00:23:44
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755949/

[6755950] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
time:   00:55:15
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755950/

[6755951] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:59:14
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755951/

[6755952] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
time:   00:16:35
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755952/

[6755953] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}}
time:   00:28:24
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755953/

[6755954] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}}
time:   00:27:07
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755954/

[6755955] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
time:   00:18:41
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755955/

[6755956] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:12:13
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755956/

[6755957] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}}
time:   00:21:10
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755957/

[6755958] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry}
time:   00:12:38
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755958/

[6755959] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
time:   00:16:47
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755959/

[6755961] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:20
info:   http://pulpito.ceph.com/yuriw-2022-03-23_14:05:17-fs-wip-yuri10-testing-2022-03-22-1809-pacific-distro-default-smithi/6755961/