2022-04-12T17:11:28.368 INFO:root:teuthology version: 1.1.0-a347b2ac
2022-04-12T17:11:28.369 INFO:teuthology.results:subset: '111/120000'
2022-04-12T17:11:28.369 INFO:teuthology.results:seed: '9092'
2022-04-12T19:59:50.905 INFO:root:teuthology version: 1.1.0-a347b2ac
2022-04-12T19:59:50.915 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-04-13T02:15:21.143 INFO:teuthology.results:Tests finished! gathering results...
2022-04-13T02:15:36.257 INFO:scrape:Found 169 jobs
2022-04-13T02:15:48.227 INFO:scrape:Found 9 distinct failure reasons
2022-04-13T02:15:48.228 INFO:scrape:Failure: 
2022-04-13T02:15:48.229 INFO:scrape:1 jobs: ['6789345']
2022-04-13T02:15:48.230 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.231 INFO:scrape:
2022-04-13T02:15:48.232 INFO:scrape:Dead: b'2022-04-13T00:11:56.170 DEBUG:teuthology.exit:Finished running handlers'
2022-04-13T02:15:48.233 INFO:scrape:2 jobs: ['6789195', '6789324']
2022-04-13T02:15:48.234 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'osd}', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.234 INFO:scrape:suites union: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'clusters/1a3s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/snaps/{begin', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{pg-warn', 'overrides/{whitelist_health', 'roles', 'tasks/workunit/snaps}', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.235 INFO:scrape:
2022-04-13T02:15:48.236 INFO:scrape:Failure: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
2022-04-13T02:15:48.237 INFO:scrape:1 jobs: ['6789338']
2022-04-13T02:15:48.237 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{no_client_pidfile', 'tasks/fragment}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.237 INFO:scrape:
2022-04-13T02:15:48.238 INFO:scrape:Failure: "2022-04-12T19:04:45.863417+0000 mds.l (mds.2) 6 : cluster [WRN] Scrub error on inode 0x1000000039e (/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0) see mds.l log and `damage ls` output for details" in cluster log
2022-04-13T02:15:48.238 INFO:scrape:1 jobs: ['6789271']
2022-04-13T02:15:48.239 INFO:scrape:suites: ['clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{rhel_8}', 'fs/workload/{begin', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{frag', 'ranks/3', 'scrub/yes', 'session_timeout', 'standby-replay', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/suites/blogbench}', 'wsync/{no}}']
2022-04-13T02:15:48.239 INFO:scrape:
2022-04-13T02:15:48.240 INFO:scrape:Failure: "2022-04-12T17:46:57.809715+0000 mon.a (mon.0) 2381 : cluster [WRN] Health check failed: Degraded data redundancy: 3/134 objects degraded (2.239%), 2 pgs degraded (PG_DEGRADED)" in cluster log
2022-04-13T02:15:48.240 INFO:scrape:4 jobs: ['6789180', '6789318', '6789346', '6789211']
2022-04-13T02:15:48.241 INFO:scrape:suites intersection: ['conf/{client', 'distro/{ubuntu_latest}', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'osd}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.241 INFO:scrape:suites union: ['clusters/1a11s-mds-1c-client-3node', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin', 'fs/workload/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag', 'overrides/{no_client_pidfile', 'ranks/5', 'scrub/no', 'session_timeout', 'standby-replay', 'tasks/client-recovery}', 'tasks/data-scan}', 'tasks/metrics}', 'tasks/{0-check-counter', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workunit/fs/test_o_trunc}', 'wsync/{yes}}']
2022-04-13T02:15:48.242 INFO:scrape:
2022-04-13T02:15:48.242 INFO:scrape:Failure: Test failure: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules)
2022-04-13T02:15:48.243 INFO:scrape:1 jobs: ['6789244']
2022-04-13T02:15:48.243 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{no_client_pidfile', 'tasks/snap-schedule}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.244 INFO:scrape:
2022-04-13T02:15:48.244 INFO:scrape:Failure: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=69f69bdf05d26516360b2501373d551b7dd645fd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh'
2022-04-13T02:15:48.245 INFO:scrape:1 jobs: ['6789328']
2022-04-13T02:15:48.245 INFO:scrape:suites: ['2-workunit/cfuse_workunit_snaptests}}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/thrash/multifs/{begin', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag', 'session_timeout', 'tasks/{1-thrash/mon', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.246 INFO:scrape:
2022-04-13T02:15:48.246 INFO:scrape:Failure: Command failed on smithi143 with status 1: "sudo nsenter --net=/var/run/netns/ceph-ns-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id vol_data_isolated --client_mountpoint=/volumes/_nogroup/vol_isolated mnt.0"
2022-04-13T02:15:48.247 INFO:scrape:1 jobs: ['6789295']
2022-04-13T02:15:48.247 INFO:scrape:suites: ['1-client', '2-upgrade', '3-verify}', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs/upgrade/volumes/import-legacy/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'tasks/{0-nautilus', 'ubuntu_18.04}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.248 INFO:scrape:
2022-04-13T02:15:48.248 INFO:scrape:Failure: Command failed on smithi037 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 94fa8c36-ba96-11ec-8c38-001a4aab830c -- ceph osd crush tunables default'
2022-04-13T02:15:48.248 INFO:scrape:1 jobs: ['6789305']
2022-04-13T02:15:48.249 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-04-13T02:15:48.249 INFO:scrape:
2022-04-13T02:15:48.257 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/
failed:  11
dead:    2
running: 0
waiting: 0
queued:  0
passed:  156


Fail
=================================================================
[6789180]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
-----------------------------------------------------------------
time:   00:27:26
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789180/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789180/

    "2022-04-12T17:46:57.809715+0000 mon.a (mon.0) 2381 : cluster [WRN] Health
    check failed: Degraded data redundancy: 3/134 objects degraded (2.239%), 2
    pgs degraded (PG_DEGRADED)" in cluster log

[6789211]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics}
-----------------------------------------------------------------
time:   00:25:18
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789211/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789211/

    "2022-04-12T18:17:43.550386+0000 mon.a (mon.0) 1225 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in
    cluster log

[6789244]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule}
-----------------------------------------------------------------
time:   00:14:03
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789244/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789244/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a166369ecc344631bd6e37aaeaa7127c

    Test failure: test_concurrent_snap_creates
    (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

[6789271]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}}
-----------------------------------------------------------------
time:   00:26:23
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789271/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789271/

    "2022-04-12T19:04:45.863417+0000 mds.l (mds.2) 6 : cluster [WRN] Scrub
    error on inode 0x1000000039e
    (/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-0) see mds.l log and
    `damage ls` output for details" in cluster log

[6789295]  fs/upgrade/volumes/import-legacy/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04}
-----------------------------------------------------------------
time:   00:08:58
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789295/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789295/
sentry: https://sentry.ceph.com/organizations/ceph/?query=578d3dbf3be142da81f1ec545d31af3b

    Command failed on smithi143 with status 1: "sudo nsenter
    --net=/var/run/netns/ceph-ns-mnt.0 sudo adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f
    --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id
    vol_data_isolated --client_mountpoint=/volumes/_nogroup/vol_isolated mnt.0"

[6789305]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:08:43
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789305/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789305/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8a55c8aea0d744ef972607efec747a8a

    Command failed on smithi037 with status 127: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    94fa8c36-ba96-11ec-8c38-001a4aab830c -- ceph osd crush tunables default'

[6789318]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery}
-----------------------------------------------------------------
time:   00:32:49
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789318/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789318/

    "2022-04-12T20:11:13.535627+0000 mon.a (mon.0) 2341 : cluster [WRN] Health
    check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)"
    in cluster log

[6789328]  fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
-----------------------------------------------------------------
time:   00:27:16
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789328/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789328/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d32ef1ce01a4b3f82d1b6f5b1850223

    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi071
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=69f69bdf05d26516360b2501373d551b7dd645fd
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-
    ceph.sh'

[6789338]  fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment}
-----------------------------------------------------------------
time:   00:14:55
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789338/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789338/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f4a5148ea6cf4b3b80e7baec0e08d3c3

    Test failure: test_rapid_creation
    (tasks.cephfs.test_fragment.TestFragmentation)

[6789345]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:27:10
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789345/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789345/
sentry: https://sentry.ceph.com/organizations/ceph/?query=396ad82c8ad84fdfbbd89a9bff45aad1

[6789346]  fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}}
-----------------------------------------------------------------
time:   00:22:42
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789346/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789346/

    "2022-04-12T20:19:33.105190+0000 mon.a (mon.0) 285 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in
    cluster log



Dead
=================================================================
[6789195]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789195/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789195/

    hit max job timeout

[6789324]  fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789324/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789324/

    hit max job timeout



Pass
=================================================================
[6789179] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:23:19
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789179/

[6789181] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
time:   01:50:59
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789181/

[6789182] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}}
time:   00:40:46
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789182/

[6789183] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
time:   00:48:56
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789183/

[6789184] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}}
time:   00:25:28
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789184/

[6789185] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}}
time:   00:23:07
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789185/

[6789186] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:16:20
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789186/

[6789187] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:12:56
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789187/

[6789188] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment}
time:   00:17:13
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789188/

[6789189] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
time:   00:38:13
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789189/

[6789190] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:48
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789190/

[6789191] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
time:   00:53:59
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789191/

[6789192] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:15:01
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789192/

[6789193] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:43:01
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789193/

[6789194] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
time:   01:00:41
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789194/

[6789196] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/dbench validater/valgrind}
time:   00:50:45
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789196/

[6789197] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
time:   00:18:57
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789197/

[6789198] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}}
time:   00:34:59
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789198/

[6789199] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
time:   00:51:17
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789199/

[6789200] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush}
time:   00:12:31
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789200/

[6789201] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:31:52
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789201/

[6789202] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:09:28
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789202/

[6789203] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
time:   00:21:49
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789203/

[6789204] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full}
time:   00:21:10
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789204/

[6789205] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:08
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789205/

[6789206] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}}
time:   00:18:12
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789206/

[6789207] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:23:02
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789207/

[6789208] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}}
time:   00:15:47
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789208/

[6789209] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry}
time:   00:14:37
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789209/

[6789210] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
time:   00:15:05
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789210/

[6789212] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:49
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789212/

[6789213] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs_python}
time:   00:09:28
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789213/

[6789214] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:10:45
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789214/

[6789215] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:18:11
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789215/

[6789216] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/multimds_misc}
time:   00:18:50
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789216/

[6789217] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:15:51
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789217/

[6789218] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{yes}}
time:   00:11:52
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789218/

[6789219] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable}
time:   00:09:24
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789219/

[6789220] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
time:   00:22:17
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789220/

[6789221] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
time:   00:30:48
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789221/

[6789222] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   01:38:57
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789222/

[6789223] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
time:   00:13:59
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789223/

[6789224] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:43
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789224/

[6789225] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm}
time:   00:11:57
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789225/

[6789226] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/lockdep}
time:   00:25:09
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789226/

[6789227] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:15:07
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789227/

[6789228] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   02:00:55
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789228/

[6789229] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/mdtest}
time:   00:11:25
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789229/

[6789230] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota}
time:   00:12:38
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789230/

[6789231] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}}
time:   00:13:27
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789231/

[6789232] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}}
time:   00:24:22
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789232/

[6789233] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}}
time:   00:16:12
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789233/

[6789234] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/recovery-fs}
time:   00:11:42
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789234/

[6789235] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:01
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789235/

[6789236] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:13:19
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789236/

[6789237] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}}
time:   00:19:48
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789237/

[6789238] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub}
time:   00:18:06
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789238/

[6789239] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}}
time:   00:25:56
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789239/

[6789240] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}}
time:   00:36:55
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789240/

[6789241] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap}
time:   00:14:15
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789241/

[6789242] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
time:   01:52:27
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789242/

[6789243] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:25:57
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789243/

[6789245] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}}
time:   00:17:17
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789245/

[6789246] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots}
time:   00:23:04
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789246/

[6789247] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}}
time:   00:37:50
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789247/

[6789248] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
time:   00:22:24
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789248/

[6789249] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays}
time:   00:24:37
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789249/

[6789250] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:27
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789250/

[6789251] fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/trim-i24137}
time:   00:10:27
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789251/

[6789252] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest}
time:   00:42:16
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789252/

[6789253] fs/full/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mgr-osd-full}
time:   00:16:31
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789253/

[6789254] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client}
time:   00:08:54
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789254/

[6789255] fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{rhel_8} tasks/mirror}
time:   01:58:28
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789255/

[6789256] fs/mirror-ha/{begin cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit}
time:   02:36:01
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789256/

[6789257] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:31:08
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789257/

[6789258] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
time:   00:18:25
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789258/

[6789259] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
time:   00:29:43
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789259/

[6789260] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:10:47
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789260/

[6789261] fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cephfs-shell}
time:   00:34:55
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789261/

[6789262] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:50:37
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789262/

[6789263] fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/whitelist_health supported-random-distros$/{centos_8} tasks/fstop}
time:   00:08:29
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789263/

[6789264] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
time:   00:21:50
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789264/

[6789265] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}}
time:   00:26:41
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789265/

[6789266] fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}}
time:   02:06:27
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789266/

[6789267] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volume-client}
time:   00:29:26
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789267/

[6789268] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
time:   01:42:12
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789268/

[6789269] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration}
time:   00:18:18
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789269/

[6789270] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/dbench validater/valgrind}
time:   00:50:21
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789270/

[6789272] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay}
time:   00:12:27
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789272/

[6789273] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
time:   00:23:33
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789273/

[6789274] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:26:28
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789274/

[6789275] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/dir-max-entries}
time:   00:14:43
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789275/

[6789276] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:18:24
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789276/

[6789277] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota}
time:   00:13:44
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789277/

[6789278] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{yes}}
time:   01:12:58
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789278/

[6789279] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
time:   00:12:54
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789279/

[6789280] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls}
time:   00:13:05
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789280/

[6789281] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:56
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789281/

[6789282] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:44
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789282/

[6789283] fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-octopus 1-upgrade}}
time:   00:08:59
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789283/

[6789284] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:16:34
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789284/

[6789285] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin}
time:   00:52:47
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789285/

[6789286] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}}
time:   00:49:43
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789286/

[6789287] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:31:11
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789287/

[6789288] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:09:44
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789288/

[6789289] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
time:   00:14:06
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789289/

[6789290] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}}
time:   00:41:12
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789290/

[6789291] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/alternate-pool}
time:   00:12:47
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789291/

[6789292] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover}
time:   00:52:09
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789292/

[6789293] fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:54:08
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789293/

[6789294] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}
time:   00:58:55
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789294/

[6789296] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree}
time:   00:17:35
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789296/

[6789297] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:13:35
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789297/

[6789298] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/lockdep}
time:   00:16:04
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789298/

[6789299] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair}
time:   00:12:42
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789299/

[6789300] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
time:   00:14:26
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789300/

[6789301] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}}
time:   00:14:50
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789301/

[6789302] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:11
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789302/

[6789303] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/ino_release_cb}
time:   00:09:46
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789303/

[6789304] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:11:14
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789304/

[6789306] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace}
time:   00:11:46
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789306/

[6789307] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:33:21
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789307/

[6789308] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/cap-flush}
time:   00:12:06
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789308/

[6789309] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
time:   02:03:26
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789309/

[6789310] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}}
time:   00:48:11
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789310/

[6789311] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits}
time:   00:18:15
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789311/

[6789312] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}}
time:   00:16:11
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789312/

[6789313] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:17:22
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789313/

[6789314] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead}
time:   00:11:23
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789314/

[6789315] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:16:33
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789315/

[6789316] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
time:   00:30:52
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789316/

[6789317] fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/mdtest}
time:   00:18:06
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789317/

[6789319] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
time:   00:41:34
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789319/

[6789320] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}}
time:   00:24:28
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789320/

[6789321] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:53
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789321/

[6789322] fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth}
time:   00:25:06
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789322/

[6789323] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:11:15
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789323/

[6789325] fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{frag whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
time:   00:44:01
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789325/

[6789326] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:29:22
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789326/

[6789327] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage}
time:   00:22:42
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789327/

[6789329] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan}
time:   00:24:17
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789329/

[6789330] fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/dbench validater/valgrind}
time:   00:53:51
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789330/

[6789331] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
time:   00:25:01
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789331/

[6789332] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports}
time:   00:43:38
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789332/

[6789333] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}}
time:   00:19:05
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789333/

[6789334] fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{no}}
time:   00:14:05
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789334/

[6789335] fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/misc}}
time:   00:17:54
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789335/

[6789336] fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:18:28
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789336/

[6789337] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub}
time:   00:15:58
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789337/

[6789339] fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
time:   00:12:52
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789339/

[6789340] fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:13:49
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789340/

[6789341] fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/libcephfs/{frag test}}
time:   00:12:57
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789341/

[6789342] fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   01:33:14
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789342/

[6789343] fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}
time:   00:18:56
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789343/

[6789344] fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:10:39
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789344/

[6789347] fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair}
time:   00:17:39
info:   http://pulpito.ceph.com/yuriw-2022-04-12_17:08:59-fs-wip-yuri4-testing-2022-04-12-0734-pacific-distro-default-smithi/6789347/