2023-10-04T19:35:12.676 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-04T19:35:12.676 INFO:teuthology.results:subset: '111/120000'
2023-10-04T19:35:12.676 INFO:teuthology.results:seed: '8919'
2023-10-04T23:25:48.293 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-04T23:25:48.326 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-10-05T10:36:46.391 INFO:teuthology.results:Tests finished! gathering results...
2023-10-05T10:37:03.899 INFO:scrape:Found 198 jobs
2023-10-05T10:37:06.435 WARNING:scrape:Misunderstood line: 
2023-10-05T10:37:10.387 WARNING:scrape:Misunderstood line: 
2023-10-05T10:37:11.555 WARNING:scrape:Misunderstood line: 
2023-10-05T10:37:20.500 INFO:scrape:Found 11 distinct failure reasons
2023-10-05T10:37:20.501 INFO:scrape:Dead: b'2023-10-05T08:17:59.269 DEBUG:teuthology.exit:Finished running handlers'
2023-10-05T10:37:20.501 INFO:scrape:6 jobs: ['7410464', '7410555', '7410458', '7410482', '7410494', '7410586']
2023-10-05T10:37:20.501 INFO:scrape:suites intersection: ['conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health']
2023-10-05T10:37:20.501 INFO:scrape:suites union: ['1-ceph', '1-ranks/2', '1-tests/fscrypt-common}}', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-logrotate}', '3-inline/no', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'bluestore-bitmap', 'centos_8.stream_container_tools', 'clusters/1-mds-1-client', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fail_fs/yes', 'fs/fscrypt/{begin/{0-install', 'fs/functional/{begin/{0-install', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn', 'pg-warn}', 'rhel_8}', 'roles', 'syntax}', 'tasks/xfstests-dev}', 'tasks/{0-client', 'tasks/{0-from/quincy']
2023-10-05T10:37:20.502 INFO:scrape:
2023-10-05T10:37:20.502 INFO:scrape:Failure: "2023-10-04T22:35:50.309738+0000 mon.a (mon.0) 794 : cluster [WRN] Health check failed: Degraded data redundancy: 31/4094 objects degraded (0.757%), 1 pg degraded (PG_DEGRADED)" in cluster log
2023-10-05T10:37:20.502 INFO:scrape:6 jobs: ['7410564', '7410533', '7410448', '7410521', '7410524', '7410614']
2023-10-05T10:37:20.502 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}']
2023-10-05T10:37:20.502 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'centos_latest', 'cephfs-mirror/one-per-cluster', 'clients/mirror', 'clients/{mirror}', 'cluster/1-node', 'cluster/{1-node}', 'clusters/1-mds-3-client', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'debug', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'distros/ubuntu_latest', 'fs/functional/{begin/{0-install', 'fs/mirror/{begin/{0-install', 'fs/multiclient/{begin/{0-install', 'fs/valgrind/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/ignorelist_health', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'overrides/{ignorelist_health}', 'supported-random-distros$/{centos_latest}', 'tasks/cephfs_misc_tests}', 'tasks/journal-repair}', 'tasks/mirror}', 'tasks/mirror}}', 'tasks/snap-schedule}']
2023-10-05T10:37:20.502 INFO:scrape:
2023-10-05T10:37:20.502 INFO:scrape:Valgrind: client (Leak_StillReachable), mon (Leak_StillReachable)
2023-10-05T10:37:20.503 INFO:scrape:3 jobs: ['7410609', '7410455', '7410537']
2023-10-05T10:37:20.503 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'osd}', 'overrides/{ignorelist_health', 'session_timeout}', 'tasks/dbench', 'validater/valgrind}']
2023-10-05T10:37:20.503 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu/{overrides', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'ranks/1', 'ranks/3', 'ranks/5', 'session_timeout}', 'tasks/dbench', 'ubuntu_latest}}', 'validater/valgrind}']
2023-10-05T10:37:20.503 INFO:scrape:
2023-10-05T10:37:20.503 INFO:scrape:Failure: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
2023-10-05T10:37:20.503 INFO:scrape:1 jobs: ['7410632']
2023-10-05T10:37:20.503 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'tasks/strays}']
2023-10-05T10:37:20.504 INFO:scrape:
2023-10-05T10:37:20.504 INFO:scrape:Failure: Command failed on smithi022 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf'
2023-10-05T10:37:20.504 INFO:scrape:5 jobs: ['7410617', '7410616', '7410624', '7410545', '7410627']
2023-10-05T10:37:20.504 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health']
2023-10-05T10:37:20.504 INFO:scrape:suites union: ['1-ceph', '1-tests/fscrypt-dbench}}', '1-tests/fscrypt-iozone}}', '2-logrotate}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'clusters/1-mds-2-client', 'clusters/1a3s-mds-1c-client', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'distros/ubuntu_latest', 'fs/fscrypt/{begin/{0-install', 'fs/multiclient/{begin/{0-install', 'fs/snaps/{begin/{0-install', 'fs/volumes/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/cephfs_misc_tests}', 'tasks/volumes/{overrides', 'tasks/workunit/snaps}', 'tasks/{0-client', 'test/clone}}']
2023-10-05T10:37:20.504 INFO:scrape:
2023-10-05T10:37:20.504 INFO:scrape:Failure: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds
2023-10-05T10:37:20.504 INFO:scrape:1 jobs: ['7410613']
2023-10-05T10:37:20.505 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/yes', '4-flush/no', '5-workunit/postgres}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'n/5', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}']
2023-10-05T10:37:20.505 INFO:scrape:
2023-10-05T10:37:20.505 INFO:scrape:Failure: Command failed (workunit test kernel_untar_build.sh) on smithi081 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=117cba0ee546c1ab1abfae99638dc9d28580cdc5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'
2023-10-05T10:37:20.505 INFO:scrape:2 jobs: ['7410565', '7410449']
2023-10-05T10:37:20.505 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{overrides', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'ubuntu_latest}}']
2023-10-05T10:37:20.505 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{ubuntu/{overrides', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts}', 'osd}', 'overrides/{ignorelist_health', 'tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'ubuntu_latest}}']
2023-10-05T10:37:20.505 INFO:scrape:
2023-10-05T10:37:20.505 INFO:scrape:Failure: Test failure: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits)
2023-10-05T10:37:20.506 INFO:scrape:1 jobs: ['7410515']
2023-10-05T10:37:20.506 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/client-limits}']
2023-10-05T10:37:20.506 INFO:scrape:
2023-10-05T10:37:20.506 INFO:scrape:Failure: Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 117cba0ee546c1ab1abfae99638dc9d28580cdc5'
2023-10-05T10:37:20.506 INFO:scrape:1 jobs: ['7410597']
2023-10-05T10:37:20.506 INFO:scrape:suites: ['1-client', '2-upgrade', '3-client-upgrade', '4-compat_client', '5-client-sanity}}', 'centos_8.stream', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'tasks/{0-octopus']
2023-10-05T10:37:20.506 INFO:scrape:
2023-10-05T10:37:20.506 INFO:scrape:Failure: 
2023-10-05T10:37:20.507 INFO:scrape:1 jobs: ['7410466']
2023-10-05T10:37:20.507 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/cfuse_workunit_suites_fsstress}}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_latest}', 'frag', 'fs/thrash/multifs/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{client-shutdown', 'overrides/{distro/stock/{k-stock', 'rhel_8}', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}']
2023-10-05T10:37:20.507 INFO:scrape:
2023-10-05T10:37:20.507 INFO:scrape:Failure: Command failed (workunit test fs/test_python.sh) on smithi161 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=117cba0ee546c1ab1abfae99638dc9d28580cdc5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh'
2023-10-05T10:37:20.507 INFO:scrape:1 jobs: ['7410475']
2023-10-05T10:37:20.507 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/libcephfs_python}']
2023-10-05T10:37:20.507 INFO:scrape:
2023-10-05T10:37:20.517 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/
failed:  22
dead:    6
running: 0
waiting: 0
queued:  0
passed:  170


Fail
=================================================================
[7410448]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:46:42
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410448/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410448/

    "2023-10-04T20:11:20.078620+0000 mon.a (mon.0) 430 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in
    cluster log

[7410449]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   00:24:03
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410449/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410449/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2013f723dc42471fbfd43921ee5f8f59

    Command failed (workunit test kernel_untar_build.sh) on smithi172 with
    status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=117cba0ee546c1ab1abfae99638dc9d28580cdc5
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1
    CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'

[7410455]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:54:06
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410455/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410455/

    saw valgrind issues

[7410466]  fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
-----------------------------------------------------------------
time:   00:15:11
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410466/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410466/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aff5c7d307614fd8821656a4b33de3ba

[7410475]  fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python}
-----------------------------------------------------------------
time:   00:14:05
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410475/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410475/
sentry: https://sentry.ceph.com/organizations/ceph/?query=075e0be138ae49f6a3daae85633f36ed

    Command failed (workunit test fs/test_python.sh) on smithi161 with status
    2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=117cba0ee546c1ab1abfae99638dc9d28580cdc5
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh'

[7410515]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits}
-----------------------------------------------------------------
time:   00:16:07
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410515/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410515/
sentry: https://sentry.ceph.com/organizations/ceph/?query=81f87d746c384392a6a4ee368ba3e5f3

    Test failure: test_client_blocklisted_oldest_tid
    (tasks.cephfs.test_client_limits.TestClientLimits)

[7410521]  fs/mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror}
-----------------------------------------------------------------
time:   01:56:58
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410521/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410521/

    "2023-10-04T21:52:15.939040+0000 mon.a (mon.0) 2155 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in
    cluster log

[7410524]  fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests}
-----------------------------------------------------------------
time:   01:01:19
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410524/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410524/

    "2023-10-04T21:59:34.772582+0000 mon.a (mon.0) 1238 : cluster [WRN] Health
    check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

[7410533]  fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}}
-----------------------------------------------------------------
time:   02:01:38
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410533/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410533/

    "2023-10-04T22:10:30.326756+0000 mon.a (mon.0) 2152 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in
    cluster log

[7410537]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:50:09
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410537/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410537/

    saw valgrind issues

[7410545]  fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-iozone}}
-----------------------------------------------------------------
time:   02:10:27
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410545/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410545/

    Command failed on smithi144 with status 3: 'sudo logrotate
    /etc/logrotate.d/ceph-test.conf'

[7410564]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair}
-----------------------------------------------------------------
time:   00:21:38
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410564/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410564/

    "2023-10-04T22:35:50.309738+0000 mon.a (mon.0) 794 : cluster [WRN] Health
    check failed: Degraded data redundancy: 31/4094 objects degraded (0.757%),
    1 pg degraded (PG_DEGRADED)" in cluster log

[7410565]  fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench}
-----------------------------------------------------------------
time:   00:24:44
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410565/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410565/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f78a904a799740beb8d5d5831ed9bcf9

    Command failed (workunit test kernel_untar_build.sh) on smithi081 with
    status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=117cba0ee546c1ab1abfae99638dc9d28580cdc5
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1
    CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'

[7410597]  fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
-----------------------------------------------------------------
time:   00:20:53
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410597/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410597/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c115904893e2468d8356b5937dcf5c92

    Command failed on smithi123 with status 128: 'rm -rf
    /home/ubuntu/cephtest/clone.client.0 && git clone
    https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd
    /home/ubuntu/cephtest/clone.client.0 && git checkout
    117cba0ee546c1ab1abfae99638dc9d28580cdc5'

[7410609]  fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}
-----------------------------------------------------------------
time:   00:46:30
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410609/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410609/

    saw valgrind issues

[7410613]  fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}}
-----------------------------------------------------------------
time:   01:09:47
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410613/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410613/

    error during scrub thrashing: reached maximum tries (31) after waiting for
    900 seconds

[7410614]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}
-----------------------------------------------------------------
time:   01:54:35
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410614/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410614/

    "2023-10-04T23:24:02.180218+0000 mon.a (mon.0) 404 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[7410616]  fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-dbench}}
-----------------------------------------------------------------
time:   01:04:49
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410616/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410616/

    Command failed on smithi157 with status 3: 'sudo logrotate
    /etc/logrotate.d/ceph-test.conf'

[7410617]  fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
-----------------------------------------------------------------
time:   00:58:59
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410617/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410617/

    Command failed on smithi022 with status 3: 'sudo logrotate
    /etc/logrotate.d/ceph-test.conf'

[7410624]  fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests}
-----------------------------------------------------------------
time:   01:00:41
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410624/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410624/

    Command failed on smithi089 with status 3: 'sudo logrotate
    /etc/logrotate.d/ceph-test.conf'

[7410627]  fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
-----------------------------------------------------------------
time:   01:22:42
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410627/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410627/

    Command failed on smithi045 with status 3: 'sudo logrotate
    /etc/logrotate.d/ceph-test.conf'

[7410632]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays}
-----------------------------------------------------------------
time:   00:31:24
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410632/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410632/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6b3083f7a7f946069667fd2d1e0041fb

    Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)



Dead
=================================================================
[7410458]  fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410458/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410458/

    hit max job timeout

[7410464]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410464/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410464/

    hit max job timeout

[7410482]  fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410482/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410482/

    hit max job timeout

[7410494]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410494/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410494/

    hit max job timeout

[7410555]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410555/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410555/

    hit max job timeout

[7410586]  fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410586/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410586/

    hit max job timeout



Pass
=================================================================
[7410436] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}}
time:   00:42:22
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410436/

[7410437] fs/upgrade/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}}
time:   00:34:40
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410437/

[7410438] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs}
time:   00:09:51
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410438/

[7410439] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-workload/new_ops/{0-clients/kclient 1-client-sanity}}}
time:   00:16:15
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410439/

[7410440] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:19:30
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410440/

[7410441] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/postgres}}
time:   00:47:17
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410441/

[7410442] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub}
time:   00:27:45
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410442/

[7410443] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:42:44
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410443/

[7410444] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}}
time:   00:53:42
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410444/

[7410445] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap}
time:   00:17:13
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410445/

[7410446] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}}
time:   00:31:11
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410446/

[7410447] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410447/

[7410450] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:17:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410450/

[7410451] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
time:   01:10:09
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410451/

[7410452] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:29:11
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410452/

[7410453] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
time:   02:04:42
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410453/

[7410454] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/blogbench}}
time:   00:44:27
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410454/

[7410456] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir}
time:   00:14:13
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410456/

[7410457] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}}
time:   00:19:26
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410457/

[7410459] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:14:50
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410459/

[7410460] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
time:   00:27:26
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410460/

[7410461] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:36:17
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410461/

[7410462] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
time:   01:52:52
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410462/

[7410463] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}
time:   00:28:38
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410463/

[7410465] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/dbench}}
time:   01:06:37
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410465/

[7410467] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
time:   00:26:37
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410467/

[7410468] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays}
time:   00:32:03
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410468/

[7410469] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration}
time:   00:19:35
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410469/

[7410470] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}}
time:   00:15:15
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410470/

[7410471] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}}
time:   00:25:00
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410471/

[7410472] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay}
time:   00:15:23
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410472/

[7410473] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/ffsb}}
time:   00:54:08
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410473/

[7410474] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:15:41
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410474/

[7410476] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:16:21
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410476/

[7410477] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:20:42
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410477/

[7410478] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:14
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410478/

[7410479] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries}
time:   00:16:09
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410479/

[7410480] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:28:02
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410480/

[7410481] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}}
time:   00:20:52
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410481/

[7410483] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}
time:   01:00:46
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410483/

[7410484] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}}
time:   00:31:26
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410484/

[7410485] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota}
time:   00:17:09
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410485/

[7410486] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:47:37
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410486/

[7410487] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc}
time:   00:19:59
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410487/

[7410488] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:12:21
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410488/

[7410489] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep}
time:   00:18:08
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410489/

[7410490] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls}
time:   00:17:43
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410490/

[7410491] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}
time:   00:16:54
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410491/

[7410492] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
time:   01:21:57
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410492/

[7410493] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   01:15:21
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410493/

[7410495] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}}
time:   00:13:37
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410495/

[7410496] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin}
time:   01:28:38
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410496/

[7410497] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsstress}}
time:   00:36:14
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410497/

[7410498] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:24:37
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410498/

[7410499] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:24
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410499/

[7410500] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:17:45
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410500/

[7410501] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}
time:   00:24:25
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410501/

[7410502] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool}
time:   00:15:02
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410502/

[7410503] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree}
time:   00:22:50
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410503/

[7410504] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}
time:   00:48:56
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410504/

[7410505] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}}
time:   00:35:12
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410505/

[7410506] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair}
time:   00:14:37
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410506/

[7410507] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}
time:   00:14:12
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410507/

[7410508] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:33:24
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410508/

[7410509] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}}
time:   00:18:59
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410509/

[7410510] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace}
time:   00:14:47
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410510/

[7410511] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
time:   00:24:39
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410511/

[7410512] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}
time:   00:44:26
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410512/

[7410513] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush}
time:   00:15:38
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410513/

[7410514] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsync-tester}}
time:   00:35:57
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410514/

[7410516] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:42
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410516/

[7410517] fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate} centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137}
time:   00:10:59
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410517/

[7410518] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/single-container-host}
time:   00:48:52
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410518/

[7410519] fs/full/{begin/{0-install 1-ceph 2-logrotate} clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full}
time:   00:17:46
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410519/

[7410520] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client}
time:   00:14:09
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410520/

[7410522] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distro$/{centos_latest} workloads/cephfs-mirror-ha-workunit}
time:   00:18:57
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410522/

[7410523] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:43:13
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410523/

[7410525] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
time:   00:34:29
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410525/

[7410526] fs/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs}
time:   00:24:36
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410526/

[7410527] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:13:52
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410527/

[7410528] fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell}
time:   00:42:43
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410528/

[7410529] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:47:18
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410529/

[7410530] fs/top/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/fstop}
time:   00:11:35
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410530/

[7410531] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc}
time:   00:23:40
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410531/

[7410532] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:26:08
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410532/

[7410534] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}}
time:   01:44:03
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410534/

[7410535] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead}
time:   00:14:26
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410535/

[7410536] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:56
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410536/

[7410538] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}}
time:   00:16:01
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410538/

[7410539] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/test_o_trunc}}
time:   00:39:55
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410539/

[7410540] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery}
time:   00:52:28
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410540/

[7410541] fs/upgrade/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}}
time:   00:13:12
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410541/

[7410542] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage}
time:   00:25:58
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410542/

[7410543] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:15:42
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410543/

[7410544] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}}
time:   00:15:09
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410544/

[7410546] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}
time:   00:22:47
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410546/

[7410547] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan}
time:   00:47:23
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410547/

[7410548] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}}
time:   00:15:24
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410548/

[7410549] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/iogen}}
time:   00:51:46
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410549/

[7410550] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}
time:   00:23:21
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410550/

[7410551] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports}
time:   00:59:24
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410551/

[7410552] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:16:19
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410552/

[7410553] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:15
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410553/

[7410554] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:18:20
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410554/

[7410556] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}
time:   00:18:56
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410556/

[7410557] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iozone}}
time:   00:32:03
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410557/

[7410558] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment}
time:   00:21:34
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410558/

[7410559] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}}
time:   00:17:51
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410559/

[7410560] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file}
time:   00:14:54
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410560/

[7410561] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
time:   01:14:10
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410561/

[7410562] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:48:24
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410562/

[7410563] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}}
time:   00:19:06
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410563/

[7410566] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}
time:   00:49:41
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410566/

[7410567] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}}
time:   00:16:29
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410567/

[7410568] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
time:   00:24:13
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410568/

[7410569] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}
time:   00:36:27
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410569/

[7410570] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush}
time:   00:10:29
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410570/

[7410571] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/pjd}}
time:   00:35:41
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410571/

[7410572] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:34
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410572/

[7410573] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}}
time:   00:15:12
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410573/

[7410574] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/lockdep}
time:   00:18:19
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410574/

[7410575] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}
time:   00:24:41
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410575/

[7410576] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:04
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410576/

[7410577] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry}
time:   00:17:14
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410577/

[7410578] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb}
time:   00:10:39
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410578/

[7410579] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}
time:   00:16:48
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410579/

[7410580] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}}
time:   00:34:04
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410580/

[7410581] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics}
time:   00:27:29
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410581/

[7410582] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/direct_io}}
time:   00:30:41
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410582/

[7410583] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}}
time:   01:00:20
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410583/

[7410584] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:25:41
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410584/

[7410585] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc}
time:   00:20:55
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410585/

[7410587] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}}
time:   00:17:54
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410587/

[7410588] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable}
time:   00:17:54
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410588/

[7410589] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}}
time:   01:11:43
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410589/

[7410590] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/fs/misc}}
time:   01:21:59
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410590/

[7410591] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}
time:   00:20:41
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410591/

[7410592] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}
time:   00:26:59
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410592/

[7410593] fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}
time:   00:40:59
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410593/

[7410594] fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}
time:   01:51:04
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410594/

[7410595] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}
time:   00:14:52
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410595/

[7410596] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}
time:   00:40:39
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410596/

[7410598] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota}
time:   00:17:46
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410598/

[7410599] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:17:08
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410599/

[7410600] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}
time:   00:44:50
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410600/

[7410601] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:16:33
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410601/

[7410602] fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc}
time:   00:31:11
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410602/

[7410603] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}}
time:   01:34:56
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410603/

[7410604] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs}
time:   00:15:34
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410604/

[7410605] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}}
time:   00:44:53
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410605/

[7410606] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:33
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410606/

[7410607] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}}
time:   00:15:37
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410607/

[7410608] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub}
time:   00:29:29
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410608/

[7410610] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap}
time:   00:17:22
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410610/

[7410611] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}
time:   00:23:24
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410611/

[7410612] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}
time:   00:16:27
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410612/

[7410615] fs/upgrade/upgraded_client/{bluestore-bitmap centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}}
time:   00:52:52
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410615/

[7410618] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}
time:   00:18:20
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410618/

[7410619] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap_schedule_snapdir}
time:   00:14:05
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410619/

[7410620] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:36
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410620/

[7410621] fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:12:13
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410621/

[7410622] fs/cephadm/renamevolume/{0-start 1-rename distro/single-container-host overrides/ignorelist_health}
time:   00:20:35
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410622/

[7410623] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}}
time:   00:19:23
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410623/

[7410625] fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}
time:   01:10:29
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410625/

[7410626] fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd}
time:   00:15:45
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410626/

[7410628] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}}
time:   00:18:12
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410628/

[7410629] fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}
time:   00:27:13
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410629/

[7410630] fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/blogbench}}
time:   00:41:21
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410630/

[7410631] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}}
time:   00:24:52
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410631/

[7410633] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}}
time:   00:19:05
info:   http://pulpito.ceph.com/yuriw-2023-10-04_15:51:41-fs-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410633/