2026-02-20T12:52:12.466 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T12:52:12.466 INFO:teuthology.results:subset: '186/1024' 2026-02-20T12:52:12.466 INFO:teuthology.results:seed: '7416' 2026-02-20T15:27:44.202 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T15:27:44.210 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2026-02-20T20:22:10.985 INFO:teuthology.results:Tests finished! gathering results... 2026-02-20T20:22:17.688 INFO:scrape:Found 263 jobs 2026-02-20T20:22:45.085 WARNING:scrape:Missing teuthology log /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60222/teuthology.log 2026-02-20T20:23:20.412 INFO:scrape:Found 35 distinct failure reasons 2026-02-20T20:23:20.412 INFO:scrape:Failure: valgrind error: Leak_StillReachable malloc 2026-02-20T20:23:20.412 INFO:scrape:3 jobs: ['60315', '60209', '60420'] 2026-02-20T20:23:20.412 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mon-debug', 'mount/fuse', 'osd}', 'overrides/{ignorelist_health', 'pg_health', 'session_timeout}', 'tasks/dbench', 'validater/valgrind}'] 2026-02-20T20:23:20.412 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu/{overrides', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'pg_health', 'ranks/1', 'ranks/3', 'ranks/5', 'session_timeout}', 'tasks/dbench', 'ubuntu_latest}}', 'validater/valgrind}'] 2026-02-20T20:23:20.412 INFO:scrape: 2026-02-20T20:23:20.412 INFO:scrape:Failure: Test failure: test_async_io_fio (tasks.cephfs.test_nfs.TestNFS.test_async_io_fio) 2026-02-20T20:23:20.412 INFO:scrape:1 jobs: ['60243'] 2026-02-20T20:23:20.412 INFO:scrape:suites: ['conf/{client', 'fs/nfs/{cluster/{1-node}', 'ignorelist_health', 'mds', 'mgr', 'mon', 'nfs-version/{4.2}', 'osd}', 'overrides/{ignore_mgr_down', 'pg_health}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/nfs}'] 2026-02-20T20:23:20.412 INFO:scrape: 2026-02-20T20:23:20.412 INFO:scrape:Failure: error during thrashing 2026-02-20T20:23:20.412 INFO:scrape:10 jobs: ['60384', '60335', '60435', '60213', '60461', '60281', '60264', '60304', '60413', '60358'] 2026-02-20T20:23:20.412 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'conf/{client', 'frag', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{client-shutdown', 'pg_health', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}'] 2026-02-20T20:23:20.412 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '2-workunit/cfuse_workunit_suites_fsstress}}', '2-workunit/cfuse_workunit_suites_pjd}}', '2-workunit/cfuse_workunit_trivial_sync}}', '2-workunit/ffsb}}', '2-workunit/fs/trivial_sync}}', '2-workunit/iozone}}', '2-workunit/suites/ffsb}}', '2-workunit/suites/fsstress}}', '3-kernel}', 'clusters/1a3s-mds-2c-client', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'frag', 'fs/thrash/multifs/{begin/{0-install', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{client-shutdown', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'pg_health', 'prefetch_entire_dirfrags/no', 'prefetch_entire_dirfrags/yes', 'prefetch_oft_dirfrags/no', 'prefetch_oft_dirfrags/yes', 'races', 'ranks/1', 'ranks/3', 'ranks/5', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}'] 2026-02-20T20:23:20.412 INFO:scrape: 2026-02-20T20:23:20.412 INFO:scrape:Failure: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic) 2026-02-20T20:23:20.412 INFO:scrape:1 jobs: ['60359'] 2026-02-20T20:23:20.412 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{0-use-snaprealm/{global}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/xfstests-dev}'] 2026-02-20T20:23:20.413 INFO:scrape: 2026-02-20T20:23:20.413 INFO:scrape:Failure: 2026-02-20T20:23:20.413 INFO:scrape:6 jobs: ['60406', '60255', '60278', '60381', '60223', '60357'] 2026-02-20T20:23:20.413 INFO:scrape:suites intersection: ['1-client', '2-upgrade', 'centos_9.stream', 'clusters/1-mds-2-client-micro', 'conf/{client', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'multimds/no', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}', 'tasks/{0-from/reef'] 2026-02-20T20:23:20.413 INFO:scrape:suites union: ['1-client', '2-upgrade', '3-client-upgrade', '3-compat_client/no}}', '3-compat_client/yes}}', '4-compat_client', '5-client-sanity}}', 'centos_9.stream', 'clusters/1-mds-2-client-micro', 'conf/{client', 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap', 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'multimds/no', 'multimds/yes', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}', 'tasks/{0-from/reef'] 2026-02-20T20:23:20.413 INFO:scrape: 2026-02-20T20:23:20.413 INFO:scrape:Failure: Test failure: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirroring.TestMirroring.test_add_ancestor_and_child_directory) 2026-02-20T20:23:20.413 INFO:scrape:2 jobs: ['60248', '60238'] 2026-02-20T20:23:20.413 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'mount/fuse', 'overrides/{ignorelist_health', 'pg_health}'] 2026-02-20T20:23:20.413 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'centos_latest', 'cephfs-mirror/one-per-cluster', 'clients/mirror', 'clients/{mirror}', 'cluster/1-node', 'cluster/{1-node}', 'conf/{client', 'debug', 'fs/mirror/{begin/{0-install', 'fs/valgrind/{begin/{0-install', 'mds', 'mgr', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mount/fuse', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/mirror}', 'tasks/mirror}}'] 2026-02-20T20:23:20.413 INFO:scrape: 2026-02-20T20:23:20.413 INFO:scrape:Failure: Test failure: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction) 2026-02-20T20:23:20.413 INFO:scrape:1 jobs: ['60421'] 2026-02-20T20:23:20.413 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/volumes/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/volumes/{0-use-snaprealm/{global}', 'test/misc}}'] 2026-02-20T20:23:20.413 INFO:scrape: 2026-02-20T20:23:20.413 INFO:scrape:Failure: Test failure: test_journal_migration (tasks.cephfs.test_journal_migration.TestJournalMigration.test_journal_migration) 2026-02-20T20:23:20.413 INFO:scrape:1 jobs: ['60332'] 2026-02-20T20:23:20.413 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{0-use-snaprealm/{global}', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/test_journal_migration}'] 2026-02-20T20:23:20.413 INFO:scrape: 2026-02-20T20:23:20.413 INFO:scrape:Failure: Command failed (workunit test client/test_oc_disabled.sh) on trial105 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test_oc_disabled.sh' 2026-02-20T20:23:20.413 INFO:scrape:1 jobs: ['60237'] 2026-02-20T20:23:20.413 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'clusters/1-mds-1-client-coloc', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/libcephfs/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/client}'] 2026-02-20T20:23:20.413 INFO:scrape: 2026-02-20T20:23:20.413 INFO:scrape:Failure: Command failed (workunit test fs/fscrypt.sh) on trial102 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt.sh unlocked dbench' 2026-02-20T20:23:20.413 INFO:scrape:2 jobs: ['60450', '60348'] 2026-02-20T20:23:20.413 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'osd', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}'] 2026-02-20T20:23:20.414 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'osd', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}', 'tasks/{1-tests/fscrypt-dbench}}', 'tasks/{1-tests/fscrypt-iozone}}'] 2026-02-20T20:23:20.414 INFO:scrape: 2026-02-20T20:23:20.414 INFO:scrape:Failure: Command failed on trial020 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp' 2026-02-20T20:23:20.414 INFO:scrape:3 jobs: ['60262', '60297', '60400'] 2026-02-20T20:23:20.414 INFO:scrape:suites intersection: ['conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'osd}'] 2026-02-20T20:23:20.414 INFO:scrape:suites union: ['0-subvolume/{with-namespace-isolated}', '0-use-snaprealm/{subvol}', '1-cephadm', '1-check-counter', '1-mount/fuse', '1-mount/kclient/{mount-syntax/{v1}', '2-logrotate', '2-scrub/yes', '2-test_admin_squid_client}}', '3-kernel}', '3-snaps/no', '4-flush/yes', '5-quiesce/with-quiesce', '6-workunit/suites/blogbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'distro/{centos_latest}', 'export-check', 'frag', 'fs/bugs/multifs_mdsauthcaps/{clusters/1node-cluster-1node-client', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'n/5', 'no_client_pidfile', 'objectstore-ec/bluestore-comp', 'objectstore/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health', 'pg_health}', 'ranks/multi/{balancer/random', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}', 'tasks/{0-install', 'wsync/yes}'] 2026-02-20T20:23:20.414 INFO:scrape: 2026-02-20T20:23:20.414 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds 2026-02-20T20:23:20.414 INFO:scrape:2 jobs: ['60231', '60267'] 2026-02-20T20:23:20.414 INFO:scrape:suites intersection: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client/fuse', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/squid'] 2026-02-20T20:23:20.414 INFO:scrape:suites union: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client/fuse', '3-inline/no', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'fail_fs/yes', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/squid'] 2026-02-20T20:23:20.414 INFO:scrape: 2026-02-20T20:23:20.414 INFO:scrape:Failure: "2026-02-20T14:21:36.296908+0000 mon.trial066 (mon.0) 369 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log 2026-02-20T20:23:20.414 INFO:scrape:1 jobs: ['60338'] 2026-02-20T20:23:20.414 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client/kclient', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/yes', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/reef/{v18.2.1}'] 2026-02-20T20:23:20.414 INFO:scrape: 2026-02-20T20:23:20.414 INFO:scrape:Dead: b'2026-02-20T20:21:13.586 DEBUG:teuthology.exit:Finished running handlers' 2026-02-20T20:23:20.414 INFO:scrape:2 jobs: ['60351', '60305'] 2026-02-20T20:23:20.414 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{0-use-snaprealm/{subvol}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}'] 2026-02-20T20:23:20.414 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs/functional/{0-use-snaprealm/{subvol}', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/scrub}', 'tasks/uninlining}'] 2026-02-20T20:23:20.414 INFO:scrape: 2026-02-20T20:23:20.414 INFO:scrape:Failure: Command failed on trial105 with status 110: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6d4df5b0-0e64-11f1-be22-d404e6e7d460 -e sha1=0917c15888a16c5bbbd9de28990cc81230360c9e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force'" 2026-02-20T20:23:20.414 INFO:scrape:2 jobs: ['60307', '60411'] 2026-02-20T20:23:20.414 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-allow_standby_replay/yes', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/squid'] 2026-02-20T20:23:20.414 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/squid'] 2026-02-20T20:23:20.414 INFO:scrape: 2026-02-20T20:23:20.415 INFO:scrape:Failure: Test failure: test_dir_merge_with_snap_items (tasks.cephfs.test_fragment.TestFragmentation.test_dir_merge_with_snap_items) 2026-02-20T20:23:20.415 INFO:scrape:1 jobs: ['60448'] 2026-02-20T20:23:20.415 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{0-use-snaprealm/{global}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/fragment}'] 2026-02-20T20:23:20.415 INFO:scrape: 2026-02-20T20:23:20.415 INFO:scrape:Failure: Test failure: test_fscrypt_clone (tasks.cephfs.test_fscrypt.TestFSCryptVolumes.test_fscrypt_clone) 2026-02-20T20:23:20.415 INFO:scrape:2 jobs: ['60235', '60415'] 2026-02-20T20:23:20.415 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'osd', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}', 'tasks/{1-tests/fscrypt-common}}'] 2026-02-20T20:23:20.415 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'osd', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}', 'tasks/{1-tests/fscrypt-common}}'] 2026-02-20T20:23:20.415 INFO:scrape: 2026-02-20T20:23:20.415 INFO:scrape:Failure: Command failed (workunit test fs/misc/direct_io.py) on trial057 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/direct_io.py' 2026-02-20T20:23:20.415 INFO:scrape:1 jobs: ['60424'] 2026-02-20T20:23:20.415 INFO:scrape:suites: ['0-subvolume/{with-quota}', '0-use-snaprealm/{subvol}', '1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/no', '3-kernel}', '3-snaps/yes', '4-flush/yes', '5-quiesce/with-quiesce', '6-workunit/fs/misc}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'n/3', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'pg_health', 'ranks/multi/{balancer/automatic', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}'] 2026-02-20T20:23:20.415 INFO:scrape: 2026-02-20T20:23:20.415 INFO:scrape:Failure: Test failure: test_random (tasks.cephfs.test_dump_tree.TestDumpTree.test_random) 2026-02-20T20:23:20.415 INFO:scrape:1 jobs: ['60388'] 2026-02-20T20:23:20.415 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{0-use-snaprealm/{subvol}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/asok_dump_tree}'] 2026-02-20T20:23:20.415 INFO:scrape: 2026-02-20T20:23:20.415 INFO:scrape:Failure: Command failed (workunit test suites/dbench.sh) on trial016 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2026-02-20T20:23:20.415 INFO:scrape:2 jobs: ['60266', '60382'] 2026-02-20T20:23:20.415 INFO:scrape:suites intersection: ['0-use-snaprealm/{global}', '1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/no', '3-kernel}', '3-snaps/yes', '5-quiesce/no', '6-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'n/5', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{centos_9.stream', 'pg_health', 'ranks/multi/{balancer/automatic', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}', 'wsync/no}'] 2026-02-20T20:23:20.415 INFO:scrape:suites union: ['0-subvolume/{with-namespace-isolated-and-quota}', '0-subvolume/{with-quota}', '0-use-snaprealm/{global}', '1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/no', '3-kernel}', '3-snaps/yes', '4-flush/no', '4-flush/yes', '5-quiesce/no', '6-workunit/suites/dbench}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/crc', 'ms_mode/secure', 'n/5', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/stock/{centos_9.stream', 'pg_health', 'ranks/multi/{balancer/automatic', 'replication/always}', 'replication/default}', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}', 'wsync/no}'] 2026-02-20T20:23:20.415 INFO:scrape: 2026-02-20T20:23:20.415 INFO:scrape:Failure: Command failed (workunit test fs/fscrypt_kclient_fuse.sh) on trial130 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/fscrypt-fuse && cd -- /home/ubuntu/cephtest/mnt.0/fscrypt-fuse && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 4h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt_kclient_fuse.sh fuse' 2026-02-20T20:23:20.415 INFO:scrape:2 jobs: ['60240', '60373'] 2026-02-20T20:23:20.415 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'ms-die-on-skipped}', 'osd-asserts', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/fscrypt-kbuild}'] 2026-02-20T20:23:20.415 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu/{overrides', 'fs/mixed-clients/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'k-stock}', 'kclient-overrides/{distro/stock/{centos_9.stream', 'kclient-overrides/{distro/testing/k-testing', 'mds', 'mgr', 'mon', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-ec-root', 'osd-asserts', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/fscrypt-kbuild}', 'ubuntu_latest}}'] 2026-02-20T20:23:20.416 INFO:scrape: 2026-02-20T20:23:20.416 INFO:scrape:Failure: Test failure: test_export_pin_many (tasks.cephfs.test_exports.TestExportPin.test_export_pin_many) 2026-02-20T20:23:20.416 INFO:scrape:1 jobs: ['60219'] 2026-02-20T20:23:20.416 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{0-use-snaprealm/{global}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/exports}'] 2026-02-20T20:23:20.416 INFO:scrape: 2026-02-20T20:23:20.416 INFO:scrape:Failure: Command failed on trial095 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.2-1jammy cephadm=19.2.2-1jammy ceph-mds=19.2.2-1jammy ceph-mgr=19.2.2-1jammy ceph-osd=19.2.2-1jammy ceph-osd-classic=19.2.2-1jammy ceph-common=19.2.2-1jammy ceph-fuse=19.2.2-1jammy ceph-test=19.2.2-1jammy ceph-volume=19.2.2-1jammy radosgw=19.2.2-1jammy python3-rados=19.2.2-1jammy python3-rgw=19.2.2-1jammy python3-cephfs=19.2.2-1jammy python3-rbd=19.2.2-1jammy libcephfs2=19.2.2-1jammy libcephfs-dev=19.2.2-1jammy librados2=19.2.2-1jammy librbd1=19.2.2-1jammy rbd-fuse=19.2.2-1jammy' 2026-02-20T20:23:20.416 INFO:scrape:1 jobs: ['60449'] 2026-02-20T20:23:20.416 INFO:scrape:suites: ['1-mount/kclient/{mount-syntax/{v1}', '2-test_admin_squid_client}}', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/bugs/multifs_mdsauthcaps/{clusters/1node-cluster-1node-client', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/{0-install'] 2026-02-20T20:23:20.416 INFO:scrape: 2026-02-20T20:23:20.416 INFO:scrape:Failure: Command failed (workunit test fs/misc/fallocate.sh) on trial069 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/fallocate.sh' 2026-02-20T20:23:20.416 INFO:scrape:1 jobs: ['60306'] 2026-02-20T20:23:20.416 INFO:scrape:suites: ['0-subvolume/{with-namespace-isolated-and-quota}', '0-use-snaprealm/{subvol}', '1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/yes', '3-kernel}', '3-snaps/no', '4-flush/no', '5-quiesce/with-quiesce', '6-workunit/fs/misc}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'n/3', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'pg_health', 'ranks/multi/{balancer/random', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}', 'wsync/yes}'] 2026-02-20T20:23:20.416 INFO:scrape: 2026-02-20T20:23:20.416 INFO:scrape:Dead: None 2026-02-20T20:23:20.416 INFO:scrape:1 jobs: ['60222'] 2026-02-20T20:23:20.416 INFO:scrape: 2026-02-20T20:23:20.416 INFO:scrape:Failure: Command failed (workunit test suites/fsx.sh) on trial024 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2026-02-20T20:23:20.416 INFO:scrape:2 jobs: ['60452', '60217'] 2026-02-20T20:23:20.416 INFO:scrape:suites intersection: ['0-use-snaprealm/{subvol}', '1-cephadm', '1-check-counter', '2-logrotate', '3-kernel}', '4-flush/yes', '5-quiesce/with-quiesce', '6-workunit/suites/fsx}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'pg_health', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}'] 2026-02-20T20:23:20.416 INFO:scrape:suites union: ['0-subvolume/{with-namespace-isolated}', '0-subvolume/{with-no-extra-options}', '0-use-snaprealm/{subvol}', '1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/no', '2-scrub/yes', '3-kernel}', '3-snaps/no', '3-snaps/yes', '4-flush/yes', '5-quiesce/with-quiesce', '6-workunit/suites/fsx}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'n/3', 'n/5', 'objectstore-ec/bluestore-bitmap', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'pg_health', 'ranks/multi/{balancer/automatic', 'ranks/multi/{balancer/random', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}'] 2026-02-20T20:23:20.416 INFO:scrape: 2026-02-20T20:23:20.416 INFO:scrape:Failure: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm) 2026-02-20T20:23:20.416 INFO:scrape:1 jobs: ['60277'] 2026-02-20T20:23:20.416 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{0-use-snaprealm/{subvol}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/pool-perm}'] 2026-02-20T20:23:20.416 INFO:scrape: 2026-02-20T20:23:20.416 INFO:scrape:Failure: error during quiesce thrashing: Error quiescing set '64615620': 110 (ETIMEDOUT) 2026-02-20T20:23:20.416 INFO:scrape:2 jobs: ['60387', '60291'] 2026-02-20T20:23:20.417 INFO:scrape:suites intersection: ['1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/yes', '3-kernel}', '3-snaps/no', '5-quiesce/with-quiesce', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'pg_health', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}', 'wsync/yes}'] 2026-02-20T20:23:20.417 INFO:scrape:suites union: ['0-subvolume/{with-namespace-isolated-and-quota}', '0-subvolume/{with-namespace-isolated}', '0-use-snaprealm/{global}', '0-use-snaprealm/{subvol}', '1-cephadm', '1-check-counter', '2-logrotate', '2-scrub/yes', '3-kernel}', '3-snaps/no', '4-flush/no', '4-flush/yes', '5-quiesce/with-quiesce', '6-workunit/suites/ffsb}}', '6-workunit/suites/iogen}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'export-check', 'frag', 'fs/workload/{0-centos_9.stream', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'n/3', 'n/5', 'objectstore-ec/bluestore-comp', 'omap_limit/10000', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'overrides/{distro/testing/k-testing', 'pg_health', 'ranks/multi/{balancer/automatic', 'ranks/multi/{balancer/random', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-fscrypt/{with-fscrypt-dummy}', 'wsync/yes}'] 2026-02-20T20:23:20.417 INFO:scrape: 2026-02-20T20:23:20.417 INFO:scrape:Failure: Test failure: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files) 2026-02-20T20:23:20.417 INFO:scrape:2 jobs: ['60433', '60216'] 2026-02-20T20:23:20.417 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs/functional/{0-use-snaprealm/{global}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/data-scan}'] 2026-02-20T20:23:20.417 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs/functional/{0-use-snaprealm/{global}', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/data-scan}'] 2026-02-20T20:23:20.417 INFO:scrape: 2026-02-20T20:23:20.417 INFO:scrape:Failure: Test failure: test_rename_primary_to_existing_referent_dentry (tasks.cephfs.test_referent.TestReferentInode.test_rename_primary_to_existing_referent_dentry) 2026-02-20T20:23:20.417 INFO:scrape:1 jobs: ['60301'] 2026-02-20T20:23:20.417 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/functional/{0-use-snaprealm/{global}', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/referent}'] 2026-02-20T20:23:20.417 INFO:scrape: 2026-02-20T20:23:20.417 INFO:scrape:Failure: Command failed (workunit test suites/ffsb.sh) on trial070 with status 135: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' 2026-02-20T20:23:20.417 INFO:scrape:1 jobs: ['60259'] 2026-02-20T20:23:20.417 INFO:scrape:suites: ['1-ceph', '2-logrotate', '2-workunit/suites/ffsb}}', '3-kernel}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'frag', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{client-shutdown', 'overrides/{distro/testing/k-testing', 'pg_health', 'prefetch_entire_dirfrags/no', 'prefetch_oft_dirfrags/yes', 'races', 'ranks/3', 'session_timeout', 'tasks/{1-thrash/with-quiesce', 'thrashosds-health}'] 2026-02-20T20:23:20.417 INFO:scrape: 2026-02-20T20:23:20.417 INFO:scrape:Assertion: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7f531eb85bf3] 2026-02-20T20:23:20.417 INFO:scrape:ceph version 20.3.0-5390-g0917c158 (0917c15888a16c5bbbd9de28990cc81230360c9e) tentacle (dev - RelWithDebInfo) 1: /lib64/libc.so.6(+0x3fc30) [0x7f531e03fc30] 2: /lib64/libc.so.6(+0x8d03c) [0x7f531e08d03c] 3: raise() 4: abort() 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18e) [0x7f531eb85bf3] 6: ceph-mds() [0x4e109c] 7: (CInode::pop_and_dirty_projected_inode(std::shared_ptr const&, boost::intrusive_ptr const&)+0x214) [0x7d7504] 8: (MutationImpl::apply()+0x93) [0x65dca3] 9: (Server::_unlink_local_finish(boost::intrusive_ptr const&, CDentry*, CDentry*, unsigned long)+0x2e9) [0x618949] 10: (MDSIOContextBase::complete(int)+0x39c) [0x85328c] 11: (MDSLogContextBase::complete(int)+0x53) [0x853403] 12: (Finisher::finisher_thread_entry()+0x16d) [0x7f531ec95acd] 13: /lib64/libc.so.6(+0x8b2fa) [0x7f531e08b2fa] 14: /lib64/libc.so.6(+0x110400) [0x7f531e110400] 2026-02-20T20:23:20.417 INFO:scrape:1 jobs: ['60386'] 2026-02-20T20:23:20.417 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'bluestore-bitmap', 'clusters/1-mds-1-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/fscrypt/{begin/{0-install', 'ignorelist_health_more', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'osd', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health}', 'tasks/{1-tests/fscrypt-pjd}}'] 2026-02-20T20:23:20.417 INFO:scrape: 2026-02-20T20:23:20.417 INFO:scrape:Crash: Command failed on trial012 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 405dd151-0e69-11f1-a746-d404e6e7d460 -e sha1=0917c15888a16c5bbbd9de28990cc81230360c9e -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2026-02-20T20:23:20.417 INFO:scrape:ceph version 19.2.3-672-g283431c0 (283431c091dafc302f5753f809d0bd1eddce0869) squid (stable) 1: /lib64/libc.so.6(+0x3fc30) [0x7f117943fc30] 2: /lib64/libc.so.6(+0x8d03c) [0x7f117948d03c] 3: raise() 4: abort() 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x17f) [0x7f117a384524] 6: ceph-fuse(+0xf875b) [0x55f002d2075b] 7: ceph-fuse(+0xb642d) [0x55f002cde42d] 8: (Finisher::finisher_thread_entry()+0x17d) [0x7f117a44344d] 9: /lib64/libc.so.6(+0x8b2fa) [0x7f117948b2fa] 10: /lib64/libc.so.6(+0x110400) [0x7f1179510400] 2026-02-20T20:23:20.417 INFO:scrape:1 jobs: ['60363'] 2026-02-20T20:23:20.418 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/squid'] 2026-02-20T20:23:20.418 INFO:scrape: 2026-02-20T20:23:20.418 INFO:scrape:Failure: Command failed (workunit test fs/snaps/snap-rm-diff.sh) on trial059 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh' 2026-02-20T20:23:20.418 INFO:scrape:1 jobs: ['60352'] 2026-02-20T20:23:20.418 INFO:scrape:suites: ['1-ceph', '2-logrotate', '2-workunit/cfuse_workunit_snaptests}}', '3-kernel}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_latest}', 'frag', 'fs/thrash/multifs/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{client-shutdown', 'pg_health', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}'] 2026-02-20T20:23:20.418 INFO:scrape: 2026-02-20T20:23:20.418 INFO:scrape:Failure: Test failure: test_filelock (tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock) 2026-02-20T20:23:20.418 INFO:scrape:1 jobs: ['60425'] 2026-02-20T20:23:20.418 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'begin/{0-install', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{0-use-snaprealm/{global}', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount/fuse', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/client-recovery}'] 2026-02-20T20:23:20.418 INFO:scrape: 2026-02-20T20:23:20.423 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial ================================================================= info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/ logs: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/ failed: 61 dead: 3 running: 0 waiting: 0 queued: 0 passed: 199 Fail ================================================================= [60209] fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/dbench validater/valgrind} ----------------------------------------------------------------- time: 00:38:55 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60209/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60209/ valgrind error: Leak_StillReachable malloc [60213] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} ----------------------------------------------------------------- time: 00:15:08 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60213/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60213/ error during thrashing [60216] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/data-scan} ----------------------------------------------------------------- time: 00:06:49 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60216/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60216/ Test failure: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_dat a_scan.TestDataScan.test_extra_data_pool_rebuild_few_files) [60217] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} ----------------------------------------------------------------- time: 00:17:18 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60217/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60217/ Command failed (workunit test suites/fsx.sh) on trial016 with status 110: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' [60219] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/exports} ----------------------------------------------------------------- time: 00:32:25 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60219/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60219/ Test failure: test_export_pin_many (tasks.cephfs.test_exports.TestExportPin.test_export_pin_many) [60223] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/yes}} ----------------------------------------------------------------- time: 01:40:50 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60223/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60223/ [60231] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:25:48 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60231/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60231/ reached maximum tries (50) after waiting for 300 seconds [60235] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-kernel} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{1-tests/fscrypt-common}} ----------------------------------------------------------------- time: 00:11:56 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60235/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60235/ Test failure: test_fscrypt_clone (tasks.cephfs.test_fscrypt.TestFSCryptVolumes.test_fscrypt_clone) [60237] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client} ----------------------------------------------------------------- time: 00:13:10 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60237/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60237/ Command failed (workunit test client/test_oc_disabled.sh) on trial105 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/client/test_oc_disabled.sh' [60238] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} ----------------------------------------------------------------- time: 00:08:06 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60238/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60238/ Test failure: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirr oring.TestMirroring.test_add_ancestor_and_child_directory) [60240] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/fscrypt-kbuild} ----------------------------------------------------------------- time: 04:15:48 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60240/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60240/ Command failed (workunit test fs/fscrypt_kclient_fuse.sh) on trial130 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/fscrypt-fuse && cd -- /home/ubuntu/cephtest/mnt.0/fscrypt-fuse && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 4h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/fs/fscrypt_kclient_fuse.sh fuse' [60243] fs/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} nfs-version/{4.2} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs} ----------------------------------------------------------------- time: 00:10:52 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60243/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60243/ Test failure: test_async_io_fio (tasks.cephfs.test_nfs.TestNFS.test_async_io_fio) [60248] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 00:15:03 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60248/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60248/ Test failure: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirr oring.TestMirroring.test_add_ancestor_and_child_directory) [60255] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/no}} ----------------------------------------------------------------- time: 01:43:33 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60255/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60255/ [60259] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:15:38 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60259/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60259/ Command failed (workunit test suites/ffsb.sh) on trial070 with status 135: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' [60262] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} ----------------------------------------------------------------- time: 00:31:05 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60262/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60262/ Command failed on trial020 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp' [60264] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} ----------------------------------------------------------------- time: 00:09:12 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60264/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60264/ error during thrashing [60266] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} ----------------------------------------------------------------- time: 00:24:56 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60266/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60266/ Command failed (workunit test suites/dbench.sh) on trial016 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' [60267] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:25:11 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60267/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60267/ reached maximum tries (50) after waiting for 300 seconds [60277] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/pool-perm} ----------------------------------------------------------------- time: 00:09:36 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60277/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60277/ Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm) [60278] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} ----------------------------------------------------------------- time: 02:29:06 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60278/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60278/ [60281] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} ----------------------------------------------------------------- time: 00:08:31 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60281/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60281/ error during thrashing [60291] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} ----------------------------------------------------------------- time: 00:29:46 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60291/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60291/ error during quiesce thrashing: Error quiescing set '541876f8': 110 (ETIMEDOUT) [60297] fs/bugs/multifs_mdsauthcaps/{clusters/1node-cluster-1node-client conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/{0-install 1-mount/fuse 2-test_admin_squid_client}} ----------------------------------------------------------------- time: 00:06:10 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60297/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60297/ Command failed on trial011 with status 1: 'sudo yum -y install ceph-osd- classic' [60301] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/referent} ----------------------------------------------------------------- time: 00:12:33 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60301/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60301/ Test failure: test_rename_primary_to_existing_referent_dentry (tasks.cephfs .test_referent.TestReferentInode.test_rename_primary_to_existing_referent_d entry) [60304] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} ----------------------------------------------------------------- time: 00:09:13 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60304/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60304/ error during thrashing [60306] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/misc}} ----------------------------------------------------------------- time: 00:21:07 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60306/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60306/ Command failed (workunit test fs/misc/fallocate.sh) on trial069 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/fallocate.sh' [60307] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:56:41 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60307/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60307/ Command failed on trial105 with status 110: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6d4df5b0-0e64-11f1-be22-d404e6e7d460 -e sha1=0917c15888a16c5bbbd9de28990cc81230360c9e -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force'" [60315] fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind} ----------------------------------------------------------------- time: 00:40:04 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60315/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60315/ valgrind error: Leak_StillReachable malloc [60332] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/test_journal_migration} ----------------------------------------------------------------- time: 00:08:40 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60332/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60332/ Test failure: test_journal_migration (tasks.cephfs.test_journal_migration.T estJournalMigration.test_journal_migration) [60335] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} ----------------------------------------------------------------- time: 00:12:27 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60335/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60335/ error during thrashing [60338] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:24:45 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60338/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60338/ "2026-02-20T14:21:36.296908+0000 mon.trial066 (mon.0) 369 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log [60348] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-kernel} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{1-tests/fscrypt-iozone}} ----------------------------------------------------------------- time: 00:11:46 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60348/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60348/ Command failed (workunit test fs/fscrypt.sh) on trial162 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt.sh unlocked iozone' [60352] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} ----------------------------------------------------------------- time: 00:09:07 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60352/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60352/ Command failed (workunit test fs/snaps/snap-rm-diff.sh) on trial059 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh' [60357] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/yes}} ----------------------------------------------------------------- time: 01:42:10 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60357/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60357/ [60358] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} ----------------------------------------------------------------- time: 00:08:26 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60358/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60358/ error during thrashing [60359] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/xfstests-dev} ----------------------------------------------------------------- time: 02:30:05 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60359/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60359/ Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic) [60363] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:22:48 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60363/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60363/ Command failed on trial012 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 405dd151-0e69-11f1-a746-d404e6e7d460 -e sha1=0917c15888a16c5bbbd9de28990cc81230360c9e -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [60373] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} kclient-overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/fscrypt-kbuild} ----------------------------------------------------------------- time: 04:14:54 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60373/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60373/ Command failed (workunit test fs/fscrypt_kclient_fuse.sh) on trial144 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/fscrypt-fuse && cd -- /home/ubuntu/cephtest/mnt.0/fscrypt-fuse && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 4h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/fs/fscrypt_kclient_fuse.sh fuse' [60381] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/no}} ----------------------------------------------------------------- time: 01:36:52 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60381/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60381/ [60382] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/dbench}} ----------------------------------------------------------------- time: 00:24:04 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60382/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60382/ Command failed (workunit test suites/dbench.sh) on trial107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' [60384] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} ----------------------------------------------------------------- time: 00:10:42 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60384/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60384/ error during thrashing [60386] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-kernel} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{1-tests/fscrypt-pjd}} ----------------------------------------------------------------- time: 00:30:59 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60386/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60386/ Command failed (workunit test fs/fscrypt.sh) on trial106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt.sh unlocked pjd' [60387] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:22:37 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60387/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60387/ error during quiesce thrashing: Error quiescing set '64615620': 110 (ETIMEDOUT) [60388] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/asok_dump_tree} ----------------------------------------------------------------- time: 00:10:47 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60388/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60388/ Test failure: test_random (tasks.cephfs.test_dump_tree.TestDumpTree.test_random) [60400] fs/bugs/multifs_mdsauthcaps/{clusters/1node-cluster-1node-client conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/{0-install 1-mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} 2-test_admin_squid_client}} ----------------------------------------------------------------- time: 00:04:18 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60400/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60400/ Command failed on trial050 with status 1: 'sudo yum -y install ceph-osd- classic' [60406] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} ----------------------------------------------------------------- time: 02:28:42 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60406/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60406/ [60411] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:19:10 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60411/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60411/ Command failed on trial006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ea9d7d8-0e6d-11f1-b52f-d404e6e7d460 -e sha1=0917c15888a16c5bbbd9de28990cc81230360c9e -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [60413] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} ----------------------------------------------------------------- time: 00:13:17 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60413/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60413/ error during thrashing [60415] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-kernel} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{1-tests/fscrypt-common}} ----------------------------------------------------------------- time: 00:10:36 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60415/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60415/ Test failure: test_fscrypt_clone (tasks.cephfs.test_fscrypt.TestFSCryptVolumes.test_fscrypt_clone) [60420] fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} ----------------------------------------------------------------- time: 00:42:00 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60420/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60420/ valgrind error: Leak_PossiblyLost operator new(unsigned long) allocate allocate [60421] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{global} overrides test/misc}} ----------------------------------------------------------------- time: 00:11:24 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60421/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60421/ Test failure: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction) [60424] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/misc}} ----------------------------------------------------------------- time: 00:26:49 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60424/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60424/ Command failed (workunit test fs/misc/direct_io.py) on trial057 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/direct_io.py' [60425] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client-recovery} ----------------------------------------------------------------- time: 00:33:02 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60425/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60425/ Test failure: test_filelock (tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock) [60433] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/data-scan} ----------------------------------------------------------------- time: 00:07:36 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60433/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60433/ Test failure: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_dat a_scan.TestDataScan.test_extra_data_pool_rebuild_few_files) [60435] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} ----------------------------------------------------------------- time: 00:15:08 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60435/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60435/ error during thrashing [60448] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/fragment} ----------------------------------------------------------------- time: 00:09:52 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60448/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60448/ Test failure: test_dir_merge_with_snap_items (tasks.cephfs.test_fragment.Te stFragmentation.test_dir_merge_with_snap_items) [60449] fs/bugs/multifs_mdsauthcaps/{clusters/1node-cluster-1node-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/{0-install 1-mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-test_admin_squid_client}} ----------------------------------------------------------------- time: 00:03:13 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60449/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60449/ Command failed on trial095 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.2-1jammy cephadm=19.2.2-1jammy ceph-mds=19.2.2-1jammy ceph- mgr=19.2.2-1jammy ceph-osd=19.2.2-1jammy ceph-osd-classic=19.2.2-1jammy ceph-common=19.2.2-1jammy ceph-fuse=19.2.2-1jammy ceph-test=19.2.2-1jammy ceph-volume=19.2.2-1jammy radosgw=19.2.2-1jammy python3-rados=19.2.2-1jammy python3-rgw=19.2.2-1jammy python3-cephfs=19.2.2-1jammy python3-rbd=19.2.2-1jammy libcephfs2=19.2.2-1jammy libcephfs- dev=19.2.2-1jammy librados2=19.2.2-1jammy librbd1=19.2.2-1jammy rbd- fuse=19.2.2-1jammy' [60450] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-kernel} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{1-tests/fscrypt-dbench}} ----------------------------------------------------------------- time: 00:44:05 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60450/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60450/ Command failed (workunit test fs/fscrypt.sh) on trial102 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt.sh unlocked dbench' [60452] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} ----------------------------------------------------------------- time: 00:26:48 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60452/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60452/ Command failed (workunit test suites/fsx.sh) on trial024 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0917c15888a16c5bbbd9de28990cc81230360c9e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' [60461] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} ----------------------------------------------------------------- time: 00:07:28 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60461/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60461/ error during thrashing Dead ================================================================= [60222] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/forward-scrub} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60222/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60222/ Error reimaging machines: Expected trial006's OS to be ubuntu 22.04 but found centos 9.stream [60305] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60305/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60305/ hit max job timeout [60351] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/uninlining} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60351/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60351/ killed Pass ================================================================= [60206] fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_fsstress} time: 00:09:54 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60206/ [60207] fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} time: 00:09:54 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60207/ [60208] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:15:49 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60208/ [60210] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/damage} time: 00:20:47 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60210/ [60211] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} time: 00:14:59 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60211/ [60212] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{global} overrides test/subvolume-snapshots-visibility}} time: 00:26:06 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60212/ [60214] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} time: 00:24:41 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60214/ [60215] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:24:03 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60215/ [60218] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} time: 00:11:56 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60218/ [60220] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} time: 00:23:29 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60220/ [60221] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} time: 00:28:32 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/ [60224] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} time: 00:10:30 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60224/ [60225] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} time: 00:25:31 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60225/ [60226] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/fragment} time: 00:28:15 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60226/ [60227] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iozone}} time: 00:22:17 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60227/ [60228] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} time: 00:26:45 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60228/ [60229] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/journal-repair} time: 00:15:43 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60229/ [60230] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/pjd}} time: 00:23:20 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60230/ [60232] fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_fsstress} time: 00:09:10 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60232/ [60233] fs/bugs/client_trim_caps/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest clusters/small-cluster conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/trim-i24137} time: 00:08:22 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60233/ [60234] fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} time: 00:46:29 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60234/ [60236] fs/full/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-node-4-mds-1-osd conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mgr-osd-full} time: 00:15:09 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60236/ [60239] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 02:31:24 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60239/ [60241] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cephfs_misc_tests} time: 00:59:28 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60241/ [60242] fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/multifs-auth} time: 00:28:09 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60242/ [60244] fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} time: 00:09:07 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60244/ [60245] fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/centos_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} time: 00:33:12 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60245/ [60246] fs/snaps/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} time: 00:34:35 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60246/ [60247] fs/top/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/fstop} time: 00:08:44 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60247/ [60249] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{subvol} overrides test/async}} time: 00:13:47 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60249/ [60250] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} time: 00:14:29 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60250/ [60251] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-flush} time: 00:08:28 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60251/ [60252] fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_ffsb traceless/50pc} time: 00:26:36 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60252/ [60253] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} time: 00:23:19 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60253/ [60254] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/misc}} time: 00:26:29 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60254/ [60256] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full} time: 00:15:36 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60256/ [60257] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/kernel_untar_build}} time: 02:57:36 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60257/ [60258] fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/reef 1-upgrade}} time: 00:08:59 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60258/ [60260] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/postgres}} time: 00:33:28 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60260/ [60261] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds_creation_retry} time: 00:10:33 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60261/ [60263] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/metrics} time: 00:21:52 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60263/ [60265] fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/fsstress validater/lockdep} time: 00:09:40 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60265/ [60268] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} time: 00:37:48 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60268/ [60269] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/multimds_misc} time: 00:12:20 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60269/ [60270] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/norstats}} time: 00:23:31 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60270/ [60271] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/exports 2-workunit/suites/fsstress}} time: 00:16:30 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60271/ [60272] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/openfiletable} time: 00:13:04 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60272/ [60273] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{global} overrides test/basic}} time: 01:57:02 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60273/ [60274] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} time: 00:16:33 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60274/ [60275] fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} time: 00:09:47 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60275/ [60276] fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} time: 00:10:45 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60276/ [60279] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-kernel} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{1-tests/fscrypt-dbench}} time: 01:12:50 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60279/ [60280] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} time: 00:24:00 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60280/ [60282] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} time: 00:17:17 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60282/ [60283] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/quiesce} time: 00:41:54 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60283/ [60284] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} time: 00:24:07 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60284/ [60285] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} time: 00:12:58 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60285/ [60286] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:41:40 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60286/ [60287] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/ior-shared-file} time: 00:09:18 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60287/ [60288] fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/failover} time: 01:19:05 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60288/ [60289] fs/snaps/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} time: 00:21:13 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60289/ [60290] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/quota} time: 00:11:24 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60290/ [60292] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:22:49 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60292/ [60293] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/iozone}} time: 00:24:14 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60293/ [60294] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/recovery-fs} time: 00:08:12 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60294/ [60295] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} time: 00:10:54 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60295/ [60296] fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_fsstress traceless/50pc} time: 00:10:35 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60296/ [60298] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client_full} time: 00:08:22 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60298/ [60299] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-compat_client/yes}} time: 00:13:14 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60299/ [60300] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/pjd}} time: 00:17:38 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60300/ [60302] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{global} overrides test/clone-progress}} time: 00:25:23 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60302/ [60303] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/direct_io}} time: 00:24:09 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60303/ [60308] fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_fsstress} time: 00:08:56 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60308/ [60309] fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} time: 00:08:31 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60309/ [60310] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/kernel_untar_build}} time: 00:25:42 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60310/ [60311] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/sessionmap} time: 00:13:28 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60311/ [60312] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} time: 00:11:08 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60312/ [60313] fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-kernel} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{1-tests/fscrypt-ffsb}} time: 00:24:26 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60313/ [60314] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} time: 00:34:20 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60314/ [60316] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-compat_client/no}} time: 00:16:28 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60316/ [60317] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/snap_schedule_snapdir} time: 00:06:01 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60317/ [60318] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} time: 00:31:14 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60318/ [60319] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} time: 00:18:58 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60319/ [60320] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/dbench}} time: 00:44:17 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60320/ [60321] fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/squid 1-upgrade}} time: 00:09:06 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60321/ [60322] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/snapshots} time: 00:25:28 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60322/ [60323] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} time: 00:28:26 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60323/ [60324] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} time: 00:22:21 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60324/ [60325] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/strays} time: 00:23:14 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60325/ [60326] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} time: 00:16:25 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60326/ [60327] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:19:59 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60327/ [60328] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/mdtest} time: 00:10:51 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60328/ [60329] fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/multifs-auth} time: 00:17:07 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60329/ [60330] fs/snaps/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} time: 00:19:52 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60330/ [60331] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{global} overrides test/clone}} time: 00:48:24 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60331/ [60333] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsstress}} time: 00:24:15 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60333/ [60334] fs/upgrade/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/squid 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/kernel_untar_build}} time: 01:22:03 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60334/ [60336] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsx}} time: 00:19:26 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60336/ [60337] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/test_snap_schedule/{overrides/{v2} snap-schedule}} time: 02:13:40 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60337/ [60339] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsync-tester}} time: 00:23:34 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60339/ [60340] fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} time: 00:10:25 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60340/ [60341] fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} time: 00:11:05 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60341/ [60342] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/exports 2-workunit/suites/ffsb}} time: 00:21:12 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60342/ [60343] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/truncate_delay} time: 00:09:04 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60343/ [60344] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} time: 00:29:09 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60344/ [60345] fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc} time: 00:16:25 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60345/ [60346] fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:14:11 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60346/ [60347] fs/bugs/snapshot_visibility_on_upgrade/{cluster/1-node conf/{client mds mgr mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/{0-install 1-test-subvolume-snapshot-default-visibility}} time: 00:09:32 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60347/ [60349] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/ino_release_cb} time: 00:08:07 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60349/ [60350] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} time: 00:24:58 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60350/ [60353] fs/upgrade/upgraded_client/{bluestore-bitmap centos_9.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-install/squid 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/new_ops/{newops}}} time: 00:08:34 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60353/ [60354] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/iozone}} time: 00:17:09 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60354/ [60355] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/dir-max-entries} time: 00:08:44 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60355/ [60356] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/pjd}} time: 00:23:11 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60356/ [60360] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{subvol} overrides test/finisher_per_module}} time: 00:07:24 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60360/ [60361] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/direct_io}} time: 00:19:58 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60361/ [60362] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/misc}} time: 00:27:01 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60362/ [60364] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/workunit/quota} time: 00:06:42 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60364/ [60365] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} time: 00:08:12 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60365/ [60366] fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/lockdep} time: 00:10:01 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60366/ [60367] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/kernel_untar_build}} time: 00:33:42 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60367/ [60368] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/acls} time: 00:09:32 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60368/ [60369] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/postgres}} time: 00:26:43 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60369/ [60370] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} time: 00:07:38 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60370/ [60371] fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} time: 00:08:57 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60371/ [60372] fs/cephadm/renamevolume/{0-start 1-rename conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} time: 00:10:40 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60372/ [60374] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cephfs_misc_tests} time: 00:59:10 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60374/ [60375] fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/failover} time: 01:32:53 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60375/ [60376] fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} time: 00:09:47 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60376/ [60377] fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} time: 00:31:11 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60377/ [60378] fs/snaps/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} time: 00:39:19 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60378/ [60379] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} time: 00:22:40 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60379/ [60380] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/admin} time: 02:19:58 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60380/ [60383] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/alternate-pool} time: 00:06:00 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60383/ [60385] fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/reef 1-upgrade}} time: 00:08:09 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60385/ [60389] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/norstats}} time: 00:23:01 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60389/ [60390] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{global} overrides test/metrics}} time: 00:10:01 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60390/ [60391] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} time: 00:10:38 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60391/ [60392] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} time: 00:16:31 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60392/ [60393] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/auto-repair} time: 00:08:18 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60393/ [60394] fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_dbench traceless/50pc} time: 00:43:08 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60394/ [60395] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:22:14 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60395/ [60396] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/fsx}} time: 00:23:39 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60396/ [60397] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/backtrace} time: 00:06:33 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60397/ [60398] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} time: 00:08:12 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60398/ [60399] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} time: 00:14:16 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60399/ [60401] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs/{frag test}} time: 01:21:59 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60401/ [60402] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} time: 00:23:24 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60402/ [60403] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cap-flush} time: 00:07:30 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60403/ [60404] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/pjd}} time: 00:11:48 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60404/ [60405] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/iogen}} time: 00:27:34 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60405/ [60407] fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_fsstress} time: 00:09:56 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60407/ [60408] fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} time: 00:09:10 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60408/ [60409] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/charmap} time: 00:16:37 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60409/ [60410] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} time: 00:23:19 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60410/ [60412] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client-limits} time: 00:12:19 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60412/ [60414] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} time: 00:15:18 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60414/ [60416] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_dbench_iozone} time: 00:34:44 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60416/ [60417] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/ior-shared-file} time: 00:08:03 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60417/ [60418] fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/multifs-auth} time: 00:15:09 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60418/ [60419] fs/snaps/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} time: 00:15:15 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60419/ [60422] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/direct_io}} time: 00:11:00 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60422/ [60423] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client-readahead} time: 00:07:19 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60423/ [60426] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-compat_client/yes}} time: 00:12:14 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60426/ [60427] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/kernel_untar_build}} time: 00:23:12 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60427/ [60428] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} time: 00:30:45 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60428/ [60429] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} time: 00:11:40 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60429/ [60430] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/damage} time: 00:14:44 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60430/ [60431] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:21:58 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60431/ [60432] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} time: 00:24:26 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60432/ [60434] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} time: 00:46:06 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60434/ [60436] fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} time: 00:09:05 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60436/ [60437] fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_pjd} time: 00:08:57 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60437/ [60438] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/exports} time: 00:44:34 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60438/ [60439] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} time: 00:18:29 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60439/ [60440] fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_ffsb traceless/50pc} time: 00:33:22 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60440/ [60441] fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-compat_client/no}} time: 00:15:58 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60441/ [60442] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} time: 00:25:19 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60442/ [60443] fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} time: 01:23:11 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60443/ [60444] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/forward-scrub} time: 00:12:11 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60444/ [60445] fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{0-use-snaprealm/{global} overrides test/snapshot}} time: 00:35:50 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60445/ [60446] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} time: 00:11:24 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60446/ [60447] fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/squid 1-upgrade}} time: 00:07:55 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60447/ [60451] fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs_python} time: 00:11:51 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60451/ [60453] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} time: 00:10:23 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60453/ [60454] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} time: 00:11:30 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60454/ [60455] fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/journal-repair} time: 00:14:44 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60455/ [60456] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} time: 00:28:25 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60456/ [60457] fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} kclient-overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_untarbuild_blogbench} time: 00:17:26 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60457/ [60458] fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/mdtest} time: 00:09:36 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60458/ [60459] fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/failover} time: 01:22:12 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60459/ [60460] fs/snaps/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} time: 00:21:32 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60460/ [60462] fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:21:07 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60462/ [60463] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-flush} time: 00:06:37 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60463/ [60464] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} time: 00:21:41 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60464/ [60465] fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full} time: 00:15:53 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60465/ [60466] fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iozone}} time: 00:26:41 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60466/ [60467] fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} time: 00:07:13 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60467/ [60468] fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/fsstress validater/lockdep} time: 00:09:55 info: https://pulpito.ceph.com/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60468/ 2026-02-20T20:23:20.433 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 33, in main results(args['--archive-dir'], args['--name'], args['--email'], File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 78, in results email_results( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 95, in email_results smtp = smtplib.SMTP('localhost') ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 255, in __init__ (code, msg) = self.connect(host, port) ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 341, in connect self.sock = self._get_socket(host, port, self.timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket return socket.create_connection((host, port), timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect self._internal_connect(address) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect raise _SocketError(err, strerror(err)) ConnectionRefusedError: [Errno 111] Connection refused