2026-02-25T05:37:07.286 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T05:37:07.286 INFO:teuthology.results:subset: '802/1024' 2026-02-25T05:37:07.286 INFO:teuthology.results:seed: '3137' 2026-02-25T05:43:40.979 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T05:43:40.987 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2026-02-25T07:26:54.573 INFO:teuthology.results:Tests finished! gathering results... 2026-02-25T07:26:55.210 INFO:scrape:Found 30 jobs 2026-02-25T07:26:56.809 INFO:scrape:Found 4 distinct failure reasons 2026-02-25T07:26:56.809 INFO:scrape:Failure: Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_sync_with_purged_snapshot) 2026-02-25T07:26:56.809 INFO:scrape:17 jobs: ['68973', '68953', '68967', '68965', '68950', '68946', '68951', '68970', '68971', '68952', '68945', '68954', '68968', '68972', '68947', '68948', '68974'] 2026-02-25T07:26:56.810 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'mount/fuse', 'overrides/{ignorelist_health', 'pg_health}'] 2026-02-25T07:26:56.810 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'centos_latest', 'cephfs-mirror/one-per-cluster', 'clients/mirror', 'clients/{mirror}', 'cluster/1-node', 'cluster/{1-node}', 'conf/{client', 'debug', 'fs/mirror/{begin/{0-install', 'fs/valgrind/{begin/{0-install', 'mds', 'mgr', 'mirror/{cephfs-mirror/one-per-cluster', 'mon', 'mount/fuse', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'supported-random-distros$/{centos_latest}', 'tasks/mirror}', 'tasks/mirror}}'] 2026-02-25T07:26:56.810 INFO:scrape: 2026-02-25T07:26:56.810 INFO:scrape:Failure: Test failure: test_mirroring_init_failure_with_recovery (tasks.cephfs.test_mirroring.TestMirroring.test_mirroring_init_failure_with_recovery), test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_sync_with_purged_snapshot) 2026-02-25T07:26:56.810 INFO:scrape:2 jobs: ['68969', '68966'] 2026-02-25T07:26:56.810 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-kernel}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/mirror}}'] 2026-02-25T07:26:56.810 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-kernel}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/mirror}}'] 2026-02-25T07:26:56.810 INFO:scrape: 2026-02-25T07:26:56.810 INFO:scrape:Failure: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_restart_sync_on_blocklist), test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_incremental_sync) 2026-02-25T07:26:56.810 INFO:scrape:1 jobs: ['68949'] 2026-02-25T07:26:56.810 INFO:scrape:suites: ['1-ceph', '2-logrotate', '3-kernel}', 'cephfs-mirror/one-per-cluster', 'clients/{mirror}', 'cluster/{1-node}', 'conf/{client', 'fs/mirror/{begin/{0-install', 'mds', 'mgr', 'mon', 'mount/fuse', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'supported-random-distros$/{centos_latest}', 'tasks/mirror}'] 2026-02-25T07:26:56.810 INFO:scrape: 2026-02-25T07:26:56.810 INFO:scrape:Failure: SSH connection to trial169 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.2 /home/ubuntu/cephtest/clone.client.2' 2026-02-25T07:26:56.810 INFO:scrape:1 jobs: ['68956'] 2026-02-25T07:26:56.810 INFO:scrape:suites: ['1-ceph', '2-logrotate', '2-three-per-cluster}', '3-kernel}', 'cephfs-mirror/{1-volume-create-rm', 'clients/{mirror}', 'cluster/{1-node}', 'conf/{client', 'fs/mirror-ha/{begin/{0-install', 'mds', 'mgr', 'mon', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/cephfs-mirror-ha-workunit}'] 2026-02-25T07:26:56.810 INFO:scrape: 2026-02-25T07:26:56.811 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial ================================================================= info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/ logs: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/ failed: 21 dead: 0 running: 0 waiting: 0 queued: 0 passed: 9 Fail ================================================================= [68945] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:20:34 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68945/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68945/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68946] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:20:21 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68946/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68946/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68947] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:19:46 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68947/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68947/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68948] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:19:42 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68948/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68948/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68949] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 00:50:39 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68949/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68949/ Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.te st_mirroring.TestMirroring.test_cephfs_mirror_restart_sync_on_blocklist), test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirror ing.test_cephfs_mirror_incremental_sync) [68950] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:20:19 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68950/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68950/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68951] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:21:00 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68951/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68951/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68952] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:19:20 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68952/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68952/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68953] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:20:08 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68953/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68953/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68954] fs/mirror/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/mirror} ----------------------------------------------------------------- time: 01:20:20 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68954/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68954/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68956] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} ----------------------------------------------------------------- time: 00:42:25 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68956/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68956/ SSH connection to trial169 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.2 /home/ubuntu/cephtest/clone.client.2' [68965] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:31:04 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68965/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68965/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68966] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:37:52 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68966/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68966/ Test failure: test_mirroring_init_failure_with_recovery (tasks.cephfs.test_ mirroring.TestMirroring.test_mirroring_init_failure_with_recovery), test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirror ing.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68967] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:37:58 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68967/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68967/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68968] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:36:01 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68968/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68968/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68969] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:38:26 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68969/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68969/ Test failure: test_mirroring_init_failure_with_recovery (tasks.cephfs.test_ mirroring.TestMirroring.test_mirroring_init_failure_with_recovery), test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirror ing.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68970] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:35:36 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68970/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68970/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68971] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:35:47 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68971/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68971/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68972] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:36:51 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68972/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68972/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68973] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:35:34 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68973/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68973/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) [68974] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} ----------------------------------------------------------------- time: 01:35:50 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68974/ log: https://qa-proxy.ceph.com/teuthology/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68974/ Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirror ing.TestMirroring.test_cephfs_mirror_incremental_sync), test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.T estMirroring.test_cephfs_mirror_sync_with_purged_snapshot) Pass ================================================================= [68955] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:18:43 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68955/ [68957] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:17:31 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68957/ [68958] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:17:50 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68958/ [68959] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:17:52 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68959/ [68960] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:17:33 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68960/ [68961] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:17:43 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68961/ [68962] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:17:44 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68962/ [68963] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:19:04 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68963/ [68964] fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} time: 00:18:34 info: https://pulpito.ceph.com/vshankar-2026-02-25_05:36:55-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/68964/ 2026-02-25T07:26:56.817 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 33, in main results(args['--archive-dir'], args['--name'], args['--email'], File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 78, in results email_results( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 95, in email_results smtp = smtplib.SMTP('localhost') ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 255, in __init__ (code, msg) = self.connect(host, port) ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 341, in connect self.sock = self._get_socket(host, port, self.timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket return socket.create_connection((host, port), timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect self._internal_connect(address) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect raise _SocketError(err, strerror(err)) ConnectionRefusedError: [Errno 111] Connection refused