2024-01-24T05:28:41.605 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-24T05:28:41.605 INFO:teuthology.results:subset: '828/1024' 2024-01-24T05:28:41.606 INFO:teuthology.results:seed: '4706' 2024-01-24T05:28:53.356 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-24T05:28:53.357 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-24T07:16:01.647 INFO:teuthology.results:Tests finished! gathering results... 2024-01-24T07:16:01.895 INFO:scrape:Found 4 jobs 2024-01-24T07:16:04.671 INFO:scrape:Found 2 distinct failure reasons 2024-01-24T07:16:04.671 INFO:scrape:Failure: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-01-24T07:16:04.671 INFO:scrape:3 jobs: ['7530335', '7530334', '7530332'] 2024-01-24T07:16:04.671 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'osd}', 'overrides/{ignorelist_health', 'session_timeout}', 'tasks/dbench', 'validater/valgrind}'] 2024-01-24T07:16:04.671 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_latest}', 'fs/verify/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{ignorelist_health', 'ranks/1', 'ranks/3', 'ranks/5', 'session_timeout}', 'tasks/dbench', 'validater/valgrind}'] 2024-01-24T07:16:04.672 INFO:scrape: 2024-01-24T07:16:04.672 INFO:scrape:Failure: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2024-01-24T07:16:04.672 INFO:scrape:1 jobs: ['7530333'] 2024-01-24T07:16:04.672 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'centos_latest', 'clients/mirror', 'cluster/1-node', 'debug', 'fs/valgrind/{begin/{0-install', 'mirror/{cephfs-mirror/one-per-cluster', 'mount/fuse', 'overrides/ignorelist_health', 'tasks/mirror}}'] 2024-01-24T07:16:04.672 INFO:scrape: 2024-01-24T07:16:04.673 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi ================================================================= info: https://pulpito.ceph.com/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [7530332] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} ----------------------------------------------------------------- time: 00:57:11 info: https://pulpito.ceph.com/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/7530332/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/7530332/ valgrind error: Leak_PossiblyLost calloc __trans_list_add [7530333] fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}} ----------------------------------------------------------------- time: 01:36:16 info: https://pulpito.ceph.com/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/7530333/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/7530333/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f3e75ea0c6e546d9ae27796e7db7f99f Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) [7530334] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} ----------------------------------------------------------------- time: 00:56:39 info: https://pulpito.ceph.com/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/7530334/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/7530334/ valgrind error: Leak_PossiblyLost calloc __trans_list_add [7530335] fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} ----------------------------------------------------------------- time: 00:57:30 info: https://pulpito.ceph.com/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/7530335/ log: http://qa-proxy.ceph.com/teuthology/vshankar-2024-01-24_05:27:39-fs-main-testing-default-smithi/7530335/ valgrind error: Leak_PossiblyLost calloc __trans_list_add