2024-04-16T11:20:58.278 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-04-16T11:20:58.278 INFO:teuthology.results:seed: '8033' 2024-04-16T11:21:46.184 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-04-16T11:21:46.187 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-04-16T11:47:48.119 INFO:teuthology.results:Tests finished! gathering results... 2024-04-16T11:47:48.519 INFO:scrape:Found 12 jobs 2024-04-16T11:47:53.289 INFO:scrape:Found 1 distinct failure reasons 2024-04-16T11:47:53.289 INFO:scrape:Failure: Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) 2024-04-16T11:47:53.289 INFO:scrape:8 jobs: ['7658075', '7658084', '7658077', '7658083', '7658081', '7658080', '7658078', '7658074'] 2024-04-16T11:47:53.290 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-modules}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/admin}'] 2024-04-16T11:47:53.290 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-modules}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health}', 'subvol_versions/create_subvol_version_v1', 'subvol_versions/create_subvol_version_v2', 'tasks/admin}'] 2024-04-16T11:47:53.290 INFO:scrape: 2024-04-16T11:47:53.291 INFO:teuthology.results:Sending results to jcollin@redhat.com: Test Run: jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/ failed: 8 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [7658074] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} ----------------------------------------------------------------- time: 00:10:50 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658074/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658074/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4fd1f1af876c418488793bd33e1535a9 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658075] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:13:38 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658075/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658075/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e3d5a16e9b74d179464f46069873974 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658077] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:10:30 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658077/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658077/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26d4c215388249bd908478a27e5f28b3 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658078] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} ----------------------------------------------------------------- time: 00:14:45 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658078/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658078/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1226376622044b8bba220a10fa573f1 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658080] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} ----------------------------------------------------------------- time: 00:10:23 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658080/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658080/ sentry: https://sentry.ceph.com/organizations/ceph/?query=81f01ff9f6444584b50be405b92eae33 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658081] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:14:44 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658081/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658081/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef46380ed40f421cbdb06dbd46d51bc9 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658083] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:10:58 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658083/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658083/ sentry: https://sentry.ceph.com/organizations/ceph/?query=98258fddd9af42bf9e900e9cce649b6b Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658084] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} ----------------------------------------------------------------- time: 00:14:14 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658084/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658084/ sentry: https://sentry.ceph.com/organizations/ceph/?query=230bb2a43f9e4852bcf50ec1798861a6 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) Pass ================================================================= [7658076] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} time: 00:16:50 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658076/ [7658079] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} time: 00:16:18 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658079/ [7658082] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} time: 00:16:09 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658082/ [7658085] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} time: 00:16:35 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:20:45-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658085/