2024-04-16T11:23:38.531 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-04-16T11:23:38.532 INFO:teuthology.results:seed: '4200' 2024-04-16T11:24:28.163 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-04-16T11:24:28.170 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-04-16T11:51:30.244 INFO:teuthology.results:Tests finished! gathering results... 2024-04-16T11:51:30.643 INFO:scrape:Found 12 jobs 2024-04-16T11:51:35.133 INFO:scrape:Found 1 distinct failure reasons 2024-04-16T11:51:35.133 INFO:scrape:Failure: Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) 2024-04-16T11:51:35.133 INFO:scrape:8 jobs: ['7658091', '7658095', '7658097', '7658088', '7658089', '7658094', '7658092', '7658098'] 2024-04-16T11:51:35.133 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate', '3-modules}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mount', 'ms-die-on-skipped}}', 'no_client_pidfile', 'osd}', 'overrides/{ignorelist_health', 'pg_health}', 'tasks/admin}'] 2024-04-16T11:51:35.134 INFO:scrape:suites union: ['1-ceph', '2-logrotate', '3-modules}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_latest}', 'distro/{ubuntu_latest}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'k-stock}', 'mds', 'mgr', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{centos_9.stream', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'pg_health}', 'subvol_versions/create_subvol_version_v1', 'subvol_versions/create_subvol_version_v2', 'tasks/admin}'] 2024-04-16T11:51:35.134 INFO:scrape: 2024-04-16T11:51:35.135 INFO:teuthology.results:Sending results to jcollin@redhat.com: Test Run: jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/ failed: 8 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [7658088] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} ----------------------------------------------------------------- time: 00:11:07 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658088/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2085b08fe3f14e33baef6de55e3aa01b Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658089] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:13:37 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658089/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658089/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c112ffcd28f4286b9af2623441874fd Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658091] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:10:51 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658091/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658091/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a921b07e3c546b0bd42a0e0be937cee Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658092] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} ----------------------------------------------------------------- time: 00:15:27 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658092/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658092/ sentry: https://sentry.ceph.com/organizations/ceph/?query=057863c96aaf4d98ad4d87d1574f9c1c Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658094] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} ----------------------------------------------------------------- time: 00:10:34 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658094/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658094/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d216deae93542c9a2b6fd5569330695 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658095] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:14:39 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658095/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658095/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5102df852fe345928311de14f9149f46 Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658097] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} ----------------------------------------------------------------- time: 00:10:59 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658097/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658097/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7efdea7077a244ab8ae2e2f27020993e Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) [7658098] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} ----------------------------------------------------------------- time: 00:13:37 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658098/ log: http://qa-proxy.ceph.com/teuthology/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658098/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae5457a5531f4b4ebfc2f6a7189456bf Test failure: test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters), test_per_client_labeled_perf_counters_io (tasks.cephfs.test_admin.TestLabeledPerfCounters) Pass ================================================================= [7658090] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} time: 00:16:36 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658090/ [7658093] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} time: 00:16:17 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658093/ [7658096] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/admin} time: 00:12:29 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658096/ [7658099] fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/admin} time: 00:13:19 info: https://pulpito.ceph.com/jcollin-2024-04-16_11:23:18-fs:functional-wip-jcollin-testing_11042024-distro-default-smithi/7658099/