2023-06-01T15:07:52.502 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-01T15:07:52.503 INFO:teuthology.results:seed: '3030' 2023-06-01T15:07:57.497 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-01T15:07:57.498 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-01T15:39:59.889 INFO:teuthology.results:Tests finished! gathering results... 2023-06-01T15:40:00.107 INFO:scrape:Found 6 jobs 2023-06-01T15:40:00.752 INFO:scrape:Found 1 distinct failure reasons 2023-06-01T15:40:00.753 INFO:scrape:Failure: Test failure: test_delayed_metrics (tasks.cephfs.test_mds_metrics.TestMDSMetrics) 2023-06-01T15:40:00.754 INFO:scrape:6 jobs: ['7293834', '7293831', '7293832', '7293830', '7293833', '7293835'] 2023-06-01T15:40:00.754 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'no_client_pidfile}', 'osd}', 'overrides/{ignorelist_health', 'tasks/metrics}'] 2023-06-01T15:40:00.754 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{rhel_8}', 'distro/{ubuntu_20.04}', 'fs:functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/metrics}'] 2023-06-01T15:40:00.755 INFO:scrape: 2023-06-01T15:40:00.756 INFO:teuthology.results:Sending results to rraja@redhat.com: Test Run: rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [7293830] fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} ----------------------------------------------------------------- time: 00:19:00 info: http://pulpito.ceph.com/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293830/ log: http://qa-proxy.ceph.com/teuthology/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293830/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d8e053c51954626b2f727369b980a18 Test failure: test_delayed_metrics (tasks.cephfs.test_mds_metrics.TestMDSMetrics) [7293831] fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} ----------------------------------------------------------------- time: 00:15:50 info: http://pulpito.ceph.com/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293831/ log: http://qa-proxy.ceph.com/teuthology/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293831/ sentry: https://sentry.ceph.com/organizations/ceph/?query=001e8e4cfd6748889b75e3a2f49ae28e Test failure: test_delayed_metrics (tasks.cephfs.test_mds_metrics.TestMDSMetrics) [7293832] fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} ----------------------------------------------------------------- time: 00:19:28 info: http://pulpito.ceph.com/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293832/ log: http://qa-proxy.ceph.com/teuthology/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293832/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31c23c5f29884969a08b9ec513dd6050 Test failure: test_delayed_metrics (tasks.cephfs.test_mds_metrics.TestMDSMetrics) [7293833] fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} ----------------------------------------------------------------- time: 00:17:20 info: http://pulpito.ceph.com/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293833/ log: http://qa-proxy.ceph.com/teuthology/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293833/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a96fba0548084d15ac84e2a0ec3ffc10 Test failure: test_delayed_metrics (tasks.cephfs.test_mds_metrics.TestMDSMetrics) [7293834] fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} ----------------------------------------------------------------- time: 00:14:02 info: http://pulpito.ceph.com/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293834/ log: http://qa-proxy.ceph.com/teuthology/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293834/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1669cfbf0c0040aab984bcf70ea8a7d9 Test failure: test_delayed_metrics (tasks.cephfs.test_mds_metrics.TestMDSMetrics) [7293835] fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} ----------------------------------------------------------------- time: 00:17:52 info: http://pulpito.ceph.com/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293835/ log: http://qa-proxy.ceph.com/teuthology/rraja-2023-06-01_15:07:47-fs:functional-ajarr-fix-58294-may-31-2023-distro-default-smithi/7293835/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a2fc81a5cac40568eaea839784c8022 Test failure: test_delayed_metrics (tasks.cephfs.test_mds_metrics.TestMDSMetrics)