2022-05-22T05:02:25.936 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-22T05:02:25.938 INFO:teuthology.results:seed: '3382' 2022-05-22T05:28:49.756 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-22T05:28:49.783 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-05-22T06:58:57.601 INFO:teuthology.results:Tests finished! gathering results... 2022-05-22T06:58:59.542 INFO:scrape:Found 24 jobs 2022-05-22T06:59:00.974 INFO:scrape:Found 1 distinct failure reasons 2022-05-22T06:59:00.975 INFO:scrape:Failure: "2022-05-22T05:20:28.771869+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: cephadm, nfs, orchestrator, dashboard, volumes, test_orchestrator" in cluster log 2022-05-22T06:59:00.976 INFO:scrape:7 jobs: ['6844058', '6844072', '6844080', '6844073', '6844070', '6844061', '6844079'] 2022-05-22T06:59:00.976 INFO:scrape:suites intersection: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install'] 2022-05-22T06:59:00.976 INFO:scrape:suites union: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install', 'test/cfuse_workunit_suites_blogbench}}', 'test/cfuse_workunit_suites_pjd}}', 'test/rados_cache_snaps}}', 'test/rados_ec_snaps}}', 'test/rados_python}}', 'test/rbd_workunit_suites_iozone}}', 'test/rgw_ec_s3tests}}'] 2022-05-22T06:59:00.977 INFO:scrape: 2022-05-22T06:59:00.978 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/ failed: 7 dead: 0 running: 0 waiting: 0 queued: 0 passed: 17 Fail ================================================================= [6844058] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/cfuse_workunit_suites_blogbench}} ----------------------------------------------------------------- time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844058/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844058/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ae8740e9b1248c68977cac6a5d79c2e "2022-05-22T05:20:28.771869+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: cephadm, nfs, orchestrator, dashboard, volumes, test_orchestrator" in cluster log [6844061] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/cfuse_workunit_suites_pjd}} ----------------------------------------------------------------- time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844061/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844061/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59a8483604994b98b40f8abe3b90559b "2022-05-22T05:20:30.552287+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: cephadm, nfs, orchestrator, dashboard, volumes, test_orchestrator" in cluster log [6844070] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_cache_snaps}} ----------------------------------------------------------------- time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844070/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844070/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ab9c6f0eb0c415fa954721ec832bea2 "2022-05-22T05:30:34.258368+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: cephadm, nfs, orchestrator, dashboard, volumes, test_orchestrator" in cluster log [6844072] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_ec_snaps}} ----------------------------------------------------------------- time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844072/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b4cd67929bc24e85bd47ec5e14255aae "2022-05-22T05:31:46.279179+0000 mgr.y (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: cephadm, nfs, orchestrator, dashboard, volumes, test_orchestrator" in cluster log [6844073] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_python}} ----------------------------------------------------------------- time: 00:16:29 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844073/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844073/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58ed623d90084419b17c5f8adce94d04 "2022-05-22T05:34:01.422570+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: cephadm, nfs, orchestrator, dashboard, volumes, test_orchestrator" in cluster log [6844079] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rbd_workunit_suites_iozone}} ----------------------------------------------------------------- time: 00:16:48 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844079/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844079/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e0da2d5e2cb4ba583be08fbd7900d8b "2022-05-22T05:41:50.882988+0000 mgr.x (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: cephadm, nfs, orchestrator, dashboard, volumes, test_orchestrator" in cluster log [6844080] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rgw_ec_s3tests}} ----------------------------------------------------------------- time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844080/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844080/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab0fa964028c4ceda5fef759381ece86 "2022-05-22T05:44:48.395978+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: cephadm, nfs, orchestrator, dashboard, volumes, test_orchestrator" in cluster log Pass ================================================================= [6844059] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_fsstress}} time: 00:17:47 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844059/ [6844060] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_iozone}} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844060/ [6844062] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/kclient_workunit_direct_io}} time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844062/ [6844063] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/kclient_workunit_suites_dbench}} time: 01:09:56 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844063/ [6844064] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/kclient_workunit_suites_fsstress}} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844064/ [6844065] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/kclient_workunit_suites_pjd}} time: 00:15:00 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844065/ [6844066] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/libcephfs_interface_tests}} time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844066/ [6844067] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/mon_thrash}} time: 00:31:44 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844067/ [6844068] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_api_tests}} time: 00:34:03 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844068/ [6844069] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_bench}} time: 01:40:17 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844069/ [6844071] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_cls_all}} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844071/ [6844074] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_workunit_loadgen_mix}} time: 00:27:29 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844074/ [6844075] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_api_tests}} time: 00:33:00 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844075/ [6844076] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rbd_cli_import_export}} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844076/ [6844077] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_fsx}} time: 00:19:42 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844077/ [6844078] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_python_api_tests}} time: 00:27:36 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844078/ [6844081] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rgw_s3tests}} time: 00:23:34 info: http://pulpito.ceph.com/teuthology-2022-05-22_05:00:03-smoke-master-distro-default-smithi/6844081/