2023-09-30T02:09:34.722 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T02:09:34.723 INFO:teuthology.results:subset: '111/120000' 2023-09-30T02:09:34.723 INFO:teuthology.results:seed: '3429' 2023-09-30T02:33:09.924 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T02:33:09.928 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-09-30T14:25:05.086 INFO:teuthology.results:Tests finished! gathering results... 2023-09-30T14:25:06.828 INFO:scrape:Found 24 jobs 2023-09-30T14:25:07.557 INFO:scrape:Found 3 distinct failure reasons 2023-09-30T14:25:07.558 INFO:scrape:Failure: "2023-09-30T02:38:38.558659+0000 mon.a (mon.0) 81 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log 2023-09-30T14:25:07.558 INFO:scrape:2 jobs: ['7406494', '7406518'] 2023-09-30T14:25:07.558 INFO:scrape:suites intersection: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{centos_latest}', 'tasks/{0-install'] 2023-09-30T14:25:07.558 INFO:scrape:suites union: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{centos_latest}', 'tasks/{0-install', 'test/libcephfs_interface_tests}}', 'test/rbd_python_api_tests}}'] 2023-09-30T14:25:07.558 INFO:scrape: 2023-09-30T14:25:07.558 INFO:scrape:Dead: b'2023-09-30T14:22:44.290 DEBUG:teuthology.exit:Finished running handlers' 2023-09-30T14:25:07.558 INFO:scrape:1 jobs: ['7406488'] 2023-09-30T14:25:07.559 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_20.04}', 'tasks/{0-install', 'test/kclient_workunit_suites_dbench}}'] 2023-09-30T14:25:07.559 INFO:scrape: 2023-09-30T14:25:07.559 INFO:scrape:Failure: reached maximum tries (801) after waiting for 4800 seconds 2023-09-30T14:25:07.559 INFO:scrape:1 jobs: ['7406500'] 2023-09-30T14:25:07.559 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{centos_8}', 'tasks/{0-install', 'test/rados_bench}}'] 2023-09-30T14:25:07.559 INFO:scrape: 2023-09-30T14:25:07.560 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/ failed: 3 dead: 1 running: 0 waiting: 0 queued: 0 passed: 20 Fail ================================================================= [7406494] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/libcephfs_interface_tests}} ----------------------------------------------------------------- time: 00:20:53 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406494/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406494/ "2023-09-30T02:38:38.558659+0000 mon.a (mon.0) 81 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7406500] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_bench}} ----------------------------------------------------------------- time: 02:07:31 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406500/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406500/ sentry: https://sentry.ceph.com/organizations/ceph/?query=95a294b510364fbaa0efac0d4277e295 reached maximum tries (801) after waiting for 4800 seconds [7406518] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/rbd_python_api_tests}} ----------------------------------------------------------------- time: 00:22:42 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406518/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406518/ "2023-09-30T02:44:56.795595+0000 mon.a (mon.0) 87 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log Dead ================================================================= [7406488] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_20.04} tasks/{0-install test/kclient_workunit_suites_dbench}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406488/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406488/ hit max job timeout Pass ================================================================= [7406478] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_20.04} tasks/{0-install test/cfuse_workunit_suites_blogbench}} time: 00:19:43 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406478/ [7406480] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/cfuse_workunit_suites_fsstress}} time: 00:16:23 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406480/ [7406482] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_iozone}} time: 00:25:18 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406482/ [7406484] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_20.04} tasks/{0-install test/cfuse_workunit_suites_pjd}} time: 00:16:06 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406484/ [7406486] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/kclient_workunit_direct_io}} time: 00:24:16 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406486/ [7406490] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/kclient_workunit_suites_fsstress}} time: 00:16:03 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406490/ [7406492] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/kclient_workunit_suites_pjd}} time: 00:17:55 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406492/ [7406496] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_20.04} tasks/{0-install test/mon_thrash}} time: 00:33:19 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406496/ [7406498] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_api_tests}} time: 00:38:41 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406498/ [7406502] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_20.04} tasks/{0-install test/rados_cache_snaps}} time: 00:24:55 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406502/ [7406504] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_cls_all}} time: 00:22:49 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406504/ [7406506] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_ec_snaps}} time: 00:33:51 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406506/ [7406508] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_python}} time: 00:20:52 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406508/ [7406510] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_workunit_loadgen_mix}} time: 00:34:38 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406510/ [7406512] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rbd_api_tests}} time: 00:54:25 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406512/ [7406514] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rbd_cli_import_export}} time: 00:17:54 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406514/ [7406516] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rbd_fsx}} time: 00:18:28 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406516/ [7406520] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_workunit_suites_iozone}} time: 00:27:13 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406520/ [7406522] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rgw_ec_s3tests}} time: 00:24:52 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406522/ [7406524] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rgw_s3tests}} time: 00:32:23 info: http://pulpito.ceph.com/yuriw-2023-09-29_19:40:02-smoke-main-distro-default-smithi/7406524/