2022-09-22T05:00:38.081 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-22T05:00:38.084 INFO:teuthology.results:seed: '9838' 2022-09-22T05:39:59.639 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-22T05:39:59.675 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-09-22T17:24:51.636 INFO:teuthology.results:Tests finished! gathering results... 2022-09-22T17:24:54.036 INFO:scrape:Found 24 jobs 2022-09-22T17:24:54.666 INFO:scrape:Found 3 distinct failure reasons 2022-09-22T17:24:54.667 INFO:scrape:Failure: Command failed (workunit test libcephfs/test.sh) on smithi040 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d31fc7b2bb44ab76bfbf8b987dba2ab51c0fdc41 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2022-09-22T17:24:54.668 INFO:scrape:1 jobs: ['7040983'] 2022-09-22T17:24:54.668 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install', 'test/libcephfs_interface_tests}}'] 2022-09-22T17:24:54.669 INFO:scrape: 2022-09-22T17:24:54.670 INFO:scrape:Dead: b'2022-09-22T17:20:44.791 DEBUG:teuthology.exit:Finished running handlers' 2022-09-22T17:24:54.670 INFO:scrape:2 jobs: ['7040980', '7040981'] 2022-09-22T17:24:54.670 INFO:scrape:suites intersection: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install'] 2022-09-22T17:24:54.671 INFO:scrape:suites union: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install', 'test/kclient_workunit_suites_dbench}}', 'test/kclient_workunit_suites_fsstress}}'] 2022-09-22T17:24:54.671 INFO:scrape: 2022-09-22T17:24:54.672 INFO:scrape:Failure: {'smithi097.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': True, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failure downloading http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm, Request failed: '}, 'smithi121.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': True, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failure downloading http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm, Request failed: '}, 'smithi055.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': True, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failure downloading http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm, Request failed: '}} 2022-09-22T17:24:54.672 INFO:scrape:1 jobs: ['7040979'] 2022-09-22T17:24:54.673 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{rhel_8}', 'tasks/{0-install', 'test/kclient_workunit_direct_io}}'] 2022-09-22T17:24:54.673 INFO:scrape: 2022-09-22T17:24:54.674 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/ failed: 1 dead: 3 running: 0 waiting: 0 queued: 0 passed: 20 Fail ================================================================= [7040983] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/libcephfs_interface_tests}} ----------------------------------------------------------------- time: 00:15:18 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040983/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040983/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ec02564d0f14b8a875ba382e0a90e8f Command failed (workunit test libcephfs/test.sh) on smithi040 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d31fc7b2bb44ab76bfbf8b987dba2ab51c0fdc41 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' Dead ================================================================= [7040979] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/kclient_workunit_direct_io}} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040979/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040979/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8fc13b6e5cf44c4970d1c0c90145060 {'smithi097.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': True, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failure downloading http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm, Request failed: '}, 'smithi121.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': True, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failure downloading http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm, Request failed: '}, 'smithi055.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': True, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failure downloading http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm, Request failed: '}} [7040980] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/kclient_workunit_suites_dbench}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040980/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040980/ hit max job timeout [7040981] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/kclient_workunit_suites_fsstress}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040981/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040981/ hit max job timeout Pass ================================================================= [7040975] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/cfuse_workunit_suites_blogbench}} time: 00:21:14 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040975/ [7040976] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_fsstress}} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040976/ [7040977] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/cfuse_workunit_suites_iozone}} time: 00:15:52 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040977/ [7040978] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_pjd}} time: 00:18:08 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040978/ [7040982] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/kclient_workunit_suites_pjd}} time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040982/ [7040984] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/mon_thrash}} time: 00:31:41 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040984/ [7040985] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_api_tests}} time: 00:34:34 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040985/ [7040986] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_bench}} time: 01:55:47 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040986/ [7040987] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_cache_snaps}} time: 00:28:07 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040987/ [7040988] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_cls_all}} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040988/ [7040989] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_ec_snaps}} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040989/ [7040990] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_python}} time: 00:19:32 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040990/ [7040991] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_workunit_loadgen_mix}} time: 00:24:48 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040991/ [7040992] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_api_tests}} time: 00:32:39 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040992/ [7040993] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rbd_cli_import_export}} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040993/ [7040994] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rbd_fsx}} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040994/ [7040995] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rbd_python_api_tests}} time: 00:24:31 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040995/ [7040996] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rbd_workunit_suites_iozone}} time: 00:18:51 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040996/ [7040997] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rgw_ec_s3tests}} time: 00:23:47 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040997/ [7040998] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rgw_s3tests}} time: 00:24:23 info: http://pulpito.ceph.com/teuthology-2022-09-22_05:00:03-smoke-main-distro-default-smithi/7040998/