2020-05-14T05:00:42.428 INFO:root:teuthology version: 1.0.0-5b22163 2020-05-14T05:00:42.430 INFO:teuthology.results:seed: '3582' 2020-05-14T05:18:40.426 INFO:root:teuthology version: 1.0.0-5b22163 2020-05-14T05:18:40.443 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-14T06:31:41.922 INFO:teuthology.results:Tests finished! gathering results... 2020-05-14T06:31:41.978 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/ failed: 17 dead: 0 running: 0 waiting: 0 queued: 0 passed: 7 Fail ================================================================= [5053346] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/cfuse_workunit_suites_blogbench.yaml} ----------------------------------------------------------------- time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053346/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053346/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b174441580214a69b17eae712cb0e0b9 Command failed on smithi186 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5053348] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053348/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053348/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=50fbb6aef8bd44bb9345909ba9d8b511 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5053350] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053350/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053350/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dc44e8c3d7334d7aaedc0851109ef00e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5053352] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053352/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053352/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=55852801888d44b18f0a1a8576e9870b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5053354] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_direct_io.yaml} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053354/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053354/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=67ba88c3b88c48cfa756c8552e132f59 Command failed on smithi145 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5053355] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_suites_dbench.yaml} ----------------------------------------------------------------- time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053355/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053355/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2b58e8f44a584b28bbf6cac424ba2d84 Command failed on smithi176 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5053357] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/kclient_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053357/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053357/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2e9bf6369e4144fa94d33ef3545dc24c Command failed on smithi061 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5053359] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/kclient_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053359/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053359/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b04adb4c792048f7a7d6d09a4ff15f88 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5053361] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/libcephfs_interface_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053361/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053361/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9eeb389d1ad141578293d387ff0a1240 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5053363] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_thrash.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053363/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053363/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b677b57fc124423687abaf5573b577d4 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5053365] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053365/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053365/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=156cb209a7654194a95220cecb6c3142 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5053376] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053376/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053376/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f9d9879f0879432eb881d1dfc3203753 Command failed on smithi124 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5053378] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_workunit_loadgen_mix.yaml} ----------------------------------------------------------------- time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053378/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053378/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9cdb7cfeb55041faa7e7534ac9ad020e Command failed on smithi083 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5053379] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rbd_api_tests.yaml} ----------------------------------------------------------------- time: 00:11:04 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053379/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053379/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6f051aa07e614407a01fa3591bfd22d0 Command failed on smithi080 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5053381] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_cli_import_export.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053381/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053381/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8d6e88236bbd4d31847fd5dacd4e0e65 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5053386] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rbd_python_api_tests.yaml} ----------------------------------------------------------------- time: 00:13:24 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053386/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053386/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=81be26175b054b85ae22ad4e4534f034 Command failed on smithi161 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5053391] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_s3tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053391/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053391/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b610cc26c02f4083a23668e50e0c6f5b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 Pass ================================================================= [5053368] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_bench.yaml} time: 01:04:56 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053368/ [5053370] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_cache_snaps.yaml} time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053370/ [5053372] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_cls_all.yaml} time: 00:21:38 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053372/ [5053374] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_ec_snaps.yaml} time: 00:28:49 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053374/ [5053384] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rbd_fsx.yaml} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053384/ [5053388] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rbd_workunit_suites_iozone.yaml} time: 00:18:15 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053388/ [5053390] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rgw_ec_s3tests.yaml} time: 00:21:49 info: http://pulpito.ceph.com/teuthology-2020-05-14_05:00:03-smoke-master-testing-basic-smithi/5053390/ 2020-05-14T06:31:42.065 INFO:teuthology.results:starting coverage generation 2020-05-14T06:31:42.071 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'