2020-05-07T05:02:00.532 INFO:root:teuthology version: 1.0.0-422bddb5 2020-05-07T05:02:00.534 INFO:teuthology.results:seed: '2216' 2020-05-07T05:41:56.830 INFO:root:teuthology version: 1.0.0-422bddb5 2020-05-07T05:41:56.833 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-07T06:58:58.366 INFO:teuthology.results:Tests finished! gathering results... 2020-05-07T06:58:58.433 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/ failed: 20 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [5029447] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_blogbench.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029447/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029447/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a49bc16f98c04089aa823686ca36c0ee Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029449] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029449/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029449/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c5d23ac30ce4468880c9650d92a6c465 Command failed on smithi028 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5029451] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029451/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029451/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0cba22a8cbc64876a6bea4e4ae9e3ce5 Command failed on smithi140 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f1 -i ceph-brx -j ACCEPT'" [5029453] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/cfuse_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029453/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029453/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=612811595abb488d8e4fcbc75accc55a Command failed on smithi119 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5029455] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_direct_io.yaml} ----------------------------------------------------------------- time: 00:11:08 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029455/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029455/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7485080d211d41458c1284f5fe8cb1dd Command failed on smithi151 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5029457] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/kclient_workunit_suites_dbench.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029457/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029457/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8d535e957094423a8658c67f5a02b062 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029459] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029459/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029459/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e09e1db0155f41cea724405d4a18e80f Command failed on smithi089 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5029461] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/kclient_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029461/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029461/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8412162ae27c4eb6b2bc9628b10f1528 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029463] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/libcephfs_interface_tests.yaml} ----------------------------------------------------------------- time: 00:13:27 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029463/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029463/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e7f2752430474921ba7471655667705e Command failed on smithi089 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5029465] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_thrash.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029465/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029465/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4148553f2092469c90a7206187a75b0a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029473] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cls_all.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029473/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029473/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e0529f7ebc4b4949bc8c28edcc0beb41 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029477] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029477/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029477/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=37c4e6b632f149e4997c1bc781038700 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029479] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_workunit_loadgen_mix.yaml} ----------------------------------------------------------------- time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029479/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029479/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cef23f980adf40438dca917aed3f52f8 Command failed on smithi005 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5029481] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rbd_api_tests.yaml} ----------------------------------------------------------------- time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029481/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029481/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8309a70a1103492aa754c360b887b6f0 Command failed on smithi019 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5029483] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_cli_import_export.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029483/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029483/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1d584cf0c5a84af8a42859a1e51bd952 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029485] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_fsx.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029485/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029485/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=61049a1e6dac4dcdad303f9de6699754 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029487] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rbd_python_api_tests.yaml} ----------------------------------------------------------------- time: 00:13:53 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029487/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029487/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=097cbeb323364636b0db4c020793cc8d Command failed on smithi139 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5029489] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029489/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029489/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c783c514418146cd93557003ef0a9057 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029491] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_ec_s3tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029491/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029491/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2b2dccab413d449cad2d70bad28b4cc0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 [5029493] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_s3tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029493/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029493/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9e6b2db7a78c4fdfa339af695f2c871b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=edd405638d9de07d04ec6e9af42057d3f3d41de6 Pass ================================================================= [5029467] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_api_tests.yaml} time: 00:29:01 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029467/ [5029469] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_bench.yaml} time: 01:16:09 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029469/ [5029471] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_cache_snaps.yaml} time: 00:24:49 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029471/ [5029475] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_ec_snaps.yaml} time: 00:26:16 info: http://pulpito.ceph.com/teuthology-2020-05-07_05:00:03-smoke-master-testing-basic-smithi/5029475/ 2020-05-07T06:58:58.526 INFO:teuthology.results:starting coverage generation 2020-05-07T06:58:58.537 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'