2020-05-15T05:00:56.110 INFO:root:teuthology version: 1.0.0-ff173f9 2020-05-15T05:00:56.112 INFO:teuthology.results:seed: '1836' 2020-05-15T05:49:30.458 INFO:root:teuthology version: 1.0.0-ff173f9 2020-05-15T05:49:30.493 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-15T09:43:34.850 INFO:teuthology.results:Tests finished! gathering results... 2020-05-15T09:43:34.924 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/ failed: 20 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [5056221] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/cfuse_workunit_suites_blogbench.yaml} ----------------------------------------------------------------- time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056221/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056221/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7b2207efde2d42389943f268a60f39da Command failed on smithi026 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5056222] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056222/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056222/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=685ce7418aac4caeb173437edc52d6ba Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056223] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056223/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056223/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1b0399ca95444328977f64d7e911ec56 Command failed on smithi101 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5056224] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/cfuse_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056224/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056224/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0c3ca70e0cfd4fd1b9d3fdae18a11722 Command failed on smithi144 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5056225] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/kclient_workunit_direct_io.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056225/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056225/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c2a1ba5068094347af12607524aaadb0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056226] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/kclient_workunit_suites_dbench.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056226/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056226/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=876f88bc5814487e83cc746efa962b00 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056227] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/kclient_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:13:02 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056227/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056227/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cda5defc9f1546e5af109ad00e046bbf Command failed on smithi140 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f1 -i ceph-brx -j ACCEPT'" [5056228] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056228/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056228/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c8e84410f9f64529b9e042f029ff53ec Command failed on smithi192 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5056229] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/libcephfs_interface_tests.yaml} ----------------------------------------------------------------- time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056229/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056229/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e2c473e60dfb4b01a0b8af472d7e8acd Command failed on smithi199 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5056230] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_thrash.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056230/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056230/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c61e3b19a02f4d339e091fee59a53852 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056232] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_bench.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056232/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056232/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=54b6dfee04d44960b783c34b7d2a4636 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056233] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cache_snaps.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056233/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056233/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bd08963b03ff4c46826af1bdc5b5fd96 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056234] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cls_all.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056234/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056234/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4290f90b0c8348ebbf759c82846a83ed Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056235] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_ec_snaps.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056235/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056235/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6fbf66df01a841ab96dbe2daf22246b0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056236] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:13:46 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056236/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056236/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7e47813927794fbf8082dd1811423fd0 Command failed on smithi063 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5056237] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056237/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056237/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d401d667fa09432984f579efd39da1cf Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056238] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rbd_api_tests.yaml} ----------------------------------------------------------------- time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056238/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056238/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4206533800b04807b0f5519952721e46 Command failed on smithi143 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5056239] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_cli_import_export.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056239/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056239/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a57c13bab63b4536b9deb23cc75d0caf Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5056241] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rbd_python_api_tests.yaml} ----------------------------------------------------------------- time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056241/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056241/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=759e16e73ad84ba78b6285e73514673a Command failed on smithi117 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5056244] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_s3tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056244/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056244/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=66c814f6dd45419cb93c4a7002dd9b0d Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 Pass ================================================================= [5056231] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_api_tests.yaml} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056231/ [5056240] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rbd_fsx.yaml} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056240/ [5056242] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rbd_workunit_suites_iozone.yaml} time: 00:18:07 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056242/ [5056243] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rgw_ec_s3tests.yaml} time: 00:20:51 info: http://pulpito.ceph.com/teuthology-2020-05-15_05:00:01-smoke-master-testing-basic-smithi/5056243/ 2020-05-15T09:43:35.081 INFO:teuthology.results:starting coverage generation 2020-05-15T09:43:35.090 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'