2020-05-12T10:26:26.503 INFO:root:teuthology version: 1.0.0-cdc9c33 2020-05-12T10:26:26.505 INFO:teuthology.results:seed: '3005' 2020-05-12T11:57:21.459 INFO:root:teuthology version: 1.0.0-cdc9c33 2020-05-12T11:57:21.488 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-12T12:59:22.934 INFO:teuthology.results:Tests finished! gathering results... 2020-05-12T12:59:23.007 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/ failed: 20 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [5048542] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_blogbench.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048542/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048542/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1a9ec86a5a2f4816a6efbfe41db024f8 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048543] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048543/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048543/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=716578dc9733468890ffd567647f1461 Command failed on smithi075 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5048544] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048544/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048544/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b2e65457cfbb4692a7c72510f87ddf1d Command failed on smithi071 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5048545] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/cfuse_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048545/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048545/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=775c3360b3eb4e4ea91a2b906353a2c9 Command failed on smithi150 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5048546] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/kclient_workunit_direct_io.yaml} ----------------------------------------------------------------- time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048546/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048546/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e9883e54f76c42a4a79cb397bacf96ac Command failed on smithi043 with status 1: "sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp'" [5048547] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_suites_dbench.yaml} ----------------------------------------------------------------- time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048547/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048547/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d968048c513b4b1c8d067fd643fbb6e6 Command failed on smithi006 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5048548] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048548/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048548/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0e120566bffc4e47bee37887f023604c Command failed on smithi063 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5048549] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048549/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048549/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8be025e200b947c3887c1cadb5e035b2 Command failed on smithi071 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5048550] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/libcephfs_interface_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048550/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048550/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6bb0d223ad7b43279d4f45c609f6d2a4 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048552] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048552/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048552/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=34f97cc025fc42169eef45030290bdd6 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048553] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_bench.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048553/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048553/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=208c45c4e7cc4b00a8d131d860a98aff Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048556] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_ec_snaps.yaml} ----------------------------------------------------------------- time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048556/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048556/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5c4da9edfc7744449079e544abb08446 Command failed on smithi189 with status 1: "sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp'" [5048557] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048557/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048557/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b5f57f114b804c3186d3a8bbb2601378 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048558] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_workunit_loadgen_mix.yaml} ----------------------------------------------------------------- time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048558/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048558/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2db1554535854188af1db475d9866cfc Command failed on smithi071 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5048559] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rbd_api_tests.yaml} ----------------------------------------------------------------- time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048559/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048559/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f18ba8e53ba44d249643596c16b3c2f4 Command failed on smithi063 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5048560] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_cli_import_export.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048560/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048560/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=352526a3cd794ee297f65bfc678f64da Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048561] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_fsx.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048561/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048561/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3a8483c6810c4712b7fb314f904b6209 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048562] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_python_api_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048562/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048562/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=29dd579eb76e49739c4b06dc8aca942c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048563] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048563/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048563/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5b65bacbac6e4e1db1bb23a8afb91795 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5048565] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_s3tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048565/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048565/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9ec9d86f202a4e0da434aa8b361950b7 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 Pass ================================================================= [5048551] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/mon_thrash.yaml} time: 00:25:31 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048551/ [5048554] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_cache_snaps.yaml} time: 00:27:02 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048554/ [5048555] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_cls_all.yaml} time: 00:22:34 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048555/ [5048564] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rgw_ec_s3tests.yaml} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2020-05-12_05:00:02-smoke-master-testing-basic-smithi/5048564/ 2020-05-12T12:59:23.170 INFO:teuthology.results:starting coverage generation 2020-05-12T12:59:23.179 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'