2020-05-13T05:01:05.364 INFO:root:teuthology version: 1.0.0-a857ecd 2020-05-13T05:01:05.366 INFO:teuthology.results:seed: '9719' 2020-05-13T05:11:05.557 INFO:root:teuthology version: 1.0.0-a857ecd 2020-05-13T05:11:05.567 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-13T08:45:10.335 INFO:teuthology.results:Tests finished! gathering results... 2020-05-13T08:45:10.638 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/ failed: 17 dead: 0 running: 0 waiting: 0 queued: 0 passed: 7 Fail ================================================================= [5050980] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/cfuse_workunit_suites_blogbench.yaml} ----------------------------------------------------------------- time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050980/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050980/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ee44162066c0430e95985ba2adaf32c8 Command failed on smithi161 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5050981] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050981/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050981/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=07e2299e17974b3da07c96c9324bf827 Command failed on smithi200 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5050982] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050982/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050982/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a2ceb6d3f47c4841a847cbefd2f78733 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5050983] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050983/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050983/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=06d13c4b9c2242299eb7ea6ead164039 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5050984] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/kclient_workunit_direct_io.yaml} ----------------------------------------------------------------- time: 00:15:00 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050984/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050984/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=159e0293d44f4767ac97a98cbc3bcab3 Command failed on smithi052 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5050985] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/kclient_workunit_suites_dbench.yaml} ----------------------------------------------------------------- time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050985/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050985/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7993ad5ed5f24f49af87050a89f337a6 Command failed on smithi072 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5050986] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/kclient_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050986/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050986/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bb13e00ac5f243b1890c033c397a0a9a Command failed on smithi087 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5050987] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050987/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050987/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6fa6d204008243b285e24e207f27b5ba Command failed on smithi005 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5050988] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/libcephfs_interface_tests.yaml} ----------------------------------------------------------------- time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050988/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050988/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1d6886914c1444acb0ca4f00da9fcbe9 Command failed on smithi059 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5050989] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/mon_thrash.yaml} ----------------------------------------------------------------- time: 03:20:45 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050989/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050989/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dbac0871422e4231a6bbe694fc8fff69 Command failed (workunit test rados/test.sh) on smithi007 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=898ea3e956daac8d2f3265e76d65ddb168373abd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5050993] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cls_all.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050993/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050993/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6e86c511550e40a4a992c7d4a2720b32 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5050995] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:14:26 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050995/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050995/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a235e7671fd04716b92d99d4adff90a4 Command failed on smithi192 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5050996] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_workunit_loadgen_mix.yaml} ----------------------------------------------------------------- time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050996/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050996/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f4a93534bf1f4d76bfa4153b73a92198 Command failed on smithi152 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5050997] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_api_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050997/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050997/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b76c18aa8fcd4ea486dcfe5f40b6c8f3 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5050998] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_cli_import_export.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050998/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050998/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2ea7bd2f2b5c4ceeb6b673e79851f7c8 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5050999] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_fsx.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050999/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050999/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2a8afc329f2340e39782e22ea806c55f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5051000] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_python_api_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5051000/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5051000/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d30d5f16b65e4caab21e91c3b84928d8 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 Pass ================================================================= [5050990] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_api_tests.yaml} time: 00:26:03 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050990/ [5050991] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_bench.yaml} time: 00:53:29 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050991/ [5050992] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_cache_snaps.yaml} time: 00:28:03 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050992/ [5050994] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_ec_snaps.yaml} time: 00:27:31 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5050994/ [5051001] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rbd_workunit_suites_iozone.yaml} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5051001/ [5051002] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rgw_ec_s3tests.yaml} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5051002/ [5051003] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rgw_s3tests.yaml} time: 00:25:01 info: http://pulpito.ceph.com/teuthology-2020-05-13_05:00:03-smoke-master-testing-basic-smithi/5051003/ 2020-05-13T08:45:10.843 INFO:teuthology.results:starting coverage generation 2020-05-13T08:45:10.863 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'