2020-05-10T05:01:15.758 INFO:root:teuthology version: 1.0.0-28c1ab59 2020-05-10T05:01:15.760 INFO:teuthology.results:seed: '2251' 2020-05-10T05:13:06.643 INFO:root:teuthology version: 1.0.0-28c1ab59 2020-05-10T05:13:06.663 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-10T06:26:08.107 INFO:teuthology.results:Tests finished! gathering results... 2020-05-10T06:26:08.269 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/ failed: 18 dead: 0 running: 0 waiting: 0 queued: 0 passed: 6 Fail ================================================================= [5042272] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/cfuse_workunit_suites_blogbench.yaml} ----------------------------------------------------------------- time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042272/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042272/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ea15b521378746078016942a7f1e7af8 Command failed on smithi051 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5042273] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042273/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042273/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0cb4b3b0e77f46508f0c09fdf2af1e98 Command failed on smithi183 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5042274] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/cfuse_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:14:48 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042274/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042274/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2db9dce83dfa455dba291a56b98eada2 Command failed on smithi060 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5042275] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/cfuse_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042275/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042275/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4b7230e8db2148b686ba074c322c7462 Command failed on smithi095 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5042276] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/kclient_workunit_direct_io.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042276/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042276/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=03e2df8a0f5644caa97d5abd9275d2a7 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=44e23095fd99912ff76e27d551a3cb3c6de4681d [5042277] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/kclient_workunit_suites_dbench.yaml} ----------------------------------------------------------------- time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042277/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042277/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7e5b020d2b754de9aa017e88113a7f6f Command failed on smithi134 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5042278] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/kclient_workunit_suites_fsstress.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042278/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042278/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=22a86b86e8eb4e1da1a16cf66079c094 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=44e23095fd99912ff76e27d551a3cb3c6de4681d [5042279] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/kclient_workunit_suites_pjd.yaml} ----------------------------------------------------------------- time: 00:14:23 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042279/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042279/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=af293e9acc3a48518ba830b4d7c78c7f Command failed on smithi165 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5042280] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/libcephfs_interface_tests.yaml} ----------------------------------------------------------------- time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042280/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042280/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1b2429a6c6c44d469cb8a640bec4f97d Command failed on smithi017 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5042282] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042282/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042282/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ee6d58fc79584579a3fff2c11a175e55 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=44e23095fd99912ff76e27d551a3cb3c6de4681d [5042284] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cache_snaps.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042284/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042284/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b73bc593f64b4389a32adfc68fbca76e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=44e23095fd99912ff76e27d551a3cb3c6de4681d [5042286] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_ec_snaps.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042286/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042286/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fb5848b124194f2f930f43e786b2dfe5 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=44e23095fd99912ff76e27d551a3cb3c6de4681d [5042287] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042287/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042287/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c8ccae050c13478ebd07409e073effa6 Command failed on smithi086 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5042288] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042288/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042288/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fa7b471fd10249d6998626f57eeac809 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=44e23095fd99912ff76e27d551a3cb3c6de4681d [5042289] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rbd_api_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042289/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042289/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c1868cdce7dd43b0b3ec32c0e67e6f36 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=44e23095fd99912ff76e27d551a3cb3c6de4681d [5042290] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rbd_cli_import_export.yaml} ----------------------------------------------------------------- time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042290/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042290/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=07fc96be28494da196626447cbbda212 Command failed on smithi148 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5042292] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rbd_python_api_tests.yaml} ----------------------------------------------------------------- time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042292/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042292/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=891d8caca6314ecfa8120365a0e4aaee Command failed on smithi053 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5042295] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_s3tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042295/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042295/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f7a54cfba2bf4d4d8b2c02ae490ce25c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=44e23095fd99912ff76e27d551a3cb3c6de4681d Pass ================================================================= [5042281] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/mon_thrash.yaml} time: 00:27:43 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042281/ [5042283] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_bench.yaml} time: 00:59:14 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042283/ [5042285] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_cls_all.yaml} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042285/ [5042291] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rbd_fsx.yaml} time: 00:12:59 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042291/ [5042293] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rbd_workunit_suites_iozone.yaml} time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042293/ [5042294] smoke/basic/{clusters/{fixed-3-cephfs.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_8.yaml} tasks/rgw_ec_s3tests.yaml} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2020-05-10_05:00:03-smoke-master-testing-basic-smithi/5042294/ 2020-05-10T06:26:08.340 INFO:teuthology.results:starting coverage generation 2020-05-10T06:26:08.345 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'