2020-05-23T22:09:55.074 INFO:root:teuthology version: 1.0.0-4413d31 2020-05-23T22:09:55.075 INFO:teuthology.results:subset: '1/9999' 2020-05-23T22:09:55.076 INFO:teuthology.results:seed: '5577' 2020-05-23T22:24:04.293 INFO:root:teuthology version: 1.0.0-4413d31 2020-05-23T22:24:04.316 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-24T00:29:06.646 INFO:teuthology.results:Tests finished! gathering results... 2020-05-24T00:29:06.695 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/ failed: 11 dead: 0 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [5066884] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-low-osd-mem-target.yaml powercycle/default.yaml supported-all-distro/centos_8.yaml tasks/cfuse_workunit_kernel_untar_build.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066884/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066884/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f63898d30d754810881f08521f8cb2c2 Command failed on smithi116 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5066885] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-stupid.yaml powercycle/default.yaml supported-all-distro/rhel_8.yaml tasks/cfuse_workunit_misc.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066885/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066885/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e9d2e45afd4d44aba10901cc2532b6dd Command failed on smithi148 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5066886] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/filestore-xfs.yaml powercycle/default.yaml supported-all-distro/ubuntu_latest.yaml tasks/cfuse_workunit_suites_ffsb.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066886/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066886/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=52492c0d2e1d4103a3102b0d621b7c21 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5066887] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-bitmap.yaml powercycle/default.yaml supported-all-distro/centos_8.yaml tasks/cfuse_workunit_suites_fsstress.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066887/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066887/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=29a699d0e7814224a3dde11c7585655e Command failed on smithi018 with status 4: "sudo bash -c 'iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT'" [5066888] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-comp-lz4.yaml powercycle/default.yaml supported-all-distro/rhel_8.yaml tasks/cfuse_workunit_suites_fsx.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066888/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066888/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7fec773fbdd746059301de1167d9111c Command failed on smithi156 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5066889] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-comp-snappy.yaml powercycle/default.yaml supported-all-distro/ubuntu_latest.yaml tasks/cfuse_workunit_suites_fsync.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066889/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066889/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a86f4727bc2040da8e11bf7a0f859ada Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5066890] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-comp-zlib.yaml powercycle/default.yaml supported-all-distro/centos_8.yaml tasks/cfuse_workunit_suites_pjd.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066890/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066890/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=82fe8747b96244b29510ca619b867f84 Command failed on smithi080 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5066891] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-comp-zstd.yaml powercycle/default.yaml supported-all-distro/rhel_8.yaml tasks/cfuse_workunit_suites_truncate_delay.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066891/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066891/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f6b6845f031446f08fe5aefb8b7c8096 Command failed on smithi149 with status 4: "sudo bash -c 'iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT'" [5066892] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-hybrid.yaml powercycle/default.yaml supported-all-distro/ubuntu_latest.yaml tasks/rados_api_tests.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066892/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066892/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0a90a4ea313c4cc5a7db565a33135653 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5066895] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/filestore-xfs.yaml powercycle/default.yaml supported-all-distro/ubuntu_latest.yaml tasks/snaps-few-objects.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066895/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066895/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ea0acb2e26d447d294c0842aa44c9601 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 [5066898] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-comp-snappy.yaml powercycle/default.yaml supported-all-distro/ubuntu_latest.yaml tasks/cfuse_workunit_kernel_untar_build.yaml thrashosds-health.yaml whitelist_health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066898/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066898/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ea04be9423ce4796b9ccdc5a90bb00a5 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sh a1=2df39dc136ccbbccbbb0d080cebc99614118a329 Pass ================================================================= [5066893] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-low-osd-mem-target.yaml powercycle/default.yaml supported-all-distro/centos_8.yaml tasks/radosbench.yaml thrashosds-health.yaml whitelist_health.yaml} time: 01:37:13 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066893/ [5066894] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-stupid.yaml powercycle/default.yaml supported-all-distro/rhel_8.yaml tasks/readwrite.yaml thrashosds-health.yaml whitelist_health.yaml} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066894/ [5066896] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-bitmap.yaml powercycle/default.yaml supported-all-distro/centos_8.yaml tasks/snaps-many-objects.yaml thrashosds-health.yaml whitelist_health.yaml} time: 00:27:38 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066896/ [5066897] powercycle/osd/{clusters/3osd-1per-target.yaml objectstore/bluestore-comp-lz4.yaml powercycle/default.yaml supported-all-distro/rhel_8.yaml tasks/admin_socket_objecter_requests.yaml thrashosds-health.yaml whitelist_health.yaml} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2020-05-18_11:15:02-powercycle-master-testing-basic-smithi/5066897/ 2020-05-24T00:29:06.786 INFO:teuthology.results:starting coverage generation 2020-05-24T00:29:06.791 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'