2020-05-03T14:11:25.601 INFO:root:teuthology version: 1.0.0-58684fc5 2020-05-03T14:11:25.602 INFO:teuthology.results:subset: '1/10' 2020-05-03T14:11:25.603 INFO:teuthology.results:seed: '174' 2020-05-03T14:33:03.067 INFO:root:teuthology version: 1.0.0-58684fc5 2020-05-03T14:33:03.129 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-03T15:01:03.701 INFO:teuthology.results:Tests finished! gathering results... 2020-05-03T15:01:03.779 INFO:teuthology.results:Sending results to ivancich@redhat.com: Test Run: ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/ failed: 7 dead: 0 running: 0 waiting: 0 queued: 0 passed: 28 Fail ================================================================= [5016568] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:09:23 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016568/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016568/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=15e68b23feeb45d496572ea1c2bc9a0c Missing parentheses in call to 'print'. Did you mean print(events[0]['Records'][0]['s3']['object']['size'])? (tests_ps.py, line 2747) [5016578] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:09:03 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016578/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016578/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9a04ce59b0ce4063b8a64d8d4d620e42 Missing parentheses in call to 'print'. Did you mean print(events[0]['Records'][0]['s3']['object']['size'])? (tests_ps.py, line 2747) [5016585] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_user_quota.yaml} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016585/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016585/ "2020-05-03T14:36:47.444337+0000 mon.a (mon.0) 238 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5016586] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:09:00 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016586/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016586/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=760ec21fb1004fcab106c1e595b171dd Missing parentheses in call to 'print'. Did you mean print(events[0]['Records'][0]['s3']['object']['size'])? (tests_ps.py, line 2747) [5016590] rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:17:21 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016590/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016590/ "2020-05-03T14:46:40.187546+0000 mon.a (mon.0) 282 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5016595] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016595/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016595/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fc7ed519b751457aacb292a6a4a3ab50 Missing parentheses in call to 'print'. Did you mean print(events[0]['Records'][0]['s3']['object']['size'])? (tests_ps.py, line 2747) [5016597] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} ----------------------------------------------------------------- time: 00:08:11 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016597/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016597/ "2020-05-03T14:43:19.869270+0000 mon.b (mon.0) 155 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY)" in cluster log Pass ================================================================= [5016564] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} time: 00:11:40 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016564/ [5016565] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/barbican.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:19:11 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016565/ [5016566] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml overrides.yaml s3a-hadoop.yaml} time: 00:14:20 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016566/ [5016567] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_multipart_upload.yaml} time: 00:08:39 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016567/ [5016569] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:55 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016569/ [5016570] rgw/tempest/{clusters/fixed-1.yaml frontend/beast.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} time: 00:19:21 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016570/ [5016571] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} time: 00:12:20 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016571/ [5016572] rgw/tools/{centos_latest.yaml cluster.yaml tasks.yaml} time: 00:17:50 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016572/ [5016573] rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} time: 00:17:46 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016573/ [5016574] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} time: 00:11:25 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016574/ [5016575] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_ragweed.yaml} time: 00:08:22 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016575/ [5016576] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:12:05 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016576/ [5016577] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/testing.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:13:05 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016577/ [5016579] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} time: 00:18:09 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016579/ [5016580] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml} time: 00:14:29 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016580/ [5016581] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:55 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016581/ [5016582] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} time: 00:10:54 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016582/ [5016583] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_kv.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:13:20 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016583/ [5016584] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml overrides.yaml s3a-hadoop.yaml} time: 00:13:00 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016584/ [5016587] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:53 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016587/ [5016588] rgw/tempest/{clusters/fixed-1.yaml frontend/civetweb.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} time: 00:19:19 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016588/ [5016589] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} time: 00:14:34 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016589/ [5016591] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} time: 00:11:45 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016591/ [5016592] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} time: 00:09:27 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016592/ [5016593] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:12:25 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016593/ [5016594] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_transit.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:13:16 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016594/ [5016596] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} time: 00:17:05 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016596/ [5016598] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:10:00 info: http://pulpito.ceph.com/ivancich-2020-05-02_19:31:41-rgw-octopus-rados-list-dev-distro-basic-smithi/5016598/ 2020-05-03T15:01:03.885 INFO:teuthology.results:starting coverage generation 2020-05-03T15:01:03.896 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'