2020-05-06T05:27:25.529 INFO:root:teuthology version: 1.0.0-58684fc5 2020-05-06T05:27:25.531 INFO:teuthology.results:subset: '1/3' 2020-05-06T05:27:25.532 INFO:teuthology.results:seed: '6862' 2020-05-06T05:51:48.900 INFO:root:teuthology version: 1.0.0-58684fc5 2020-05-06T05:51:48.920 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-06T06:33:49.758 INFO:teuthology.results:Tests finished! gathering results... 2020-05-06T06:33:49.882 INFO:teuthology.results:Sending results to smanjara@redhat.com: Test Run: smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/ failed: 11 dead: 0 running: 0 waiting: 0 queued: 0 passed: 44 Fail ================================================================= [5027184] rgw/tools/{centos_latest.yaml cluster.yaml tasks.yaml} ----------------------------------------------------------------- time: 00:12:11 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027184/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027184/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8b23243406904e4cb132e01b4a34d1d3 Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi163 with status 12: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=06e6013ec1ed59c0f1137510d90d4c8af1d3db49 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh' [5027186] rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:18:01 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027186/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027186/ "2020-05-06T05:52:21.454842+0000 mon.a (mon.0) 200 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY)" in cluster log [5027188] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} ----------------------------------------------------------------- time: 00:08:25 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027188/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027188/ "2020-05-06T05:46:12.802237+0000 mon.b (mon.0) 220 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5027199] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:34:48 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027199/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027199/ "2020-05-06T06:02:21.964541+0000 mon.a (mon.0) 447 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5027204] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:33:08 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027204/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027204/ "2020-05-06T05:58:08.370288+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY)" in cluster log [5027208] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:42:46 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027208/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027208/ "2020-05-06T05:57:12.817955+0000 mon.a (mon.0) 214 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY)" in cluster log [5027212] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:23:09 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027212/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027212/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f368cfe9fe23482393f601a4e5c0181e Command failed (workunit test rgw/run-reshard.sh) on smithi205 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=06e6013ec1ed59c0f1137510d90d4c8af1d3db49 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh' [5027222] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} ----------------------------------------------------------------- time: 00:25:32 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027222/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027222/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=60e69ea42c754801a90c826651b9c4ca rgw multisite, test failures [5027226] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027226/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027226/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e719b5babc1b4ae8b708ae10df336fb1 Command failed on smithi025 with status 1: 'sudo yum install -y kernel' [5027229] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:29:34 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027229/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027229/ "2020-05-06T06:09:50.497049+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5027230] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} ----------------------------------------------------------------- time: 00:08:32 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027230/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027230/ "2020-05-06T06:08:36.320730+0000 mon.b (mon.0) 173 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY)" in cluster log Pass ================================================================= [5027177] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/barbican.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:19:05 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027177/ [5027178] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml overrides.yaml s3a-hadoop.yaml} time: 00:14:47 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027178/ [5027179] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} time: 00:09:35 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027179/ [5027180] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} time: 00:42:07 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027180/ [5027181] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:12:22 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027181/ [5027182] rgw/tempest/{clusters/fixed-1.yaml frontend/beast.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} time: 00:19:44 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027182/ [5027183] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} time: 00:13:12 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027183/ [5027185] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:26:26 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027185/ [5027187] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:35:00 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027187/ [5027189] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} time: 00:10:52 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027189/ [5027190] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:36:52 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027190/ [5027191] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:53 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027191/ [5027192] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:27:50 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027192/ [5027193] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} time: 00:08:43 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027193/ [5027194] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/testing.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:12:45 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027194/ [5027195] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} time: 00:26:35 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027195/ [5027196] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} time: 00:18:21 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027196/ [5027197] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:28:14 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027197/ [5027198] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} time: 00:13:23 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027198/ [5027200] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:55 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027200/ [5027201] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} time: 00:14:15 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027201/ [5027202] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:27:43 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027202/ [5027203] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} time: 00:08:41 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027203/ [5027205] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_kv.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:13:11 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027205/ [5027206] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml overrides.yaml s3a-hadoop.yaml} time: 00:13:35 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027206/ [5027207] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} time: 00:09:20 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027207/ [5027209] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:58 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027209/ [5027210] rgw/tempest/{clusters/fixed-1.yaml frontend/civetweb.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} time: 00:20:21 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027210/ [5027211] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} time: 00:13:07 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027211/ [5027213] rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} time: 00:18:22 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027213/ [5027214] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:27:17 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027214/ [5027215] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} time: 00:08:46 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027215/ [5027216] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} time: 00:11:54 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027216/ [5027217] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:27:43 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027217/ [5027218] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:55 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027218/ [5027219] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:29:02 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027219/ [5027220] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} time: 00:08:17 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027220/ [5027221] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_transit.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:13:23 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027221/ [5027223] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} time: 00:17:31 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027223/ [5027224] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:31:52 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027224/ [5027225] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} time: 00:14:29 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027225/ [5027227] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:47 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027227/ [5027228] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} time: 00:12:58 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027228/ [5027231] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:25:49 info: http://pulpito.ceph.com/smanjara-2020-05-06_05:27:01-rgw-wip-dynamic-resharding-distro-basic-smithi/5027231/ 2020-05-06T06:33:50.088 INFO:teuthology.results:starting coverage generation 2020-05-06T06:33:50.095 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'