2020-05-06T10:51:09.206 INFO:root:teuthology version: 1.0.0-58684fc5 2020-05-06T10:51:09.208 INFO:teuthology.results:subset: '1/3' 2020-05-06T10:51:09.208 INFO:teuthology.results:seed: '227' 2020-05-06T11:19:17.151 INFO:root:teuthology version: 1.0.0-58684fc5 2020-05-06T11:19:17.166 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-06T12:00:18.038 INFO:teuthology.results:Tests finished! gathering results... 2020-05-06T12:00:18.138 INFO:teuthology.results:Sending results to smanjara@redhat.com: Test Run: smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/ failed: 8 dead: 0 running: 0 waiting: 0 queued: 0 passed: 47 Fail ================================================================= [5028461] rgw/tools/{centos_latest.yaml cluster.yaml tasks.yaml} ----------------------------------------------------------------- time: 00:12:07 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028461/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028461/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9c58fad5a67c404cad4af704e4bc76de Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi052 with status 12: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c02a4731bb7f81103b157e88adf12ade89eaca35 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh' [5028469] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:28:14 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028469/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028469/ "2020-05-06T11:28:41.629780+0000 mon.a (mon.0) 441 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5028490] rgw/website/{clusters/fixed-2.yaml frontend/civetweb.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:17:23 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028490/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028490/ "2020-05-06T11:25:41.122859+0000 mon.a (mon.0) 205 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 5 pgs peering (PG_AVAILABILITY)" in cluster log [5028492] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_multipart_upload.yaml} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028492/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028492/ "2020-05-06T11:37:48.310818+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY)" in cluster log [5028494] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:31:34 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028494/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028494/ "2020-05-06T11:30:12.127035+0000 mon.b (mon.0) 248 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY)" in cluster log [5028504] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:10:00 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028504/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028504/ "2020-05-06T11:37:40.973959+0000 mon.a (mon.0) 170 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log [5028507] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_user_quota.yaml} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028507/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028507/ "2020-05-06T11:30:44.501318+0000 mon.b (mon.0) 241 : cluster [WRN] Health check failed: Reduced data availability: 6 pgs inactive, 6 pgs peering (PG_AVAILABILITY)" in cluster log [5028508] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:27:42 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028508/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028508/ "2020-05-06T11:38:08.746273+0000 mon.a (mon.0) 404 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log Pass ================================================================= [5028454] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/barbican.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:18:57 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028454/ [5028455] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/default.yaml overrides.yaml s3a-hadoop.yaml} time: 00:14:54 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028455/ [5028456] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_bucket_quota.yaml} time: 00:09:34 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028456/ [5028457] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} time: 00:40:50 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028457/ [5028458] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:13:02 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028458/ [5028459] rgw/tempest/{clusters/fixed-1.yaml frontend/beast.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} time: 00:19:29 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028459/ [5028460] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} time: 00:13:19 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028460/ [5028462] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:27:06 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028462/ [5028463] rgw/website/{clusters/fixed-2.yaml frontend/beast.yaml http.yaml overrides.yaml tasks/s3tests-website.yaml ubuntu_latest.yaml} time: 00:17:54 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028463/ [5028464] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:30:42 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028464/ [5028465] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_multipart_upload.yaml} time: 00:08:22 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028465/ [5028466] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} time: 00:11:20 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028466/ [5028467] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:26:38 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028467/ [5028468] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:59 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028468/ [5028470] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_ragweed.yaml} time: 00:08:49 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028470/ [5028471] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/testing.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:12:51 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028471/ [5028472] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} time: 00:25:44 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028472/ [5028473] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} time: 00:19:03 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028473/ [5028474] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:26:45 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028474/ [5028475] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml} time: 00:13:43 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028475/ [5028476] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:28:10 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028476/ [5028477] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:57 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028477/ [5028478] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} time: 00:11:53 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028478/ [5028479] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:27:15 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028479/ [5028480] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml} time: 00:08:43 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028480/ [5028481] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:27:00 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028481/ [5028482] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_kv.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:13:04 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028482/ [5028483] rgw/hadoop-s3a/{clusters/fixed-2.yaml hadoop/v32.yaml overrides.yaml s3a-hadoop.yaml} time: 00:13:44 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028483/ [5028484] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_bucket_quota.yaml} time: 00:09:29 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028484/ [5028485] rgw/multisite/{clusters.yaml frontend/civetweb.yaml omap_limits.yaml overrides.yaml realms/three-zone-plus-pubsub.yaml tasks/test_multi.yaml valgrind.yaml} time: 00:42:26 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028485/ [5028486] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/ec-profile.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:55 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028486/ [5028487] rgw/tempest/{clusters/fixed-1.yaml frontend/civetweb.yaml overrides.yaml tasks/rgw_tempest.yaml ubuntu_latest.yaml} time: 00:20:03 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028487/ [5028488] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_bucket_quota.yaml} time: 00:12:08 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028488/ [5028489] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:26:33 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028489/ [5028491] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:28:55 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028491/ [5028493] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_multipart_upload.yaml} time: 00:11:21 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028493/ [5028495] rgw/singleton/{all/radosgw-admin.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:49 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028495/ [5028496] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:28:19 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028496/ [5028497] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/filestore-xfs.yaml overrides.yaml rgw_pool_type/replicated.yaml tasks/rgw_ragweed.yaml} time: 00:08:30 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028497/ [5028498] rgw/crypt/{0-cluster/fixed-1.yaml 1-ceph-install/install.yaml 2-kms/vault_transit.yaml 3-rgw/rgw.yaml 4-tests/{s3tests.yaml}} time: 00:13:05 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028498/ [5028499] rgw/multisite/{clusters.yaml frontend/beast.yaml omap_limits.yaml overrides.yaml realms/two-zonegroup.yaml tasks/test_multi.yaml valgrind.yaml} time: 00:26:03 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028499/ [5028500] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/filestore-xfs.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_s3tests.yaml} time: 00:17:27 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028500/ [5028501] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:27:27 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028501/ [5028502] rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml objectstore/bluestore-bitmap.yaml overrides.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml} time: 00:14:18 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028502/ [5028503] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:28:08 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028503/ [5028505] rgw/thrash/{civetweb.yaml clusters/fixed-2.yaml install.yaml objectstore/bluestore-bitmap.yaml thrasher/default.yaml thrashosds-health.yaml workload/rgw_user_quota.yaml} time: 00:12:27 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028505/ [5028506] rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:29:16 info: http://pulpito.ceph.com/smanjara-2020-05-06_10:49:50-rgw-wip-dynamic-resharding-distro-basic-smithi/5028506/ 2020-05-06T12:00:18.250 INFO:teuthology.results:starting coverage generation 2020-05-06T12:00:18.257 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'