2020-04-22T10:51:41.642 INFO:root:teuthology version: 1.0.0-876b874 2020-04-22T10:51:41.643 INFO:teuthology.results:seed: '2844' 2020-04-22T11:03:17.433 INFO:root:teuthology version: 1.0.0-876b874 2020-04-22T11:03:17.438 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-04-22T11:43:18.121 INFO:teuthology.results:Tests finished! gathering results... 2020-04-22T11:43:18.191 INFO:teuthology.results:Sending results to smanjara@redhat.com: Test Run: smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 23 Fail ================================================================= [4975134] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:28:21 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975134/ log: http://qa-proxy.ceph.com/teuthology/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975134/ "2020-04-22T11:14:12.043537+0000 mon.b (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log Pass ================================================================= [4975152] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:30:48 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975152/ [4975153] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:28:15 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975153/ [4975150] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:25:42 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975150/ [4975151] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:33:15 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975151/ [4975135] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:28:02 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975135/ [4975136] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:26:48 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975136/ [4975137] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:23:40 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975137/ [4975130] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:30:59 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975130/ [4975131] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:25:51 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975131/ [4975132] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:24:50 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975132/ [4975133] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:27:27 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975133/ [4975138] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:25:54 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975138/ [4975139] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:27:34 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975139/ [4975145] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:27:32 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975145/ [4975144] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:26:07 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975144/ [4975147] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:27:59 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975147/ [4975146] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{single.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:28:40 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975146/ [4975141] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:28:13 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975141/ [4975140] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} time: 00:30:45 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975140/ [4975143] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:25:53 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975143/ [4975142] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:25:51 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975142/ [4975149] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml sharding$/{single.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:24:34 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975149/ [4975148] rgw:verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml sharding$/{default.yaml} striping$/{stripe-equals-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml reshard.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} time: 00:25:46 info: http://pulpito.ceph.com/smanjara-2020-04-22_10:49:45-rgw:verify-wip-dynamic-resharding-distro-basic-smithi/4975148/ 2020-04-22T11:43:18.247 INFO:teuthology.results:starting coverage generation 2020-04-22T11:43:18.255 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python2.7/subprocess.py", line 711, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1343, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory