2021-07-08T17:32:12.951 INFO:root:teuthology version: 1.1.0-24e3280d 2021-07-08T17:32:12.969 INFO:teuthology.results:subset: '1/2' 2021-07-08T17:32:12.969 INFO:teuthology.results:seed: '996' 2021-07-08T17:36:48.069 INFO:root:teuthology version: 1.1.0-24e3280d 2021-07-08T17:36:48.075 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-07-08T19:11:55.182 INFO:teuthology.results:Tests finished! gathering results... 2021-07-08T19:11:55.971 INFO:scrape:Found 12 jobs 2021-07-08T19:11:56.898 INFO:scrape:Found 1 distinct failure reasons 2021-07-08T19:11:56.898 INFO:scrape:Failure: "2021-07-08T17:52:02.172479+0000 mon.a (mon.0) 110 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 2021-07-08T19:11:56.899 INFO:scrape:2 jobs: ['6259203', '6259200'] 2021-07-08T19:11:56.899 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{centos_latest', 'rgw_pool_type/ec', 's3tests-java', 's3tests}', 'striping$/{stripe-equals-chunk}', 'tasks/{0-install'] 2021-07-08T19:11:56.900 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{centos_latest', 'rgw_pool_type/ec', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}'] 2021-07-08T19:11:56.900 INFO:scrape: 2021-07-08T19:11:56.902 INFO:teuthology.results:Sending results to yehuda@redhat.com: Test Run: yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 10 Fail ================================================================= [6259200] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 01:29:29 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259200/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259200/ "2021-07-08T17:57:52.446730+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log [6259203] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:14 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259203/ log: http://qa-proxy.ceph.com/teuthology/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259203/ "2021-07-08T17:52:02.172479+0000 mon.a (mon.0) 110 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log Pass ================================================================= [6259199] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:26:55 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259199/ [6259201] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:26:22 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259201/ [6259202] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:24:42 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259202/ [6259204] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:24:59 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259204/ [6259205] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:27:49 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259205/ [6259206] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:16:00 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259206/ [6259207] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:27:09 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259207/ [6259208] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:19:09 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259208/ [6259209] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:27:50 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259209/ [6259210] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 01:13:07 info: http://pulpito.ceph.com/yehuda-2021-07-08_10:31:42-rgw:verify-wip-rgw-realm-resolve-distro-basic-smithi/6259210/