2021-07-05T08:18:08.002 INFO:root:teuthology version: 1.1.0-26631ede
2021-07-05T08:18:08.004 INFO:teuthology.results:seed: '292'
2021-07-05T08:18:58.250 INFO:root:teuthology version: 1.1.0-26631ede
2021-07-05T08:18:58.255 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-07-05T09:58:04.727 INFO:teuthology.results:Tests finished! gathering results...
2021-07-05T09:58:06.101 INFO:scrape:Found 24 jobs
2021-07-05T09:58:06.671 INFO:scrape:Found 1 distinct failure reasons
2021-07-05T09:58:06.672 INFO:scrape:Failure: "2021-07-05T08:38:35.488034+0000 mon.a (mon.0) 106 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2021-07-05T09:58:06.673 INFO:scrape:2 jobs: ['6253009', '6253015']
2021-07-05T09:58:06.673 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{centos_latest', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'tasks/{0-install', 'validater/valgrind}']
2021-07-05T09:58:06.673 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{centos_latest', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/valgrind}']
2021-07-05T09:58:06.674 INFO:scrape:
2021-07-05T09:58:06.675 INFO:teuthology.results:Sending results to mkogan@redhat.com: Test Run: mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  22


Fail
=================================================================
[6253009]  rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:28:00
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253009/
log:    http://qa-proxy.ceph.com/teuthology/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253009/

    "2021-07-05T08:38:35.488034+0000 mon.a (mon.0) 106 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6253015]  rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:17:51
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253015/
log:    http://qa-proxy.ceph.com/teuthology/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253015/

    "2021-07-05T08:37:54.770688+0000 mon.a (mon.0) 111 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log



Pass
=================================================================
[6253006] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:46
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253006/

[6253007] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:24:51
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253007/

[6253008] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:36
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253008/

[6253010] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:33
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253010/

[6253011] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:26:05
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253011/

[6253012] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:10
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253012/

[6253013] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:13:38
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253013/

[6253014] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:58
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253014/

[6253016] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:15
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253016/

[6253017] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:11:29
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253017/

[6253018] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:27:14
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253018/

[6253019] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:25:50
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253019/

[6253020] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:27:27
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253020/

[6253021] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:24:24
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253021/

[6253022] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:27:07
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253022/

[6253023] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:25:03
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253023/

[6253024] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:28
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253024/

[6253025] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:15:30
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253025/

[6253026] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:27
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253026/

[6253027] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:12:51
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253027/

[6253028] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:50
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253028/

[6253029] rgw:verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:19:18
info:   http://pulpito.ceph.com/mkogan-2021-07-05_08:17:52-rgw:verify-rgw-tracker-51377_m01-distro-basic-smithi/6253029/