2021-10-21T04:59:12.068 INFO:root:teuthology version: 1.1.0-c56135d1
2021-10-21T04:59:12.069 INFO:teuthology.results:seed: '9746'
2021-10-21T05:00:37.226 INFO:root:teuthology version: 1.1.0-c56135d1
2021-10-21T05:00:37.232 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-10-21T07:06:47.127 INFO:teuthology.results:Tests finished! gathering results...
2021-10-21T07:06:51.055 INFO:scrape:Found 48 jobs
2021-10-21T07:06:51.987 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453936/teuthology.log matches
2021-10-21T07:06:51.988 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:52.265 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453916/teuthology.log matches
2021-10-21T07:06:52.266 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:52.569 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453930/teuthology.log matches
2021-10-21T07:06:52.571 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:52.900 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453952/teuthology.log matches
2021-10-21T07:06:52.901 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:53.228 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453922/teuthology.log matches
2021-10-21T07:06:53.229 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:53.508 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453946/teuthology.log matches
2021-10-21T07:06:53.509 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:53.832 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453908/teuthology.log matches
2021-10-21T07:06:53.833 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:54.160 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453954/teuthology.log matches
2021-10-21T07:06:54.161 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:54.464 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453940/teuthology.log matches
2021-10-21T07:06:54.465 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:54.763 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453932/teuthology.log matches
2021-10-21T07:06:54.764 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:55.108 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453944/teuthology.log matches
2021-10-21T07:06:55.109 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:55.470 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453928/teuthology.log matches
2021-10-21T07:06:55.471 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:55.865 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453938/teuthology.log matches
2021-10-21T07:06:55.867 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:56.175 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453950/teuthology.log matches
2021-10-21T07:06:56.176 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:56.521 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453924/teuthology.log matches
2021-10-21T07:06:56.522 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:57.159 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453934/teuthology.log matches
2021-10-21T07:06:57.160 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:57.576 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453948/teuthology.log matches
2021-10-21T07:06:57.577 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:57.861 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453910/teuthology.log matches
2021-10-21T07:06:57.862 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:58.198 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453926/teuthology.log matches
2021-10-21T07:06:58.199 WARNING:scrape:Misunderstood line: 
2021-10-21T07:06:58.199 INFO:scrape:Found 2 distinct failure reasons
2021-10-21T07:06:58.200 INFO:scrape:Failure: "2021-10-21T05:25:06.910210+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2021-10-21T07:06:58.200 INFO:scrape:4 jobs: ['6453942', '6453912', '6453914', '6453920']
2021-10-21T07:06:58.201 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls', 'validater/valgrind}']
2021-10-21T07:06:58.202 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/valgrind}']
2021-10-21T07:06:58.202 INFO:scrape:
2021-10-21T07:06:58.203 INFO:scrape:Valgrind: 
2021-10-21T07:06:58.203 INFO:scrape:20 jobs: ['6453936', '6453916', '6453930', '6453952', '6453922', '6453946', '6453908', '6453954', '6453940', '6453932', '6453944', '6453928', '6453938', '6453950', '6453924', '6453918', '6453934', '6453948', '6453910', '6453926']
2021-10-21T07:06:58.204 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls', 'validater/valgrind}']
2021-10-21T07:06:58.204 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/valgrind}']
2021-10-21T07:06:58.205 INFO:scrape:
2021-10-21T07:06:58.208 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/
failed:  24
dead:    0
running: 0
waiting: 0
queued:  0
passed:  24


Fail
=================================================================
[6453908]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:53:58
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453908/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453908/

    saw valgrind issues

[6453910]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:49:43
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453910/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453910/

    saw valgrind issues

[6453912]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:33
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453912/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453912/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bb956ab7192749e889623fe600479923

    "2021-10-21T05:25:50.128279+0000 mon.a (mon.0) 117 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6453914]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:21:03
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453914/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453914/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b7f6281cce494a43835d5959321ad5ed

    "2021-10-21T05:20:18.008705+0000 mon.a (mon.0) 276 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6453916]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:37:23
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453916/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453916/

    saw valgrind issues

[6453918]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:23:18
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453918/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453918/
sentry: https://sentry.ceph.com/organizations/ceph/?query=587eefcc21b44b699cfe729847b195b1

    reached maximum tries (90) after waiting for 540 seconds

[6453920]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:23:03
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453920/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453920/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fd8e174beae84a54a0d18505fd1113fb

    "2021-10-21T05:25:09.067964+0000 mon.a (mon.0) 114 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6453922]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:53:25
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453922/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453922/

    saw valgrind issues

[6453924]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:44:33
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453924/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453924/

    saw valgrind issues

[6453926]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:42:03
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453926/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453926/

    saw valgrind issues

[6453928]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:41:45
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453928/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453928/

    saw valgrind issues

[6453930]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:34:42
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453930/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453930/

    saw valgrind issues

[6453932]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:51:30
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453932/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453932/

    saw valgrind issues

[6453934]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:49:20
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453934/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453934/

    saw valgrind issues

[6453936]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:49:23
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453936/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453936/

    saw valgrind issues

[6453938]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:35:27
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453938/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453938/

    saw valgrind issues

[6453940]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:39:51
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453940/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453940/

    saw valgrind issues

[6453942]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:34:21
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453942/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453942/

    "2021-10-21T05:25:06.910210+0000 mon.a (mon.0) 119 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6453944]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:45:59
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453944/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453944/

    saw valgrind issues

[6453946]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:46:09
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453946/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453946/

    saw valgrind issues

[6453948]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:53:38
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453948/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453948/

    saw valgrind issues

[6453950]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:39:42
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453950/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453950/

    saw valgrind issues

[6453952]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:37:23
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453952/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453952/

    saw valgrind issues

[6453954]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:36:33
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453954/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453954/

    saw valgrind issues



Pass
=================================================================
[6453907] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:12
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453907/

[6453909] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:19
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453909/

[6453911] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:34
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453911/

[6453913] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:35:02
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453913/

[6453915] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:04
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453915/

[6453917] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:39
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453917/

[6453919] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:51
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453919/

[6453921] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:44
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453921/

[6453923] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:09
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453923/

[6453925] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:09
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453925/

[6453927] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:55
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453927/

[6453929] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:46
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453929/

[6453931] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:26
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453931/

[6453933] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:36:21
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453933/

[6453935] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:57
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453935/

[6453937] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:35:44
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453937/

[6453939] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:47
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453939/

[6453941] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:46
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453941/

[6453943] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:15
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453943/

[6453945] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:44
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453945/

[6453947] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:21
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453947/

[6453949] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:13
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453949/

[6453951] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:31
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453951/

[6453953] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:35:26
info:   http://pulpito.ceph.com/gsalomon-2021-10-21_04:59:04-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6453953/