2021-11-12T13:59:35.494 INFO:root:teuthology version: 1.1.0-d4737010
2021-11-12T13:59:35.495 INFO:teuthology.results:seed: '8389'
2021-11-12T17:04:40.717 INFO:root:teuthology version: 1.1.0-d4737010
2021-11-12T17:04:40.742 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-11-12T18:59:49.492 INFO:teuthology.results:Tests finished! gathering results...
2021-11-12T18:59:53.984 INFO:scrape:Found 48 jobs
2021-11-12T18:59:54.422 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499443/teuthology.log matches
2021-11-12T18:59:54.423 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:55.023 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499405/teuthology.log matches
2021-11-12T18:59:55.025 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:55.581 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499437/teuthology.log matches
2021-11-12T18:59:55.582 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:55.854 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499441/teuthology.log matches
2021-11-12T18:59:55.856 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:56.226 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499415/teuthology.log matches
2021-11-12T18:59:56.227 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:56.610 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499407/teuthology.log matches
2021-11-12T18:59:56.611 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:57.023 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499425/teuthology.log matches
2021-11-12T18:59:57.024 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:57.362 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499427/teuthology.log matches
2021-11-12T18:59:57.363 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:57.599 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499445/teuthology.log matches
2021-11-12T18:59:57.600 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:57.820 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499417/teuthology.log matches
2021-11-12T18:59:57.821 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:58.122 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499403/teuthology.log matches
2021-11-12T18:59:58.123 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:58.950 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499413/teuthology.log matches
2021-11-12T18:59:58.951 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:59.269 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499409/teuthology.log matches
2021-11-12T18:59:59.270 WARNING:scrape:Misunderstood line: 
2021-11-12T18:59:59.554 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499431/teuthology.log matches
2021-11-12T18:59:59.555 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:00.226 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499423/teuthology.log matches
2021-11-12T19:00:00.227 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:00.483 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499439/teuthology.log matches
2021-11-12T19:00:00.484 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:01.546 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499401/teuthology.log matches
2021-11-12T19:00:01.547 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:01.840 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499429/teuthology.log matches
2021-11-12T19:00:01.841 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:02.079 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499447/teuthology.log matches
2021-11-12T19:00:02.081 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:02.373 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499419/teuthology.log matches
2021-11-12T19:00:02.374 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:02.611 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499421/teuthology.log matches
2021-11-12T19:00:02.612 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:03.032 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499411/teuthology.log matches
2021-11-12T19:00:03.033 WARNING:scrape:Misunderstood line: 
2021-11-12T19:00:03.035 INFO:scrape:Found 1 distinct failure reasons
2021-11-12T19:00:03.036 INFO:scrape:Valgrind: 
2021-11-12T19:00:03.036 INFO:scrape:26 jobs: ['6499443', '6499405', '6499435', '6499433', '6499437', '6499441', '6499415', '6499407', '6499438', '6499425', '6499427', '6499445', '6499417', '6499403', '6499408', '6499413', '6499409', '6499431', '6499423', '6499439', '6499401', '6499429', '6499447', '6499419', '6499421', '6499411']
2021-11-12T19:00:03.038 INFO:scrape:suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls']
2021-11-12T19:00:03.039 INFO:scrape:suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}']
2021-11-12T19:00:03.040 INFO:scrape:
2021-11-12T19:00:03.043 INFO:teuthology.results:Sending results to gsalomon@redhat.com: Test Run: gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/
failed:  26
dead:    0
running: 0
waiting: 0
queued:  0
passed:  22


Fail
=================================================================
[6499401]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:46:30
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499401/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499401/

    saw valgrind issues

[6499403]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:43:02
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499403/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499403/

    saw valgrind issues

[6499405]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:42:32
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499405/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499405/

    saw valgrind issues

[6499407]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:35:09
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499407/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499407/

    saw valgrind issues

[6499408]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:22
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499408/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499408/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f17809901433417fb3d5a3699abc533f

    reached maximum tries (90) after waiting for 540 seconds

[6499409]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:38:37
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499409/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499409/

    saw valgrind issues

[6499411]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:37:26
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499411/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499411/

    saw valgrind issues

[6499413]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:48:52
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499413/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499413/

    saw valgrind issues

[6499415]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:51:04
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499415/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499415/

    saw valgrind issues

[6499417]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:45:38
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499417/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499417/

    saw valgrind issues

[6499419]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:37:02
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499419/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499419/

    saw valgrind issues

[6499421]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:36:36
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499421/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499421/

    saw valgrind issues

[6499423]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:36:44
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499423/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499423/

    saw valgrind issues

[6499425]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:44:42
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499425/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499425/

    saw valgrind issues

[6499427]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:46:30
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499427/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499427/

    saw valgrind issues

[6499429]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:45:56
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499429/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499429/

    saw valgrind issues

[6499431]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:32:39
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499431/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499431/

    saw valgrind issues

[6499433]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:20:05
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499433/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499433/
sentry: https://sentry.ceph.com/organizations/ceph/?query=088c944a9c164a1a8453987f6c81dbba

    "2021-11-12T17:09:26.265966+0000 mon.a (mon.0) 135 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6499435]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:19:50
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499435/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499435/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3d72cdd7830c4019a9e6e2b17b8f3a67

    "2021-11-12T17:13:03.843014+0000 mon.a (mon.0) 131 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log

[6499437]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:50:16
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499437/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499437/

    saw valgrind issues

[6499438]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:19:07
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499438/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499438/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e2a0a11bfc9043c1a36fa59dcbddc4c8

    reached maximum tries (90) after waiting for 540 seconds

[6499439]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:48:36
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499439/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499439/

    saw valgrind issues

[6499441]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:48:27
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499441/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499441/

    saw valgrind issues

[6499443]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:35:23
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499443/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499443/

    saw valgrind issues

[6499445]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:31:26
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499445/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499445/

    saw valgrind issues

[6499447]  rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:29:23
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499447/
log:    http://qa-proxy.ceph.com/teuthology/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499447/

    saw valgrind issues



Pass
=================================================================
[6499400] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:14
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499400/

[6499402] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:17
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499402/

[6499404] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:07
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499404/

[6499406] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:36:52
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499406/

[6499410] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:19
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499410/

[6499412] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:43
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499412/

[6499414] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:25
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499414/

[6499416] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:31
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499416/

[6499418] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:09
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499418/

[6499420] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:22
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499420/

[6499422] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:12
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499422/

[6499424] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:54
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499424/

[6499426] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:20
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499426/

[6499428] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:55
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499428/

[6499430] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:59
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499430/

[6499432] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:41
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499432/

[6499434] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:53
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499434/

[6499436] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:31
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499436/

[6499440] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:29:30
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499440/

[6499442] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:10
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499442/

[6499444] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:56
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499444/

[6499446] rgw:verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:31:09
info:   http://pulpito.ceph.com/gsalomon-2021-11-12_12:31:24-rgw:verify-wip-test-albin-error-status-distro-basic-smithi/6499446/