2023-06-02T16:00:17.445 INFO:root:teuthology version: 0.0.1.dev116+g62814ab
2023-06-02T16:00:17.446 INFO:teuthology.results:seed: '831'
2023-06-02T16:16:40.252 INFO:root:teuthology version: 0.0.1.dev116+g62814ab
2023-06-02T16:16:40.280 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-06-02T18:07:49.392 INFO:teuthology.results:Tests finished! gathering results...
2023-06-02T18:07:51.333 INFO:scrape:Found 24 jobs
2023-06-02T18:07:51.678 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294437/teuthology.log matches
2023-06-02T18:07:51.679 WARNING:scrape:Misunderstood line: 
2023-06-02T18:07:52.038 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294443/teuthology.log matches
2023-06-02T18:07:52.039 WARNING:scrape:Misunderstood line: 
2023-06-02T18:07:52.321 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294449/teuthology.log matches
2023-06-02T18:07:52.322 WARNING:scrape:Misunderstood line: 
2023-06-02T18:07:52.685 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294435/teuthology.log matches
2023-06-02T18:07:52.686 WARNING:scrape:Misunderstood line: 
2023-06-02T18:07:53.031 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294445/teuthology.log matches
2023-06-02T18:07:53.033 WARNING:scrape:Misunderstood line: 
2023-06-02T18:07:53.370 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294451/teuthology.log matches
2023-06-02T18:07:53.371 WARNING:scrape:Misunderstood line: 
2023-06-02T18:07:53.372 INFO:scrape:Found 1 distinct failure reasons
2023-06-02T18:07:53.372 INFO:scrape:Valgrind: 
2023-06-02T18:07:53.373 INFO:scrape:6 jobs: ['7294437', '7294443', '7294449', '7294435', '7294445', '7294451']
2023-06-02T18:07:53.373 INFO:scrape:suites intersection: ['clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'ragweed', 'reshard', 'rgw:verify/{0-install', 's3tests-branch', 's3tests-java', 's3tests}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{cls', 'validater/valgrind}']
2023-06-02T18:07:53.373 INFO:scrape:suites union: ['clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{off}', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw:verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-branch', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{cls', 'validater/valgrind}']
2023-06-02T18:07:53.374 INFO:scrape:
2023-06-02T18:07:53.375 INFO:teuthology.results:Sending results to ivancich@redhat.com: Test Run: ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/
failed:  6
dead:    0
running: 0
waiting: 0
queued:  0
passed:  18


Fail
=================================================================
[7294435]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:16:28
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294435/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294435/

    "1685723400.0001874 mon.a (mon.0) 446 : cluster [WRN] overall HEALTH_WARN 1
    pool(s) do not have an application enabled" in cluster log

[7294437]  rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:18:06
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294437/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294437/

    saw valgrind issues

[7294443]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:48:48
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294443/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294443/

    saw valgrind issues

[7294445]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:40:28
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294445/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294445/

    saw valgrind issues

[7294449]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:11:02
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294449/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294449/

    saw valgrind issues

[7294451]  rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:17:08
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294451/
log:    http://qa-proxy.ceph.com/teuthology/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294451/

    saw valgrind issues



Pass
=================================================================
[7294428] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:37:02
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294428/

[7294429] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:11:41
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294429/

[7294430] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:40:41
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294430/

[7294431] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:05:47
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294431/

[7294432] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:27
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294432/

[7294433] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:01:37
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294433/

[7294434] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:41
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294434/

[7294436] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:35:51
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294436/

[7294438] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:36:15
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294438/

[7294439] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:50:11
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294439/

[7294440] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:34
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294440/

[7294441] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:21:08
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294441/

[7294442] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:36:05
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294442/

[7294444] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:39:46
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294444/

[7294446] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:43:48
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294446/

[7294447] rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:58:13
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294447/

[7294448] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:35:57
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294448/

[7294450] rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:44:08
info:   http://pulpito.ceph.com/ivancich-2023-06-02_15:58:58-rgw:verify-wip-add-reupload-testing-distro-default-smithi/7294450/