2022-07-02T20:08:24.319 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-02T20:08:24.321 INFO:teuthology.results:subset: '111/120000'
2022-07-02T20:08:24.321 INFO:teuthology.results:seed: '3894'
2022-07-02T20:50:45.705 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-02T20:50:45.736 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-07-02T23:14:57.866 INFO:teuthology.results:Tests finished! gathering results...
2022-07-02T23:15:01.488 INFO:scrape:Found 43 jobs
2022-07-02T23:15:03.535 INFO:scrape:Found 3 distinct failure reasons
2022-07-02T23:15:03.537 INFO:scrape:Failure: rgw multisite, rgw multisite pubsub, test failures
2022-07-02T23:15:03.538 INFO:scrape:3 jobs: ['6910954', '6910987', '6910976']
2022-07-02T23:15:03.538 INFO:scrape:suites intersection: ['ignore-pg-availability', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2022-07-02T23:15:03.539 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2022-07-02T23:15:03.539 INFO:scrape:
2022-07-02T23:15:03.540 INFO:scrape:Failure: Cannot create secret
2022-07-02T23:15:03.540 INFO:scrape:1 jobs: ['6910951']
2022-07-02T23:15:03.541 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability}', 'rgw/crypt/{0-cluster/fixed-1']
2022-07-02T23:15:03.541 INFO:scrape:
2022-07-02T23:15:03.542 INFO:scrape:Failure: Command failed on smithi162 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --"
2022-07-02T23:15:03.542 INFO:scrape:1 jobs: ['6910989']
2022-07-02T23:15:03.543 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'frontend/civetweb', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'tasks/{0-install', 'validater/valgrind}']
2022-07-02T23:15:03.543 INFO:scrape:
2022-07-02T23:15:03.545 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/
failed:  5
dead:    0
running: 0
waiting: 0
queued:  0
passed:  38


Fail
=================================================================
[6910951]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
-----------------------------------------------------------------
time:   00:16:58
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910951/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910951/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6316562ef4fa42df82ed19c17b1cb7b3

    Cannot create secret

[6910954]  rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:43:17
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910954/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910954/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3510e734b9e7465f8c82168285dac719

    rgw multisite, rgw multisite pubsub, test failures

[6910976]  rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:37:20
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910976/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910976/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d19806486ed44aa7932b03212cd04973

    rgw multisite pubsub, test failures

[6910987]  rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:41:04
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910987/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910987/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b1dbd947af554757b5d2022fa15ece4f

    rgw multisite, test failures

[6910989]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:32:25
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910989/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910989/

    Command failed on smithi162 with status 123: "sudo find /var/log/ceph -name
    '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --"



Pass
=================================================================
[6910952] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop}
time:   00:15:39
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910952/

[6910953] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload}
time:   00:09:49
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910953/

[6910955] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:14:05
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910955/

[6910956] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{ubuntu_latest} tasks/{0-install ststests webidentity}}
time:   00:26:43
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910956/

[6910957] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest}
time:   00:21:48
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910957/

[6910958] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota}
time:   00:14:15
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910958/

[6910959] rgw/tools/{centos_latest cluster tasks}
time:   02:51:14
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910959/

[6910960] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:11
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910960/

[6910961] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest}
time:   00:17:43
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910961/

[6910962] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload}
time:   00:12:41
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910962/

[6910963] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:13:13
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910963/

[6910964] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed}
time:   00:09:14
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910964/

[6910965] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8}}
time:   00:13:46
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910965/

[6910966] rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind}
time:   00:32:16
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910966/

[6910967] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests}
time:   00:20:03
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910967/

[6910968] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:32:34
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910968/

[6910969] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:12:17
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910969/

[6910970] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests}
time:   00:13:36
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910970/

[6910971] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}}
time:   00:13:55
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910971/

[6910972] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota}
time:   00:13:21
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910972/

[6910973] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:12:26
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910973/

[6910974] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop}
time:   00:13:59
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910974/

[6910975] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota}
time:   00:09:18
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910975/

[6910977] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:14:40
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910977/

[6910978] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/civetweb supported-random-distro$/{centos_8} tasks/{0-install ststests webidentity}}
time:   00:30:03
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910978/

[6910979] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest}
time:   00:22:17
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910979/

[6910980] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota}
time:   00:13:27
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910980/

[6910981] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:26:48
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910981/

[6910982] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest}
time:   00:17:17
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910982/

[6910983] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload}
time:   00:12:46
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910983/

[6910984] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:12:14
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910984/

[6910985] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota}
time:   00:10:22
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910985/

[6910986] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}}
time:   00:14:36
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910986/

[6910988] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests}
time:   00:16:39
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910988/

[6910990] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:12:27
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910990/

[6910991] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload}
time:   00:09:33
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910991/

[6910992] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}}
time:   00:14:33
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910992/

[6910993] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota}
time:   00:16:06
info:   http://pulpito.ceph.com/yuriw-2022-07-02_20:03:24-rgw-wip-yuri8-testing-2022-07-01-0822-pacific-distro-default-smithi/6910993/