2022-10-11T18:13:52.024 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-11T18:13:52.026 INFO:teuthology.results:subset: '111/120000'
2022-10-11T18:13:52.026 INFO:teuthology.results:seed: '6198'
2022-10-11T19:10:42.109 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-11T19:10:42.113 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-10-11T21:36:53.241 INFO:teuthology.results:Tests finished! gathering results...
2022-10-11T21:36:56.844 INFO:scrape:Found 43 jobs
2022-10-11T21:36:58.580 INFO:scrape:Found 2 distinct failure reasons
2022-10-11T21:36:58.581 INFO:scrape:Failure: rgw multisite, rgw multisite pubsub, test failures
2022-10-11T21:36:58.581 INFO:scrape:4 jobs: ['7063126', '7063159', '7063148', '7063138']
2022-10-11T21:36:58.582 INFO:scrape:suites intersection: ['ignore-pg-availability', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2022-10-11T21:36:58.582 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2022-10-11T21:36:58.583 INFO:scrape:
2022-10-11T21:36:58.583 INFO:scrape:Failure: Cannot create secret
2022-10-11T21:36:58.584 INFO:scrape:1 jobs: ['7063123']
2022-10-11T21:36:58.584 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability}', 'rgw/crypt/{0-cluster/fixed-1']
2022-10-11T21:36:58.585 INFO:scrape:
2022-10-11T21:36:58.587 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/
failed:  5
dead:    0
running: 0
waiting: 0
queued:  0
passed:  38


Fail
=================================================================
[7063123]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
-----------------------------------------------------------------
time:   00:13:23
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063123/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063123/
sentry: https://sentry.ceph.com/organizations/ceph/?query=be320903ab3340e2b239ba17e9238c25

    Cannot create secret

[7063126]  rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:44:30
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063126/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063126/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce390a2933d7459893078dde46ff00f7

    rgw multisite, rgw multisite pubsub, test failures

[7063138]  rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   02:36:26
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063138/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063138/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aa78e41bf5d54c1d80d5acdd7f1c1af9

    rgw multisite, rgw multisite pubsub, test failures

[7063148]  rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:39:12
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063148/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063148/
sentry: https://sentry.ceph.com/organizations/ceph/?query=36a3c032d0a74eddad6ccc2df8106846

    rgw multisite pubsub, test failures

[7063159]  rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   02:19:47
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063159/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063159/
sentry: https://sentry.ceph.com/organizations/ceph/?query=94fdb046252742beb186c8b92efa03b2

    rgw multisite, rgw multisite pubsub, test failures



Pass
=================================================================
[7063124] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop}
time:   00:13:34
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063124/

[7063125] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload}
time:   00:07:14
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063125/

[7063127] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:11:43
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063127/

[7063128] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{rhel_8} tasks/{0-install ststests webidentity}}
time:   00:27:19
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063128/

[7063129] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest}
time:   00:19:45
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063129/

[7063130] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota}
time:   00:11:30
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063130/

[7063131] rgw/tools/{centos_latest cluster tasks}
time:   02:49:40
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063131/

[7063132] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:25:17
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063132/

[7063133] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest}
time:   00:14:47
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063133/

[7063134] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload}
time:   00:10:02
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063134/

[7063135] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:10:32
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063135/

[7063136] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed}
time:   00:06:32
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063136/

[7063137] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}
time:   00:08:09
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063137/

[7063139] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests}
time:   00:15:20
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063139/

[7063140] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:28:53
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063140/

[7063141] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:09:33
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063141/

[7063142] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests}
time:   00:11:07
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063142/

[7063143] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}
time:   00:08:28
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063143/

[7063144] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota}
time:   00:10:41
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063144/

[7063145] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:09:54
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063145/

[7063146] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop}
time:   00:12:25
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063146/

[7063147] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota}
time:   00:06:38
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063147/

[7063149] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:11:24
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063149/

[7063150] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/civetweb supported-random-distro$/{ubuntu_latest} tasks/{0-install ststests webidentity}}
time:   00:24:32
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063150/

[7063151] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest}
time:   00:18:50
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063151/

[7063152] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota}
time:   00:10:52
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063152/

[7063153] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:23:39
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063153/

[7063154] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest}
time:   00:14:20
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063154/

[7063155] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload}
time:   00:10:39
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063155/

[7063156] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:09:47
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063156/

[7063157] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota}
time:   00:08:00
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063157/

[7063158] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}
time:   00:08:37
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063158/

[7063160] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests}
time:   00:14:33
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063160/

[7063161] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:29:12
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063161/

[7063162] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:10:03
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063162/

[7063163] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload}
time:   00:07:01
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063163/

[7063164] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}}
time:   00:11:15
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063164/

[7063165] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota}
time:   00:10:41
info:   http://pulpito.ceph.com/yuriw-2022-10-11_18:07:14-rgw-wip-yuri-testing-2022-10-03-1342-pacific-distro-default-smithi/7063165/