2022-08-03T21:25:15.897 INFO:root:teuthology version: 1.1.1.dev407+g9e4bf63f
2022-08-03T21:25:15.909 INFO:teuthology.results:subset: '111/120000'
2022-08-03T21:25:15.910 INFO:teuthology.results:seed: '7551'
2022-08-03T21:47:12.135 INFO:root:teuthology version: 1.1.1.dev407+g9e4bf63f
2022-08-03T21:47:12.179 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-08-04T00:28:27.469 INFO:teuthology.results:Tests finished! gathering results...
2022-08-04T00:28:32.166 INFO:scrape:Found 43 jobs
2022-08-04T00:28:33.719 INFO:scrape:Found 2 distinct failure reasons
2022-08-04T00:28:33.721 INFO:scrape:Failure: rgw multisite, rgw multisite pubsub, test failures
2022-08-04T00:28:33.722 INFO:scrape:4 jobs: ['6957193', '6957213', '6957223', '6957234']
2022-08-04T00:28:33.723 INFO:scrape:suites intersection: ['ignore-pg-availability', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2022-08-04T00:28:33.724 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2022-08-04T00:28:33.725 INFO:scrape:
2022-08-04T00:28:33.726 INFO:scrape:Failure: Cannot create secret
2022-08-04T00:28:33.727 INFO:scrape:1 jobs: ['6957187']
2022-08-04T00:28:33.728 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability}', 'rgw/crypt/{0-cluster/fixed-1']
2022-08-04T00:28:33.729 INFO:scrape:
2022-08-04T00:28:33.733 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/
failed:  5
dead:    0
running: 0
waiting: 0
queued:  0
passed:  38


Fail
=================================================================
[6957187]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
-----------------------------------------------------------------
time:   00:15:49
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957187/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957187/
sentry: https://sentry.ceph.com/organizations/ceph/?query=403d5e88f0e24e64aa5ece1774f9f2ac

    Cannot create secret

[6957193]  rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:37:27
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957193/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957193/
sentry: https://sentry.ceph.com/organizations/ceph/?query=336416703c58482a89de6bd975da709f

    rgw multisite, rgw multisite pubsub, test failures

[6957213]  rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:42:17
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957213/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957213/
sentry: https://sentry.ceph.com/organizations/ceph/?query=679ec09d41c74a519180b65d36c1bbef

    rgw multisite, test failures

[6957223]  rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   01:06:57
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957223/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957223/
sentry: https://sentry.ceph.com/organizations/ceph/?query=82a5dd51ad144c629e47d4bd1a6cd755

    rgw multisite, rgw multisite pubsub, test failures

[6957234]  rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:46:59
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957234/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957234/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ea5e2a02f9d84c0997d80302f9e91a82

    rgw multisite, test failures



Pass
=================================================================
[6957189] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop}
time:   00:17:18
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957189/

[6957191] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload}
time:   00:10:08
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957191/

[6957195] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}
time:   00:13:32
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957195/

[6957196] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{rhel_8} tasks/{0-install ststests webidentity}}
time:   00:32:16
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957196/

[6957198] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest}
time:   00:22:17
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957198/

[6957200] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota}
time:   00:14:44
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957200/

[6957202] rgw/tools/{centos_latest cluster tasks}
time:   02:47:17
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957202/

[6957204] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:28
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957204/

[6957206] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest}
time:   00:18:25
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957206/

[6957208] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload}
time:   00:14:36
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957208/

[6957210] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:14:14
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957210/

[6957211] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed}
time:   00:11:29
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957211/

[6957212] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8}}
time:   00:15:43
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957212/

[6957214] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests}
time:   00:19:52
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957214/

[6957215] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:34:20
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957215/

[6957216] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:14:04
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957216/

[6957217] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests}
time:   00:16:08
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957217/

[6957218] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}}
time:   00:15:54
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957218/

[6957219] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota}
time:   00:17:51
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957219/

[6957220] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:14:29
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957220/

[6957221] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop}
time:   00:17:51
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957221/

[6957222] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota}
time:   00:12:02
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957222/

[6957224] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}}
time:   00:15:33
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957224/

[6957225] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/civetweb supported-random-distro$/{rhel_8} tasks/{0-install ststests webidentity}}
time:   00:33:11
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957225/

[6957226] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest}
time:   00:23:34
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957226/

[6957227] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota}
time:   00:15:42
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957227/

[6957228] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:30:03
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957228/

[6957229] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest}
time:   00:19:04
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957229/

[6957230] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload}
time:   00:15:36
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957230/

[6957231] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:13:49
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957231/

[6957232] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota}
time:   00:12:15
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957232/

[6957233] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}}
time:   00:16:51
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957233/

[6957235] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests}
time:   00:18:20
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957235/

[6957236] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:33:38
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957236/

[6957237] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability}
time:   00:13:20
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957237/

[6957238] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload}
time:   00:10:44
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957238/

[6957239] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}}
time:   00:16:03
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957239/

[6957240] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota}
time:   00:14:04
info:   http://pulpito.ceph.com/yuriw-2022-08-03_17:56:07-rgw-wip-yuri5-testing-2022-08-03-0828-pacific-distro-default-smithi/6957240/