2023-05-30T20:22:18.538 INFO:root:teuthology version: 0.0.1.dev111+gfa97ddd
2023-05-30T20:22:18.539 INFO:teuthology.results:subset: '111/12000'
2023-05-30T20:22:18.539 INFO:teuthology.results:seed: '1449'
2023-05-30T20:23:24.002 INFO:root:teuthology version: 0.0.1.dev111+gfa97ddd
2023-05-30T20:23:24.006 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-05-30T23:39:40.130 INFO:teuthology.results:Tests finished! gathering results...
2023-05-30T23:39:43.365 INFO:scrape:Found 41 jobs
2023-05-30T23:39:44.404 INFO:scrape:Found 3 distinct failure reasons
2023-05-30T23:39:44.406 INFO:scrape:Failure: Cannot create secret
2023-05-30T23:39:44.406 INFO:scrape:1 jobs: ['7289972']
2023-05-30T23:39:44.407 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 'supported-random-distro$/{ubuntu_latest}}']
2023-05-30T23:39:44.408 INFO:scrape:
2023-05-30T23:39:44.408 INFO:scrape:Failure: Command failed on smithi194 with status 1: 'cd /home/ubuntu/cephtest/tempest && /home/ubuntu/cephtest/tox-venv/bin/tox -e venv --notest'
2023-05-30T23:39:44.409 INFO:scrape:1 jobs: ['7289980']
2023-05-30T23:39:44.409 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2023-05-30T23:39:44.409 INFO:scrape:
2023-05-30T23:39:44.409 INFO:scrape:Failure: rgw multisite test failures
2023-05-30T23:39:44.410 INFO:scrape:1 jobs: ['7289976']
2023-05-30T23:39:44.410 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8}', 'tasks/test_multi}']
2023-05-30T23:39:44.410 INFO:scrape:
2023-05-30T23:39:44.413 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/
failed:  3
dead:    0
running: 0
waiting: 0
queued:  0
passed:  38


Fail
=================================================================
[7289972]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:18:25
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289972/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289972/
sentry: https://sentry.ceph.com/organizations/ceph/?query=99664f1237464a5abd6842abed7c3bdd

    Cannot create secret

[7289976]  rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{centos_8} tasks/test_multi}
-----------------------------------------------------------------
time:   00:45:14
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289976/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289976/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f56b485567b4bd3b2f41542bd4569c8

    rgw multisite test failures

[7289980]  rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest}
-----------------------------------------------------------------
time:   00:23:44
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289980/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289980/
sentry: https://sentry.ceph.com/organizations/ceph/?query=56273e0eba4e4e819b3498e30941d809

    Command failed on smithi194 with status 1: 'cd
    /home/ubuntu/cephtest/tempest && /home/ubuntu/cephtest/tox-venv/bin/tox -e
    venv --notest'



Pass
=================================================================
[7289971] rgw/cloud-transition/{cluster overrides supported-random-distro$/{centos_8} tasks/cloud_transition_s3tests}
time:   00:31:51
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289971/

[7289973] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop}
time:   00:18:35
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289973/

[7289974] rgw/lifecycle/{cluster overrides supported-random-distro$/{centos_8} tasks/rgw_s3tests}
time:   00:26:53
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289974/

[7289975] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload ubuntu_latest}
time:   00:13:04
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289975/

[7289977] rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}}
time:   00:35:58
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289977/

[7289978] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}
time:   00:18:01
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289978/

[7289979] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{ubuntu_latest} tasks/{0-install first ststests}}
time:   00:35:26
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289979/

[7289981] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}
time:   00:16:51
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289981/

[7289982] rgw/tools/{centos_latest cluster tasks}
time:   02:56:54
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289982/

[7289983] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:39:46
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289983/

[7289984] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest}
time:   00:21:33
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289984/

[7289985] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}
time:   00:19:01
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289985/

[7289986] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}}
time:   00:17:40
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289986/

[7289987] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed ubuntu_latest}
time:   00:10:38
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289987/

[7289988] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8}}
time:   00:22:49
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289988/

[7289989] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests}
time:   00:25:07
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289989/

[7289990] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:00:50
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289990/

[7289991] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}}
time:   00:17:37
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289991/

[7289992] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests ubuntu_latest}
time:   00:15:44
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289992/

[7289993] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}}
time:   00:18:21
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289993/

[7289994] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}
time:   00:14:23
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289994/

[7289995] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}}
time:   00:14:51
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289995/

[7289996] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop}
time:   00:16:59
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289996/

[7289997] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota ubuntu_latest}
time:   00:15:50
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289997/

[7289998] rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{rhel_8} tasks/test_multi}
time:   00:37:00
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289998/

[7289999] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}
time:   00:14:30
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7289999/

[7290000] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}
time:   00:15:04
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290000/

[7290001] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:35:44
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290001/

[7290002] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}
time:   00:20:25
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290002/

[7290003] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}}
time:   00:18:27
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290003/

[7290004] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest}
time:   00:12:38
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290004/

[7290005] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_8}}
time:   00:21:15
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290005/

[7290006] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests}
time:   00:18:16
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290006/

[7290007] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:01:03
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290007/

[7290008] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}}
time:   00:16:35
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290008/

[7290009] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest}
time:   00:11:18
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290009/

[7290010] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}
time:   00:15:48
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290010/

[7290011] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}
time:   00:19:08
info:   http://pulpito.ceph.com/yuriw-2023-05-30_20:22:01-rgw-wip-yuri5-testing-2023-05-30-0828-quincy-distro-default-smithi/7290011/