2022-07-16T13:15:14.388 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5
2022-07-16T13:15:14.395 INFO:teuthology.results:subset: '1/30000'
2022-07-16T13:15:14.396 INFO:teuthology.results:seed: '6010'
2022-07-16T13:38:04.654 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5
2022-07-16T13:38:04.699 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-07-17T01:39:04.752 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2022-07-17T01:39:08.736 INFO:scrape:Found 43 jobs
2022-07-17T01:39:09.528 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932937/teuthology.log matches
2022-07-17T01:39:09.530 WARNING:scrape:Misunderstood line: 
2022-07-17T01:39:09.909 WARNING:scrape:Misunderstood line: Binary file /home/teuthworker/archive/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932971/teuthology.log matches
2022-07-17T01:39:09.910 WARNING:scrape:Misunderstood line: 
2022-07-17T01:39:11.695 INFO:scrape:Found 2 distinct failure reasons
2022-07-17T01:39:11.696 INFO:scrape:Failure: Command failed on smithi188 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'"
2022-07-17T01:39:11.697 INFO:scrape:1 jobs: ['6932922']
2022-07-17T01:39:11.697 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2022-07-17T01:39:11.698 INFO:scrape:
2022-07-17T01:39:11.699 INFO:scrape:Valgrind: 
2022-07-17T01:39:11.699 INFO:scrape:6 jobs: ['6932937', '6932971', '6932953', '6932912', '6932919', '6932918']
2022-07-17T01:39:11.700 INFO:scrape:suites intersection: []
2022-07-17T01:39:11.700 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'bluestore-bitmap', 'centos_latest', 'clusters/fixed-2', 'datacache/rgw-datacache', 'fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'notify', 'objectstore/filestore-xfs', 'omap_limits', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'reshard', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multisite/{clusters', 'rgw/notifications/{beast', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'supported-all-distro$/{centos_8}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/test_multi}', 'tasks/{0-install', 'tasks/{cls', 'test_amqp', 'test_kafka', 'test_others}}', 'validater/valgrind}']
2022-07-17T01:39:11.701 INFO:scrape:
2022-07-17T01:39:11.703 INFO:teuthology.results:Sending results to aemerson@redhat.com: Test Run: aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/
failed:  6
dead:    1
running: 0
waiting: 0
queued:  0
passed:  36


Fail
=================================================================
[6932912]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:17:36
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932912/
log:    http://qa-proxy.ceph.com/teuthology/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932912/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cbc0735617414cf08b8eedfc64c03ce0

    Cannot create secret

[6932918]  rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{centos_8} tasks/test_multi}
-----------------------------------------------------------------
time:   01:32:56
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932918/
log:    http://qa-proxy.ceph.com/teuthology/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932918/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f9f46e57a0941f3b5b789d97ef2be33

    rgw multisite test failures

[6932922]  rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest}
-----------------------------------------------------------------
time:   00:26:08
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932922/
log:    http://qa-proxy.ceph.com/teuthology/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932922/
sentry: https://sentry.ceph.com/organizations/ceph/?query=25398cffc8c048d99ef8baca025df559

    Command failed on smithi188 with status 1: "cd
    /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest
    run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml
    --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test
    _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.
    *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv
    ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes
    t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw
    eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*
    test_object_services.PublicObjectTest.test_access_public_container_object_w
    ithout_using_creds|.*test_object_services.ObjectTest.test_create_object_wit
    h_transfer_encoding'"

[6932937]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:59:30
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932937/
log:    http://qa-proxy.ceph.com/teuthology/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932937/

    saw valgrind issues

[6932953]  rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{rhel_8} tasks/test_multi}
-----------------------------------------------------------------
time:   00:34:55
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932953/
log:    http://qa-proxy.ceph.com/teuthology/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932953/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bc2ff8cf04ba4d4f9977d7f459646709

    rgw multisite test failures

[6932971]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   01:43:52
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932971/
log:    http://qa-proxy.ceph.com/teuthology/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932971/

    saw valgrind issues



Dead
=================================================================
[6932919]  rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932919/
log:    http://qa-proxy.ceph.com/teuthology/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932919/

    hit max job timeout



Pass
=================================================================
[6932911] rgw/cloud-transition/{cluster overrides supported-random-distro$/{rhel_8} tasks/cloud_transition_s3tests}
time:   00:30:14
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932911/

[6932913] rgw/dbstore/{cluster overrides supported-random-distro$/{centos_8} tasks/rgw_s3tests}
time:   00:17:23
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932913/

[6932914] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop}
time:   00:17:00
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932914/

[6932915] rgw/iam/{cluster ignore-pg-availability objectstore pool-type rgw_frontend/beast supported_random_distro$/{centos_8} tasks/{0-install iamtests}}
time:   00:16:18
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932915/

[6932916] rgw/lifecycle/{cluster overrides supported-random-distro$/{centos_8} tasks/rgw_s3tests}
time:   00:29:59
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932916/

[6932917] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload ubuntu_latest}
time:   00:11:53
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932917/

[6932920] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:12:59
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932920/

[6932921] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{ubuntu_latest} tasks/{0-install first ststests}}
time:   00:29:34
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932921/

[6932923] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}
time:   00:16:22
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932923/

[6932924] rgw/tools/{centos_latest cluster tasks}
time:   02:53:47
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932924/

[6932925] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:28
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932925/

[6932926] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest}
time:   00:19:47
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932926/

[6932927] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}
time:   00:14:14
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932927/

[6932929] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}}
time:   00:15:00
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932929/

[6932931] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed ubuntu_latest}
time:   00:11:06
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932931/

[6932933] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}
time:   00:12:38
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932933/

[6932935] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests}
time:   00:23:16
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932935/

[6932939] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}}
time:   00:13:58
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932939/

[6932941] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests ubuntu_latest}
time:   00:16:08
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932941/

[6932943] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}}
time:   00:12:50
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932943/

[6932945] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}
time:   00:13:07
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932945/

[6932947] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}}
time:   00:14:14
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932947/

[6932949] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop}
time:   00:14:47
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932949/

[6932951] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota ubuntu_latest}
time:   00:09:59
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932951/

[6932955] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:11:59
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932955/

[6932957] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}
time:   00:13:49
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932957/

[6932959] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:33:35
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932959/

[6932961] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}
time:   00:13:38
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932961/

[6932963] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}}
time:   00:13:52
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932963/

[6932965] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest}
time:   00:11:12
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932965/

[6932967] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}}
time:   00:12:10
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932967/

[6932969] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests}
time:   00:17:12
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932969/

[6932973] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}}
time:   00:16:15
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932973/

[6932974] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest}
time:   00:10:01
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932974/

[6932977] rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}
time:   00:11:47
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932977/

[6932979] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}
time:   00:14:38
info:   http://pulpito.ceph.com/aemerson-2022-07-16_13:14:31-rgw-wip-55765-distro-default-smithi/6932979/