2021-12-11T00:47:59.238 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-11T00:47:59.239 INFO:teuthology.results:subset: '111/120000'
2021-12-11T00:47:59.240 INFO:teuthology.results:seed: '3310'
2021-12-11T01:35:19.280 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-11T01:35:19.317 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-12-11T13:21:12.337 INFO:teuthology.results:Tests finished! gathering results...
2021-12-11T13:21:15.783 INFO:scrape:Found 39 jobs
2021-12-11T13:21:17.152 INFO:scrape:Found 4 distinct failure reasons
2021-12-11T13:21:17.153 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi101 with status 1: 'S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a test_of_sts'
2021-12-11T13:21:17.153 INFO:scrape:1 jobs: ['6557719']
2021-12-11T13:21:17.153 INFO:scrape:suites: ['first', 'ignore-pg-availability', 'objectstore', 'overrides', 'pool-type', 'rgw/sts/{cluster', 'rgw_frontend/beast', 'ststests}}', 'supported-random-distro$/{centos_8.stream}', 'tasks/{0-install']
2021-12-11T13:21:17.154 INFO:scrape:
2021-12-11T13:21:17.154 INFO:scrape:Failure: "2021-12-11T01:22:37.880596+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2021-12-11T13:21:17.155 INFO:scrape:1 jobs: ['6557723']
2021-12-11T13:21:17.155 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}']
2021-12-11T13:21:17.156 INFO:scrape:
2021-12-11T13:21:17.156 INFO:scrape:Dead: b'2021-12-11T13:14:38.126 DEBUG:teuthology.exit:Finished running handlers'
2021-12-11T13:21:17.156 INFO:scrape:2 jobs: ['6557726', '6557716']
2021-12-11T13:21:17.157 INFO:scrape:suites intersection: ['ignore-pg-availability']
2021-12-11T13:21:17.157 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'tasks/test_multi}']
2021-12-11T13:21:17.158 INFO:scrape:
2021-12-11T13:21:17.158 INFO:scrape:Failure: Command failed on smithi072 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'"
2021-12-11T13:21:17.158 INFO:scrape:1 jobs: ['6557720']
2021-12-11T13:21:17.159 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2021-12-11T13:21:17.159 INFO:scrape:
2021-12-11T13:21:17.161 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/
failed:  3
dead:    2
running: 0
waiting: 0
queued:  0
passed:  34


Fail
=================================================================
[6557719]  rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{centos_8.stream} tasks/{0-install first ststests}}
-----------------------------------------------------------------
time:   00:28:22
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557719/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557719/
sentry: https://sentry.ceph.com/organizations/ceph/?query=655c1297705b42cab42f87e94cbd513a

    Command failed (s3 tests against rgw) on smithi101 with status 1:
    'S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a test_of_sts'

[6557720]  rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest}
-----------------------------------------------------------------
time:   00:20:34
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557720/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557720/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fa53c22e30f14c4da29973fd2b1e9204

    Command failed on smithi072 with status 1: "cd
    /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest
    run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml
    --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test
    _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.
    *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv
    ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes
    t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw
    eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*
    test_object_services.PublicObjectTest.test_access_public_container_object_w
    ithout_using_creds|.*test_object_services.ObjectTest.test_create_object_wit
    h_transfer_encoding'"

[6557723]  rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:27:55
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557723/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557723/

    "2021-12-11T01:22:37.880596+0000 mon.a (mon.0) 119 : cluster [WRN] Health
    check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1
    pg degraded (PG_DEGRADED)" in cluster log



Dead
=================================================================
[6557716]  rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{centos_8} tasks/test_multi}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557716/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557716/

    hit max job timeout

[6557726]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557726/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557726/

    hit max job timeout



Pass
=================================================================
[6557713] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}}
time:   00:38:55
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557713/

[6557714] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop}
time:   00:15:34
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557714/

[6557715] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload ubuntu_latest}
time:   00:08:44
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557715/

[6557717] rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}}
time:   00:30:44
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557717/

[6557718] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:24:42
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557718/

[6557721] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}
time:   00:13:07
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557721/

[6557722] rgw/tools/{centos_latest cluster tasks}
time:   02:43:58
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557722/

[6557724] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest}
time:   00:15:59
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557724/

[6557725] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}
time:   00:11:49
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557725/

[6557727] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed ubuntu_latest}
time:   00:07:37
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557727/

[6557728] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8}}
time:   00:12:36
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557728/

[6557729] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests}
time:   00:16:51
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557729/

[6557730] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:34:41
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557730/

[6557731] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}}
time:   00:14:41
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557731/

[6557732] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests ubuntu_latest}
time:   00:12:35
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557732/

[6557733] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8.stream}}
time:   00:12:07
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557733/

[6557734] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}
time:   00:11:32
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557734/

[6557735] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8.stream}}
time:   00:13:48
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557735/

[6557736] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop}
time:   00:13:38
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557736/

[6557737] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota ubuntu_latest}
time:   00:07:48
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557737/

[6557738] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_8.stream} tasks/test_multi}
time:   00:41:12
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557738/

[6557739] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:24:57
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557739/

[6557740] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}
time:   00:12:21
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557740/

[6557741] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:28:50
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557741/

[6557742] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}
time:   00:11:40
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557742/

[6557743] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}}
time:   00:11:30
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557743/

[6557744] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest}
time:   00:09:16
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557744/

[6557745] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}}
time:   00:24:57
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557745/

[6557746] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests}
time:   00:18:25
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557746/

[6557747] rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   01:38:33
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557747/

[6557748] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8.stream}}
time:   00:13:33
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557748/

[6557749] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest}
time:   00:07:56
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557749/

[6557750] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8.stream}}
time:   00:12:03
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557750/

[6557751] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}
time:   00:11:48
info:   http://pulpito.ceph.com/yuriw-2021-12-10_22:10:52-rgw-wip-yuri-master-12.10.21-distro-default-smithi/6557751/