2020-12-31T00:37:37.721 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-31T00:37:37.723 INFO:teuthology.results:seed: '3030' 2020-12-31T01:58:24.526 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-31T01:58:24.945 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-12-31T02:40:25.872 INFO:teuthology.results:Tests finished! gathering results... 2020-12-31T02:41:44.618 INFO:scrape:Found 113 jobs 2020-12-31T02:42:53.600 INFO:scrape:Found 4 distinct failure reasons 2020-12-31T02:42:53.602 INFO:scrape:Failure: Command failed on smithi085 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2020-12-31T02:42:53.602 INFO:scrape:54 jobs 2020-12-31T02:42:53.603 INFO:scrape:suites intersection: ['overrides'] 2020-12-31T02:42:53.604 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/multifs/{clusters/fixed-2', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/rgw_ragweed}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}'] 2020-12-31T02:42:53.605 INFO:scrape: 2020-12-31T02:42:53.605 INFO:scrape:Failure: "2020-12-31T01:54:15.521863+0000 mon.a (mon.0) 198 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log 2020-12-31T02:42:53.605 INFO:scrape:2 jobs: ['5737020', '5736993'] 2020-12-31T02:42:53.606 INFO:scrape:suites intersection: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw_pool_type/ec'] 2020-12-31T02:42:53.606 INFO:scrape:suites union: ['clusters/fixed-2', 'frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw/sts/{centos_latest', 'rgw_pool_type/ec', 'ststests', 'tasks/rgw_s3tests}', 'tasks/{0-install', 'webidentity}}'] 2020-12-31T02:42:53.607 INFO:scrape: 2020-12-31T02:42:53.607 INFO:scrape:Failure: [Errno 13] Permission denied: '/home/dgalloway' 2020-12-31T02:42:53.608 INFO:scrape:3 jobs: ['5736971', '5737057', '5737028'] 2020-12-31T02:42:53.608 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2020-12-31T02:42:53.608 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2020-12-31T02:42:53.609 INFO:scrape: 2020-12-31T02:42:53.609 INFO:scrape:Failure: Command failed on smithi025 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 2020-12-31T02:42:53.610 INFO:scrape:1 jobs: ['5736974'] 2020-12-31T02:42:53.610 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2020-12-31T02:42:53.610 INFO:scrape: 2020-12-31T02:42:53.616 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/ failed: 60 dead: 0 running: 0 waiting: 0 queued: 0 passed: 53 Fail ================================================================= [5736971] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:09:22 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736971/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736971/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae48a4fc9efd40c094e87c367eebcbb5 [Errno 13] Permission denied: '/home/dgalloway' [5736974] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:17:40 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736974/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736974/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05db51cd5dd2408cb59fa58a5a145c98 Command failed on smithi025 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|. *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.* test_object_services.PublicObjectTest.test_access_public_container_object_w ithout_using_creds'" [5736977] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:43 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736977/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736977/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f46a32fdf0a84df2ae9123a790dabb51 Command failed on smithi138 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736979] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:28:20 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736979/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736979/ sentry: https://sentry.ceph.com/organizations/ceph/?query=798b5289a97c4a38ab3a4511e62799f4 Command failed on smithi042 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736981] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:01 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736981/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736981/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9dba5b84bd3c44cba3a26da1c033f124 Command failed on smithi152 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736982] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:29:30 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736982/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736982/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2acef96c07747bdaf43a862cc610492 Command failed on smithi080 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736983] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736983/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736983/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3d9034d2c23462594c495f51642feda Command failed on smithi125 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736984] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736984/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736984/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0c02135ea6044cca2c3f56d32e96dd5 Command failed on smithi141 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736986] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:26:53 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736986/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736986/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2ba45ea3e5f4d1dbd0ea8b68cd69cb1 Command failed on smithi161 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736988] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:28:50 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736988/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736988/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5cda623125845eba0270ed4590e8662 Command failed on smithi184 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736990] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:26:55 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736990/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736990/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cdca56d426fd447182a9c5acc98a4a01 Command failed on smithi180 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736993] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/{0-install ststests webidentity}} ----------------------------------------------------------------- time: 00:26:35 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736993/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736993/ "2020-12-31T01:22:25.118826+0000 mon.b (mon.0) 187 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive (PG_AVAILABILITY)" in cluster log [5736994] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:28:07 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736994/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736994/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d00c9e477744805ba99ee608ea27df2 Command failed on smithi051 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736995] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:27:08 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736995/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736995/ sentry: https://sentry.ceph.com/organizations/ceph/?query=15a3e912235f439ca77a807a33bdd026 Command failed on smithi101 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736997] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:21 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736997/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736997/ sentry: https://sentry.ceph.com/organizations/ceph/?query=676eb0ffcb624014ba26eb55d5b1131d Command failed on smithi200 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736998] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:28:13 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736998/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736998/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa5e1a558e3f4c8797fd9da24f66e144 Command failed on smithi050 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5736999] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:05:54 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736999/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736999/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26d993fd44c8445384ce6e21bad17288 Command failed on smithi119 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737003] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737003/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737003/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4fb69629b1be4a0a87d8f41acbca02fd Command failed on smithi165 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737005] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:28:21 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737005/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737005/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f722fa4da63840a3a9aff323402b2fe6 Command failed on smithi039 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737006] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:11 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737006/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737006/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39a7d22eda214aca99c819f171873ae9 Command failed on smithi097 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737008] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:29:30 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737008/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737008/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3bc5200894140e89bde6e1b381aaa31 Command failed on smithi047 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737012] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737012/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737012/ sentry: https://sentry.ceph.com/organizations/ceph/?query=15d399cfc9f848288cdf0d9160d1e76c Command failed on smithi176 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737013] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:27:58 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737013/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737013/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d705f3ee301540d48766a66626092756 Command failed on smithi139 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737016] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:41 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737016/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737016/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b754fb77ecaa48899e10b0f013930f39 Command failed on smithi041 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737017] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:27:26 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737017/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737017/ sentry: https://sentry.ceph.com/organizations/ceph/?query=50c3a9f93c2a46cfa6d8689d1f2f4979 Command failed on smithi042 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737018] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:06:16 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737018/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737018/ sentry: https://sentry.ceph.com/organizations/ceph/?query=105730ea9f174e8da54bca95cebb83db Command failed on smithi033 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737019] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:06 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737019/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737019/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4eb94f28b974e899e6966177d1ebbb8 Command failed on smithi075 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737020] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_s3tests} ----------------------------------------------------------------- time: 00:21:38 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737020/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737020/ "2020-12-31T01:54:15.521863+0000 mon.a (mon.0) 198 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [5737021] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:27:19 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737021/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737021/ sentry: https://sentry.ceph.com/organizations/ceph/?query=33f6c55585b642919a68ead788a78c97 Command failed on smithi163 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737022] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:31 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737022/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737022/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc108fc5380744f4b86194d9b9c67dea Command failed on smithi143 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737024] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:27:15 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737024/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737024/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc183b265c0d40939135b02d2f260776 Command failed on smithi125 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737028] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737028/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737028/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0ecc64693384ec3bca434b1dd658c69 [Errno 13] Permission denied: '/home/dgalloway' [5737033] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:27 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737033/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737033/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d82bf21f77814e32ac366b3f8941f426 Command failed on smithi203 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737035] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:26:48 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737035/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737035/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6d423099b2841e2ae3e03831575839c Command failed on smithi119 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737037] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737037/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737037/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddd0160f122c464d86aee9ba0b2ebab9 Command failed on smithi098 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737038] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:26:32 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737038/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737038/ sentry: https://sentry.ceph.com/organizations/ceph/?query=215b9d62d5db4331a588f9f3e648a3c3 Command failed on smithi084 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737039] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:05:49 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737039/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737039/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7c59cb31a56f4425a16044038a08ccb8 Command failed on smithi129 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737040] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:59 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737040/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737040/ sentry: https://sentry.ceph.com/organizations/ceph/?query=262343f4d79f4ed5ae06f18e87c2dca3 Command failed on smithi074 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737042] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737042/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737042/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25ba98c7d3d34739b81821c3e599b3a1 Command failed on smithi154 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737044] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:30 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737044/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737044/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4aea6b2794d64c59a610a1c1dee53368 Command failed on smithi085 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737046] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:26:09 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737046/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737046/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77467fc392d547efa9db03231d042830 Command failed on smithi031 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737050] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737050/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737050/ sentry: https://sentry.ceph.com/organizations/ceph/?query=19e52152eefd4b338ca2c2e7a66297e5 Command failed on smithi142 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737051] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:28:18 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737051/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737051/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f03e7852833242c49c8fc4ba7c01a997 Command failed on smithi148 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737053] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:29:06 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737053/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737053/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21239283d47a4c8989395f8e48676da1 Command failed on smithi063 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737054] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:27:35 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737054/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737054/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee64ca33c85c4c308f949e897df82326 Command failed on smithi192 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737055] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737055/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737055/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3452f1daa8a4ff4919f59282b1eb398 Command failed on smithi037 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737057] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737057/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737057/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb81f595063340c1bc894a758d6b2a71 [Errno 13] Permission denied: '/home/dgalloway' [5737059] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:16 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737059/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737059/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e96b9f511eae4ff0b7e51d3b8b502f2d Command failed on smithi190 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737061] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:30:32 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737061/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737061/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4b41d863cb6e4f47aaa5e4515655376d Command failed on smithi050 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737062] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:29 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737062/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737062/ sentry: https://sentry.ceph.com/organizations/ceph/?query=539c5a4aee284b00a8cca180dd262ea7 Command failed on smithi185 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737064] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:30:59 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737064/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737064/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4261850a923c4598bf2927ae5e22a5f7 Command failed on smithi140 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737068] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:27:25 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737068/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d991a9071ded4f35a0b3179f9c24ac92 Command failed on smithi162 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737069] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:29:48 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737069/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737069/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ecda41688eb4ebf833645a9c4753437 Command failed on smithi205 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737072] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:28:43 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737072/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b12e4c2d4e974606a6b23e18027db4c1 Command failed on smithi032 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737073] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:30:15 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737073/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737073/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac6ec89c11074e839b6d4b93f4db659c Command failed on smithi204 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737074] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:05:57 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737074/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737074/ sentry: https://sentry.ceph.com/organizations/ceph/?query=804823234b6c4e5c88bca82fcc9b9aa6 Command failed on smithi016 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737075] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737075/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737075/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5ba7604ef584993986c073e3d33d377 Command failed on smithi042 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737077] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:28:55 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737077/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737077/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41446db3a90e467c9446fcc60323ad19 Command failed on smithi083 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737078] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:28:04 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737078/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737078/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7ecee8d363214f5da494ab18f576fb21 Command failed on smithi156 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5737080] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:29:13 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737080/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737080/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8b57c08476649c19dbed309d16b5113 Command failed on smithi150 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Pass ================================================================= [5736968] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736968/ [5736969] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736969/ [5736970] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736970/ [5736972] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736972/ [5736973] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/{0-install ststests webidentity}} time: 00:27:15 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736973/ [5736975] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:20:26 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736975/ [5736976] rgw/tools/{centos_latest cluster tasks} time: 00:28:52 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736976/ [5736978] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:22:19 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736978/ [5736980] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_multipart_upload} time: 00:14:22 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736980/ [5736985] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_s3tests} time: 00:18:58 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736985/ [5736987] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:17:23 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736987/ [5736989] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_user_quota} time: 00:15:40 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736989/ [5736991] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_bucket_quota} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736991/ [5736992] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736992/ [5736996] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5736996/ [5737000] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737000/ [5737001] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737001/ [5737002] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737002/ [5737004] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737004/ [5737007] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737007/ [5737009] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737009/ [5737010] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737010/ [5737011] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/{0-install ststests webidentity}} time: 00:28:55 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737011/ [5737014] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:15:15 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737014/ [5737015] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:18:15 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737015/ [5737023] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_user_quota} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737023/ [5737025] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737025/ [5737026] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737026/ [5737027] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737027/ [5737029] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737029/ [5737030] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/{0-install ststests webidentity}} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737030/ [5737031] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737031/ [5737032] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737032/ [5737034] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737034/ [5737036] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_multipart_upload} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737036/ [5737041] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_s3tests} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737041/ [5737043] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:18:34 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737043/ [5737045] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_user_quota} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737045/ [5737047] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_bucket_quota} time: 00:16:29 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737047/ [5737048] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_8}} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737048/ [5737049] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/{0-install ststests webidentity}} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737049/ [5737052] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737052/ [5737056] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737056/ [5737058] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:24:28 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737058/ [5737060] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737060/ [5737063] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737063/ [5737065] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:16:11 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737065/ [5737066] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737066/ [5737067] rgw/sts/{centos_latest clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/{0-install ststests webidentity}} time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737067/ [5737070] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737070/ [5737071] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:20:33 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737071/ [5737076] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_s3tests} time: 00:20:25 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737076/ [5737079] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_user_quota} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2020-12-26_03:05:03-rgw-master-distro-basic-smithi/5737079/