2021-09-24T18:14:00.101 INFO:root:teuthology version: 1.1.0-d3a488f5 2021-09-24T18:14:00.103 INFO:teuthology.results:subset: '1/20' 2021-09-24T18:14:00.103 INFO:teuthology.results:seed: '831' 2021-09-24T18:14:27.240 INFO:root:teuthology version: 1.1.0-d3a488f5 2021-09-24T18:14:27.241 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-09-25T06:15:14.222 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2021-09-25T06:15:17.247 INFO:scrape:Found 35 jobs 2021-09-25T06:15:26.549 INFO:scrape:Found 9 distinct failure reasons 2021-09-25T06:15:26.550 INFO:scrape:Failure: Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi073 with status 13: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aa4497ebeb49e483ecc674aa31f102ee02c8c533 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh' 2021-09-25T06:15:26.550 INFO:scrape:1 jobs: ['6406310'] 2021-09-25T06:15:26.551 INFO:scrape:suites: ['cluster', 'rgw/tools/{centos_latest', 'tasks}'] 2021-09-25T06:15:26.551 INFO:scrape: 2021-09-25T06:15:26.551 INFO:scrape:Failure: Command failed (bucket notification tests against different endpoints) on smithi124 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' 2021-09-25T06:15:26.552 INFO:scrape:1 jobs: ['6406305'] 2021-09-25T06:15:26.552 INFO:scrape:suites: ['bluestore-bitmap', 'fixed-2', 'overrides', 'rgw/notifications/{beast', 'supported-all-distro$/{centos_8}', 'tasks/{0-install', 'test_amqp', 'test_kafka', 'test_others}}'] 2021-09-25T06:15:26.553 INFO:scrape: 2021-09-25T06:15:26.553 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi022 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" 2021-09-25T06:15:26.554 INFO:scrape:9 jobs: ['6406311', '6406321', '6406318', '6406301', '6406331', '6406317', '6406332', '6406328', '6406316'] 2021-09-25T06:15:26.554 INFO:scrape:suites intersection: [] 2021-09-25T06:15:26.554 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '2-kms/testing', '2-kms/vault_kv', '2-kms/vault_old', '2-kms/vault_transit', '3-rgw/rgw', '4-tests/{s3tests}', 'frontend/beast', 'http', 'ignore-pg-availability', 'install', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multifs/{clusters/fixed-2', 'rgw/thrash/{clusters/fixed-2', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_8.stream}}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rgw_s3tests', 'tasks/s3tests-website', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest', 'ubuntu_latest}', 'workload/rgw_s3tests}'] 2021-09-25T06:15:26.555 INFO:scrape: 2021-09-25T06:15:26.555 INFO:scrape:Failure: rgw multisite test failures 2021-09-25T06:15:26.556 INFO:scrape:2 jobs: ['6406324', '6406304'] 2021-09-25T06:15:26.556 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi}'] 2021-09-25T06:15:26.557 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8.stream}', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}'] 2021-09-25T06:15:26.557 INFO:scrape: 2021-09-25T06:15:26.557 INFO:scrape:Failure: 2021-09-25T06:15:26.558 INFO:scrape:6 jobs: ['6406319', '6406334', '6406315', '6406325', '6406330', '6406306'] 2021-09-25T06:15:26.558 INFO:scrape:suites intersection: ['frontend/beast', 'overrides', 'rgw/singleton/{all/radosgw-admin'] 2021-09-25T06:15:26.559 INFO:scrape:suites union: ['frontend/beast', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_8.stream}}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}'] 2021-09-25T06:15:26.559 INFO:scrape: 2021-09-25T06:15:26.559 INFO:scrape:Dead: b'2021-09-24T19:02:36.873 INFO:tasks.rgw.client.0.smithi099.stdout:' 2021-09-25T06:15:26.560 INFO:scrape:1 jobs: ['6406313'] 2021-09-25T06:15:26.560 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 'supported-random-distro$/{centos_8}}'] 2021-09-25T06:15:26.561 INFO:scrape: 2021-09-25T06:15:26.561 INFO:scrape:Failure: Command failed (ragweed tests against rgw) on smithi149 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'" 2021-09-25T06:15:26.561 INFO:scrape:1 jobs: ['6406314'] 2021-09-25T06:15:26.562 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 'tasks/rgw_ragweed', 'ubuntu_latest}'] 2021-09-25T06:15:26.562 INFO:scrape: 2021-09-25T06:15:26.563 INFO:scrape:Failure: Command failed on smithi158 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds|.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding'" 2021-09-25T06:15:26.563 INFO:scrape:1 jobs: ['6406308'] 2021-09-25T06:15:26.564 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2021-09-25T06:15:26.564 INFO:scrape: 2021-09-25T06:15:26.565 INFO:scrape:Failure: {'Failure object was': {'smithi159.front.sepia.ceph.com': {'stdout': '', 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6166 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n', 'rc': 100, 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': True, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'autoclean': False, 'install_recommends': 'None', 'name': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'purge': False, 'allow_unauthenticated': False, 'state': 'absent', 'upgrade': 'None', 'update_cache': 'None', 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, 'msg': "'apt-get remove 'librbd1' 'librados2'' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6166 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", 'stdout_lines': [], 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6166 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} 2021-09-25T06:15:26.565 INFO:scrape:1 jobs: ['6406322'] 2021-09-25T06:15:26.566 INFO:scrape:suites: ['hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2021-09-25T06:15:26.566 INFO:scrape: 2021-09-25T06:15:26.568 INFO:teuthology.results:Sending results to ivancich@redhat.com: Test Run: ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/ failed: 21 dead: 1 running: 1 waiting: 0 queued: 0 passed: 12 Fail ================================================================= [6406301] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:19:41 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406301/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406301/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b94652b078f948cc8f1d27d52504046e Command failed (s3 tests against rgw) on smithi188 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406304] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{rhel_8} tasks/test_multi} ----------------------------------------------------------------- time: 02:47:01 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406304/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406304/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62dea26147524c52b7c7582ab92b90e8 rgw multisite test failures [6406305] rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}} ----------------------------------------------------------------- time: 00:17:40 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406305/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406305/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c01beab32224960864595ce4ea30b94 Command failed (bucket notification tests against different endpoints) on smithi124 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/ rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/s rc/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test' [6406306] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:29 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406306/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406306/ sentry: https://sentry.ceph.com/organizations/ceph/?query=201ba6661f8a4b41a6b6ff8faa44904b [6406308] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:22:14 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406308/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406308/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a51a374376e340d681f03a3dc7ab3915 Command failed on smithi158 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test _account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|. *test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_serv ices_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*tes t_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticw eb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.* test_object_services.PublicObjectTest.test_access_public_container_object_w ithout_using_creds|.*test_object_services.ObjectTest.test_create_object_wit h_transfer_encoding'" [6406310] rgw/tools/{centos_latest cluster tasks} ----------------------------------------------------------------- time: 00:16:09 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406310/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406310/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ef9725a8c5d4596abe2f444a01a19ee Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi073 with status 13: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=aa4497ebeb49e483ecc674aa31f102ee02c8c533 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh' [6406311] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} ----------------------------------------------------------------- time: 00:17:08 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406311/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406311/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61a299c27c624a43aed1a06c09c8fbe8 Command failed (s3 tests against rgw) on smithi022 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406314] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed ubuntu_latest} ----------------------------------------------------------------- time: 00:08:56 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406314/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406314/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e612a7620134f429ece271fbf16212f Command failed (ragweed tests against rgw) on smithi149 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'" [6406315] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:50 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406315/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406315/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3684ece79ad54ef2a622caba853b7fdb [6406316] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:17:00 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406316/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406316/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ced7f6d70ff4713addf83d77f6e8978 Command failed (s3 tests against rgw) on smithi023 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406317] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:05 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406317/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406317/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e3822beb9b04778b945ce598451b805 Command failed (s3 tests against rgw) on smithi151 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406318] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests ubuntu_latest} ----------------------------------------------------------------- time: 00:13:16 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406318/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406318/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3605b1c1001d450295cd683d86a684da Command failed (s3 tests against rgw) on smithi152 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406319] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8.stream}} ----------------------------------------------------------------- time: 00:11:33 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406319/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406319/ sentry: https://sentry.ceph.com/organizations/ceph/?query=769b91dff81d440592de905567156b4a [6406321] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8.stream}} ----------------------------------------------------------------- time: 00:15:03 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406321/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406321/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e1af5fb232314d5b86890de32603e7b9 Command failed (s3 tests against rgw) on smithi136 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406324] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_8.stream} tasks/test_multi} ----------------------------------------------------------------- time: 00:54:32 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406324/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406324/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc65811f6f624789933e6043ad2af82b rgw multisite test failures [6406325] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:58 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406325/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406325/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2cda1629d3054b798087aa22fc0ec34f [6406328] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:23:44 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406328/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406328/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55254b1c366d4796addef651fe039ca6 Command failed (s3 tests against rgw) on smithi183 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406330] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:21:02 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406330/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406330/ sentry: https://sentry.ceph.com/organizations/ceph/?query=381c1300052d45d0928d7cdf0d53439f [6406331] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:16:18 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406331/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406331/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26acd655b66e414e8c1c60beddd0495f Command failed (s3 tests against rgw) on smithi111 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406332] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:23:55 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406332/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406332/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f37b76005db54f4e9573633bfe8fa21f Command failed (s3 tests against rgw) on smithi098 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,! fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" [6406334] rgw/singleton/{all/radosgw-admin frontend/beast objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8.stream}} ----------------------------------------------------------------- time: 00:11:53 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406334/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406334/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff1dedbe4b9b48b7894fe35a2db4b58c Dead ================================================================= [6406322] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:04:37 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406322/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406322/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f9af581fee54d21b96ecad4c2bbe7f0 {'Failure object was': {'smithi159.front.sepia.ceph.com': {'stdout': '', 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6166 (apt-get)\\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\\n', 'rc': 100, 'invocation': {'module_args': {'dpkg_options': 'force- confdef,force-confold', 'autoremove': False, 'force': True, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': ['ceph', 'ceph- common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python- cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph- fs-common', 'openmpi-common'], 'autoclean': False, 'install_recommends': 'None', 'name': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python- ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'purge': False, 'allow_unauthenticated': False, 'state': 'absent', 'upgrade': 'None', 'update_cache': 'None', 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, 'msg': "'apt-get remove 'librbd1' 'librados2'' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6166 (apt- get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock- frontend), is another process using it?\n", 'stdout_lines': [], 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock- frontend. It is held by process 6166 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/pyt hon3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker /src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/v irtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python 3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teut hology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/si te-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/vir tualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d 4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python 3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/vir tualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d 4e803797684b740cd06ea526c40/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_ teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/lib/python3. 6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} Running ================================================================= [6406313] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406313/ Pass ================================================================= [6406300] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:13:07 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406300/ [6406302] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:16:34 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406302/ [6406303] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload ubuntu_latest} time: 00:09:58 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406303/ [6406307] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{centos_8.stream} tasks/{0-install first ststests}} time: 00:30:32 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406307/ [6406309] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:15:31 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406309/ [6406312] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:13:07 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406312/ [6406320] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} time: 00:13:49 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406320/ [6406323] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota ubuntu_latest} time: 00:10:08 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406323/ [6406326] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/filestore-xfs thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} time: 00:14:43 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406326/ [6406327] rgw/thrash/{clusters/fixed-2 frontend/beast install objectstore/bluestore-bitmap thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} time: 00:13:59 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406327/ [6406329] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota ubuntu_latest} time: 00:10:42 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406329/ [6406333] rgw/multifs/{clusters/fixed-2 frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload ubuntu_latest} time: 00:10:24 info: http://pulpito.ceph.com/ivancich-2021-09-24_18:13:22-rgw-wip-eric-testing-1-distro-basic-smithi/6406333/