2020-06-27T12:01:06.117 INFO:root:teuthology version: 1.0.0-22bcea5
2020-06-27T12:01:06.118 INFO:teuthology.results:seed: '7245'
2020-06-27T13:05:02.624 INFO:root:teuthology version: 1.0.0-22bcea5
2020-06-27T13:05:02.658 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-06-27T13:58:03.827 INFO:teuthology.results:Tests finished! gathering results...
2020-06-27T13:58:11.116 INFO:scrape:Found 107 jobs
2020-06-27T13:58:54.879 INFO:scrape:Found 10 distinct failure reasons
2020-06-27T13:58:54.881 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi190 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain'"
2020-06-27T13:58:54.881 INFO:scrape:31 jobs
2020-06-27T13:58:54.882 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 's3tests-java', 's3tests}', 'tasks/{0-install']
2020-06-27T13:58:54.883 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}']
2020-06-27T13:58:54.883 INFO:scrape:
2020-06-27T13:58:54.884 INFO:scrape:Failure: "2020-06-27T13:00:00.000085+0000 mon.b (mon.0) 127 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive, 1 pg peering" in cluster log
2020-06-27T13:58:54.884 INFO:scrape:14 jobs: ['5182680', '5182664', '5182669', '5182679', '5182704', '5182737', '5182747', '5182722', '5182730', '5182675', '5182742', '5182717', '5182719', '5182734']
2020-06-27T13:58:54.885 INFO:scrape:suites intersection: ['overrides']
2020-06-27T13:58:54.885 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'http', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/multifs/{clusters/fixed-2', 'rgw/verify/{centos_latest', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/rgw_bucket_quota}', 'tasks/rgw_multipart_upload}', 'tasks/rgw_ragweed}', 'tasks/rgw_s3tests}', 'tasks/rgw_user_quota}', 'tasks/s3tests-website', 'tasks/{0-install', 'ubuntu_latest}', 'validater/lockdep}', 'validater/valgrind}']
2020-06-27T13:58:54.886 INFO:scrape:
2020-06-27T13:58:54.886 INFO:scrape:Failure: "2020-06-27T12:26:22.303184+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.4127.0:1 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e18) initiated 2020-06-27T12:25:51.284826+0000 currently delayed" in cluster log
2020-06-27T13:58:54.886 INFO:scrape:2 jobs: ['5182682', '5182667']
2020-06-27T13:58:54.887 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'frontend/beast', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 's3tests-java', 's3tests}', 'sharding$/{default}', 'tasks/{0-install', 'validater/lockdep}']
2020-06-27T13:58:54.887 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/lockdep}']
2020-06-27T13:58:54.888 INFO:scrape:
2020-06-27T13:58:54.888 INFO:scrape:Failure: Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi169 with status 12: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8b33a29f3a7f00f8e6f971159aa875abdbdf0dd9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh'
2020-06-27T13:58:54.889 INFO:scrape:1 jobs: ['5182662']
2020-06-27T13:58:54.889 INFO:scrape:suites: ['cluster', 'rgw/tools/{centos_latest', 'tasks}']
2020-06-27T13:58:54.889 INFO:scrape:
2020-06-27T13:58:54.890 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean.
2020-06-27T13:58:54.890 INFO:scrape:7 jobs: ['5182750', '5182740', '5182668', '5182752', '5182673', '5182758', '5182687']
2020-06-27T13:58:54.891 INFO:scrape:suites intersection: ['clusters/fixed-2']
2020-06-27T13:58:54.891 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'install', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/thrash/{civetweb', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'thrasher/default', 'thrashosds-health', 'validater/valgrind}', 'workload/rgw_multipart_upload}', 'workload/rgw_s3tests}', 'workload/rgw_user_quota}']
2020-06-27T13:58:54.892 INFO:scrape:
2020-06-27T13:58:54.892 INFO:scrape:Failure: Command failed on smithi152 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack service create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi152.front.sepia.ceph.com:35357/v3 --description 'Swift Service' --name swift object-store --debug"
2020-06-27T13:58:54.892 INFO:scrape:3 jobs: ['5182714', '5182655', '5182660']
2020-06-27T13:58:54.893 INFO:scrape:suites intersection: []
2020-06-27T13:58:54.893 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'frontend/beast', 'frontend/civetweb', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2020-06-27T13:58:54.894 INFO:scrape:
2020-06-27T13:58:54.894 INFO:scrape:Failure: rgw multisite, test failures
2020-06-27T13:58:54.894 INFO:scrape:3 jobs: ['5182658', '5182712', '5182739']
2020-06-27T13:58:54.895 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2020-06-27T13:58:54.895 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}']
2020-06-27T13:58:54.896 INFO:scrape:
2020-06-27T13:58:54.896 INFO:scrape:Failure: wait_for_clean: failed before timeout expired
2020-06-27T13:58:54.897 INFO:scrape:1 jobs: ['5182683']
2020-06-27T13:58:54.897 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'tasks/{0-install', 'validater/valgrind}']
2020-06-27T13:58:54.898 INFO:scrape:
2020-06-27T13:58:54.898 INFO:scrape:Failure: Command failed on smithi132 with status 1: 'sudo yum -y install ceph-test'
2020-06-27T13:58:54.898 INFO:scrape:1 jobs: ['5182718']
2020-06-27T13:58:54.899 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'frontend/beast', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{0-install', 'validater/valgrind}']
2020-06-27T13:58:54.899 INFO:scrape:
2020-06-27T13:58:54.900 INFO:scrape:Failure: {'Failure object was': {'smithi089.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost-program-options-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"}
2020-06-27T13:58:54.900 INFO:scrape:1 jobs: ['5182729']
2020-06-27T13:58:54.900 INFO:scrape:suites: ['cls', 'clusters/fixed-2', 'frontend/beast', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{0-install', 'validater/valgrind}']
2020-06-27T13:58:54.901 INFO:scrape:
2020-06-27T13:58:54.908 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/
failed:  63
dead:    1
running: 0
waiting: 0
queued:  0
passed:  43


Fail
=================================================================
[5182655]  rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}}
-----------------------------------------------------------------
time:   00:12:02
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182655/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182655/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=61582161cb7a4663a643450a868cd812

    Command failed on smithi164 with status 1: "cd
    /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate &&
    openstack project create --os-username admin --os-password ADMIN --os-user-
    domain-id default --os-project-name admin --os-project-domain-id default
    --os-identity-api-version 3 --os-auth-url
    http://smithi164.front.sepia.ceph.com:35357/v3 --description 'Encryption
    Tenant' --domain default rgwcrypt --debug"

[5182658]  rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:47:50
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182658/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182658/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1bbf5a5d23a045be99cc31fd7df1b132

    rgw multisite, test failures

[5182660]  rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest}
-----------------------------------------------------------------
time:   00:12:42
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182660/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182660/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=cd4ca0ca903c476793ecee12d21cbf58

    Command failed on smithi033 with status 1: "cd
    /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate &&
    openstack service create --os-username admin --os-password ADMIN --os-user-
    domain-id default --os-project-name admin --os-project-domain-id default
    --os-identity-api-version 3 --os-auth-url
    http://smithi033.front.sepia.ceph.com:35357/v3 --description 'Swift
    Service' --name swift object-store --debug"

[5182662]  rgw/tools/{centos_latest cluster tasks}
-----------------------------------------------------------------
time:   00:15:50
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182662/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182662/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=4de73c4e1ae64809b95f3c639ceaebb1

    Command failed (workunit test rgw/test_rgw_orphan_list.sh) on smithi169
    with status 12: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=8b33a29f3a7f00f8e6f971159aa875abdbdf0dd9
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh'

[5182664]  rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest}
-----------------------------------------------------------------
time:   00:17:22
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182664/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182664/

    "2020-06-27T12:25:12.548422+0000 mon.b (mon.0) 183 : cluster [WRN] Health
    check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering
    (PG_AVAILABILITY)" in cluster log

[5182665]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:37:19
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182665/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182665/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=7a3b858947e14170b809472dece6a71d

    Command failed (s3 tests against rgw) on smithi073 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182667]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:40:34
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182667/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182667/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=283364ca906a4dceb51f09ec5d520e08

    "2020-06-27T12:35:09.281787+0000 osd.2 (osd.2) 3 : cluster [WRN] slow
    request osd_op(client.4141.0:1 2.1 2.3e6a8311 (undecoded)
    ondisk+read+known_if_redirected e19) initiated
    2020-06-27T12:34:38.758743+0000 currently delayed" in cluster log

[5182668]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:41:13
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182668/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182668/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=beef2fe6eff9405fbbcae888e9bb5d83

    Scrubbing terminated -- not all pgs were active and clean.

[5182669]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_ragweed}
-----------------------------------------------------------------
time:   00:26:47
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182669/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182669/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2d516736497b416889b5bb6076800069

    "2020-06-27T13:09:48.840762+0000 mon.b (mon.0) 177 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182670]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:32:43
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182670/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182670/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=07148fe22d724661b05579cdaa93e938

    Command failed (s3 tests against rgw) on smithi116 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182672]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:38:07
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182672/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182672/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=f566298ff135431997ccde9f209abfe3

    Command failed (s3 tests against rgw) on smithi167 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182673]  rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload}
-----------------------------------------------------------------
time:   00:40:19
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182673/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182673/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=087c6139dfe64952b6b8a1bb849a7958

    Scrubbing terminated -- not all pgs were active and clean.

[5182674]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:34:50
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182674/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182674/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b77e3dc4a3a94273a637c03d18fd28d3

    Command failed (s3 tests against rgw) on smithi098 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182675]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_user_quota}
-----------------------------------------------------------------
time:   00:11:43
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182675/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182675/

    "2020-06-27T12:54:11.742366+0000 mon.b (mon.0) 212 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182679]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:40:31
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182679/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182679/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=388e0dccda0e443d802cc614e6dfd473

    "2020-06-27T13:00:00.000121+0000 mon.a (mon.0) 241 : cluster [WRN] overall
    HEALTH_WARN Reduced data availability: 1 pg inactive, 1 pg peering" in
    cluster log

[5182680]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:41:11
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182680/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182680/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=3d16823866dd45b2ab242bb22a04ddbb

    "2020-06-27T13:00:00.000085+0000 mon.b (mon.0) 127 : cluster [WRN] overall
    HEALTH_WARN Reduced data availability: 1 pg inactive, 1 pg peering" in
    cluster log

[5182682]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:40:36
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182682/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182682/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=0ed3c1f230a94bec8a1d74c9717a2ce5

    "2020-06-27T12:26:22.303184+0000 osd.5 (osd.5) 3 : cluster [WRN] slow
    request osd_op(client.4127.0:1 2.2 2.7c339972 (undecoded)
    ondisk+read+known_if_redirected e18) initiated
    2020-06-27T12:25:51.284826+0000 currently delayed" in cluster log

[5182683]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:40:43
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182683/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182683/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=aba1fb703f69402fafc9922a6aec17be

    wait_for_clean: failed before timeout expired

[5182687]  rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests}
-----------------------------------------------------------------
time:   00:40:45
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182687/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182687/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5c55ebcd6b224916ae110587fe7a226f

    Scrubbing terminated -- not all pgs were active and clean.

[5182688]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:33:00
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182688/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182688/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9910e3f2aa6142cf9e6fc2b53b64c98c

    Command failed (s3 tests against rgw) on smithi040 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182690]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:40:23
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182690/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182690/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=50adae155ef247b2a10f75c6930dbb0f

    Command failed (s3 tests against rgw) on smithi022 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182691]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:30:04
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182691/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182691/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2d4207e72e6d4fac833f080f364b6983

    Command failed (s3 tests against rgw) on smithi143 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182693]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:37:57
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182693/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182693/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=868af1032f794655afd417942f23a46a

    Command failed (s3 tests against rgw) on smithi018 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182696]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:32:35
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182696/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182696/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=7a4a18ebdd74462cbf20db73c3d966a9

    Command failed (s3 tests against rgw) on smithi045 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182697]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:40:10
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182697/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182697/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1f770dceeec64cfabc8fb5379422cf93

    Command failed (s3 tests against rgw) on smithi058 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182700]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:33:11
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182700/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182700/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2a5170b02ddc4c0eb51cb146c2cee295

    Command failed (s3 tests against rgw) on smithi179 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182703]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:32:45
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182703/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182703/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=f149b3157c5745f98b9c74886ea8bfb3

    Command failed (s3 tests against rgw) on smithi200 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182704]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_s3tests}
-----------------------------------------------------------------
time:   00:26:29
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182704/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182704/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=096f3d28cfd1436ab50f92c1b00e7a54

    "2020-06-27T12:44:08.015496+0000 mon.b (mon.0) 111 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182706]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:34:52
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182706/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182706/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=6a1e9f0495344ad48c8733092a19fc30

    Command failed (s3 tests against rgw) on smithi099 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182708]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:33:46
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182708/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182708/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=7d29cd14b7484921b09fe7ada145c5b9

    Command failed (s3 tests against rgw) on smithi103 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182712]  rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:46:49
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182712/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182712/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b5a946ec01644537b62564590acfe9d4

    rgw multisite, test failures

[5182714]  rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest}
-----------------------------------------------------------------
time:   00:12:51
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182714/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182714/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=6cb7d9e15a754becbbc27fa3db747d1b

    Command failed on smithi152 with status 1: "cd
    /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate &&
    openstack service create --os-username admin --os-password ADMIN --os-user-
    domain-id default --os-project-name admin --os-project-domain-id default
    --os-identity-api-version 3 --os-auth-url
    http://smithi152.front.sepia.ceph.com:35357/v3 --description 'Swift
    Service' --name swift object-store --debug"

[5182716]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:34:28
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182716/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182716/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=6d5daaf8a3394401a944e6fc6a916c1f

    Command failed (s3 tests against rgw) on smithi192 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182717]  rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest}
-----------------------------------------------------------------
time:   00:40:45
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182717/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182717/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=00582797f74f45f28b28033fca88a3ed

    "2020-06-27T13:05:12.849439+0000 mon.a (mon.0) 129 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182718]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:04:21
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182718/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182718/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=7fbde097182945139f12b7d6c5b34e31

    Command failed on smithi132 with status 1: 'sudo yum -y install ceph-test'

[5182719]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_multipart_upload}
-----------------------------------------------------------------
time:   00:12:16
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182719/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182719/

    "2020-06-27T13:05:21.986346+0000 mon.b (mon.0) 218 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182720]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:32:25
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182720/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182720/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=35ad46cc8a9441558b1d8cfed44ec5e4

    Command failed (s3 tests against rgw) on smithi190 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182721]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:35:04
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182721/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182721/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2881e26b26f241dab82c0e023c0fd9a3

    Command failed (s3 tests against rgw) on smithi162 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182722]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_ragweed}
-----------------------------------------------------------------
time:   00:26:27
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182722/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182722/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5990b7712bf84989ac6da4f25da7b557

    "2020-06-27T12:59:48.353175+0000 mon.b (mon.0) 165 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182723]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:34:40
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182723/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182723/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=da49642c5faf4004b7d03a73f0d2fef7

    Command failed (s3 tests against rgw) on smithi063 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182725]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:34:07
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182725/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182725/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=388014e780914a37adf72a5a54821afb

    Command failed (s3 tests against rgw) on smithi149 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182727]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:47:49
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182727/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182727/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1177c56f31914f2c88040015b7546f6f

    Command failed (s3 tests against rgw) on smithi098 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182730]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_bucket_quota}
-----------------------------------------------------------------
time:   00:26:58
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182730/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182730/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=973e5d43056949cfb1dd92c4ec905ca6

    "2020-06-27T13:05:50.625324+0000 mon.a (mon.0) 130 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182732]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:38:47
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182732/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182732/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=97abb2f79d1e4d0281182da0118cc98c

    Command failed (s3 tests against rgw) on smithi101 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182733]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:33:13
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182733/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182733/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=d70ded82e6c5433e8ce9e9821152f582

    Command failed (s3 tests against rgw) on smithi040 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182734]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload}
-----------------------------------------------------------------
time:   00:26:36
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182734/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182734/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=7609b6cbed224e80b5d9f4334bd63617

    "2020-06-27T13:11:32.769020+0000 mon.b (mon.0) 168 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182735]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:42:45
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182735/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182735/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=7c0cee5401af450f83023bf38c9c14fb

    Command failed (s3 tests against rgw) on smithi187 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182736]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:32:54
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182736/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182736/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=ac4a1bd179a14912ae363129bef40cef

    Command failed (s3 tests against rgw) on smithi079 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182737]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_ragweed}
-----------------------------------------------------------------
time:   00:26:53
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182737/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182737/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=6af25d67813c4d75b3ec84afc46fa11d

    "2020-06-27T13:16:10.543741+0000 mon.b (mon.0) 109 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182739]  rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind}
-----------------------------------------------------------------
time:   00:30:30
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182739/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182739/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5fb19cd0198545be908ab6230a0d5002

    rgw multisite, test failures

[5182740]  rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests}
-----------------------------------------------------------------
time:   00:40:22
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182740/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182740/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=96b6bfbae8f7435fb5d9a56e5c8ad244

    Scrubbing terminated -- not all pgs were active and clean.

[5182741]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:32:09
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182741/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182741/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=6c551d63e741431890eef91dbbb6c722

    Command failed (s3 tests against rgw) on smithi118 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182742]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_s3tests}
-----------------------------------------------------------------
time:   00:26:34
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182742/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182742/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=ed1a21758a534421b66020713d1f0114

    "2020-06-27T13:10:16.316596+0000 mon.a (mon.0) 133 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg inactive, 1 pg peering
    (PG_AVAILABILITY)" in cluster log

[5182743]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:37:05
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182743/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182743/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2cb76bbbdad54d4ca47cc2692f973863

    Command failed (s3 tests against rgw) on smithi145 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182746]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:36:53
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182746/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182746/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=79300ea6c5e74ed0a98cf9459891b0fa

    Command failed (s3 tests against rgw) on smithi167 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182747]  rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_bucket_quota}
-----------------------------------------------------------------
time:   00:12:27
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182747/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182747/

    "2020-06-27T13:14:06.599992+0000 mon.a (mon.0) 188 : cluster [WRN] Health
    check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in
    cluster log

[5182750]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:41:44
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182750/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182750/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9df1149fa9744461a9b9b4398d4fc4ab

    Scrubbing terminated -- not all pgs were active and clean.

[5182752]  rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota}
-----------------------------------------------------------------
time:   00:40:56
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182752/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182752/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=4b04dda14d444c0e9d942ab32595474a

    Scrubbing terminated -- not all pgs were active and clean.

[5182753]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:38:16
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182753/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182753/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=8a61f6d5fb0f411bb09095abef44fad2

    Command failed (s3 tests against rgw) on smithi057 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182754]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:35:11
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182754/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182754/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=d2cd9bf2774149dd99389538e9f52719

    Command failed (s3 tests against rgw) on smithi094 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182758]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:41:46
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182758/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182758/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=14ace28dca614f67830e2c7de7658cc7

    Scrubbing terminated -- not all pgs were active and clean.

[5182759]  rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
-----------------------------------------------------------------
time:   00:35:27
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182759/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182759/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b840b1ee16604ed89ff608febf1f0fe1

    Command failed (s3 tests against rgw) on smithi084 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"

[5182761]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:33:03
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182761/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182761/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=bbad79a14f7a4e0ea46fa54b44f1be2f

    Command failed (s3 tests against rgw) on smithi124 with status 1:
    "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf
    BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg
    REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt
    /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w
    /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!
    fails_strict_rfc2616,!fails_with_subdomain'"



Dead
=================================================================
[5182729]  rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
-----------------------------------------------------------------
time:   00:02:56
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182729/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182729/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1daeb439c8414d4d8aeee9b014811bce

    {'Failure object was': {'smithi089.front.sepia.ceph.com': {'msg': 'Failed
    to download packages: Cannot download Packages/boost-program-
    options-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [],
    'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit',
    'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs',
    'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof',
    'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel',
    'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose',
    'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-
    kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'],
    'state': 'present', 'allow_downgrade': False, 'autoremove': False,
    'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [],
    'disablerepo': [], 'download_only': False, 'enable_plugin': [],
    'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery':
    True, 'install_weak_deps': True, 'security': False, 'skip_broken': False,
    'update_cache': False, 'update_only': False, 'validate_certs': True,
    'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None',
    'download_dir': 'None', 'list': 'None', 'releasever': 'None'}},
    '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call
    last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-
    ansible_master/callback_plugins/failure_log.py", line 44, in log_failure
    log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com
    _git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data],
    stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com
    _git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data)
    File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l
    ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node
    = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te
    uthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 207, in represent_dict return
    self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo
    rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 207, in represent_dict return
    self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo
    rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 207, in represent_dict return
    self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo
    rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 207, in represent_dict return
    self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo
    rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 58, in represent_data node =
    self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce
    ph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 231, in represent_undefined raise
    RepresenterError("cannot represent an object", data)',
    'yaml.representer.RepresenterError': "('cannot represent an object', '/')"}



Pass
=================================================================
[5182656] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop}
time:   00:15:54
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182656/

[5182657] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota}
time:   00:13:24
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182657/

[5182659] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}}
time:   00:14:20
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182659/

[5182661] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota}
time:   00:16:22
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182661/

[5182663] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:35:28
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182663/

[5182666] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_multipart_upload}
time:   00:12:23
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182666/

[5182671] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_s3tests}
time:   00:13:31
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182671/

[5182676] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:34:19
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182676/

[5182677] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_bucket_quota}
time:   00:12:32
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182677/

[5182678] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{centos_8}}
time:   00:09:34
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182678/

[5182681] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload}
time:   00:11:54
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182681/

[5182684] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed}
time:   00:08:14
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182684/

[5182685] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}}
time:   00:12:56
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182685/

[5182686] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind}
time:   00:25:34
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182686/

[5182689] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests}
time:   00:14:15
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182689/

[5182692] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota}
time:   00:11:24
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182692/

[5182694] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota}
time:   00:12:47
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182694/

[5182695] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}}
time:   00:14:50
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182695/

[5182698] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload}
time:   00:11:46
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182698/

[5182699] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota}
time:   00:17:13
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182699/

[5182701] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:35:03
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182701/

[5182702] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_ragweed}
time:   00:08:44
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182702/

[5182705] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind}
time:   00:39:49
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182705/

[5182707] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_user_quota}
time:   00:11:41
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182707/

[5182709] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}}
time:   00:13:19
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182709/

[5182710] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop}
time:   00:14:30
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182710/

[5182711] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota}
time:   00:12:10
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182711/

[5182713] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}}
time:   00:09:29
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182713/

[5182715] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota}
time:   00:15:38
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182715/

[5182724] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_s3tests}
time:   00:14:27
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182724/

[5182726] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload}
time:   00:16:00
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182726/

[5182728] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_user_quota}
time:   00:11:23
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182728/

[5182731] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_8}}
time:   00:09:50
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182731/

[5182738] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}}
time:   00:13:09
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182738/

[5182744] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:32:31
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182744/

[5182745] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_user_quota}
time:   00:12:01
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182745/

[5182748] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}}
time:   00:09:29
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182748/

[5182749] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:34:23
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182749/

[5182751] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_multipart_upload}
time:   00:12:16
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182751/

[5182755] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_ragweed}
time:   00:08:12
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182755/

[5182756] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep}
time:   00:35:41
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182756/

[5182757] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_s3tests}
time:   00:14:50
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182757/

[5182760] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_user_quota}
time:   00:11:17
info:   http://pulpito.ceph.com/teuthology-2020-06-27_03:05:03-rgw-master-distro-basic-smithi/5182760/