2020-07-04T03:07:40.143 INFO:root:teuthology version: 1.0.0-2b31d02 2020-07-04T03:07:40.145 INFO:teuthology.results:seed: '8390' 2020-07-04T03:36:50.295 INFO:root:teuthology version: 1.0.0-2b31d02 2020-07-04T03:36:50.316 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-04T04:42:51.879 INFO:teuthology.results:Tests finished! gathering results... 2020-07-04T04:42:57.823 INFO:scrape:Found 107 jobs 2020-07-04T04:43:32.696 INFO:scrape:Found 7 distinct failure reasons 2020-07-04T04:43:32.697 INFO:scrape:Failure: Command failed on smithi101 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' 2020-07-04T04:43:32.698 INFO:scrape:57 jobs 2020-07-04T04:43:32.699 INFO:scrape:suites intersection: [] 2020-07-04T04:43:32.700 INFO:scrape:suites union: ['cls', 'cluster', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'install', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/multifs/{clusters/fixed-2', 'rgw/thrash/{civetweb', 'rgw/tools/{centos_latest', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/rgw_bucket_quota}', 'tasks/rgw_multipart_upload}', 'tasks/rgw_user_quota}', 'tasks/{0-install', 'tasks}', 'thrasher/default', 'thrashosds-health', 'validater/lockdep}', 'validater/valgrind}', 'workload/rgw_bucket_quota}', 'workload/rgw_multipart_upload}', 'workload/rgw_user_quota}'] 2020-07-04T04:43:32.700 INFO:scrape: 2020-07-04T04:43:32.700 INFO:scrape:Failure: rgw multisite, test failures 2020-07-04T04:43:32.701 INFO:scrape:2 jobs: ['5197614', '5197668'] 2020-07-04T04:43:32.701 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2020-07-04T04:43:32.702 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2020-07-04T04:43:32.702 INFO:scrape: 2020-07-04T04:43:32.703 INFO:scrape:Failure: "2020-07-04T03:25:05.735922+0000 mon.a (mon.0) 184 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 2020-07-04T04:43:32.703 INFO:scrape:9 jobs: ['5197637', '5197678', '5197622', '5197702', '5197634', '5197709', '5197620', '5197680', '5197633'] 2020-07-04T04:43:32.703 INFO:scrape:suites intersection: ['overrides'] 2020-07-04T04:43:32.704 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'http', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/multifs/{clusters/fixed-2', 'rgw/singleton/{all/radosgw-admin', 'rgw/verify/{centos_latest', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rgw_bucket_quota}', 'tasks/rgw_multipart_upload}', 'tasks/rgw_ragweed}', 'tasks/rgw_s3tests}', 'tasks/s3tests-website', 'tasks/{0-install', 'ubuntu_latest}', 'validater/lockdep}', 'validater/valgrind}'] 2020-07-04T04:43:32.704 INFO:scrape: 2020-07-04T04:43:32.705 INFO:scrape:Failure: "2020-07-04T03:44:56.083828+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.4143.0:1 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e18) initiated 2020-07-04T03:44:25.493317+0000 currently delayed" in cluster log 2020-07-04T04:43:32.705 INFO:scrape:3 jobs: ['5197677', '5197626', '5197638'] 2020-07-04T04:43:32.706 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'frontend/beast', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install'] 2020-07-04T04:43:32.706 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}'] 2020-07-04T04:43:32.707 INFO:scrape: 2020-07-04T04:43:32.707 INFO:scrape:Failure: Command failed on smithi062 with status 1: 'sudo yum -y install ceph-mgr-diskprediction-local' 2020-07-04T04:43:32.707 INFO:scrape:3 jobs: ['5197623', '5197636', '5197656'] 2020-07-04T04:43:32.708 INFO:scrape:suites intersection: ['cls', 'clusters/fixed-2', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 's3tests-java', 's3tests}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install'] 2020-07-04T04:43:32.708 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/lockdep}', 'validater/valgrind}'] 2020-07-04T04:43:32.709 INFO:scrape: 2020-07-04T04:43:32.709 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean. 2020-07-04T04:43:32.710 INFO:scrape:6 jobs: ['5197706', '5197630', '5197643', '5197683', '5197649', '5197632'] 2020-07-04T04:43:32.710 INFO:scrape:suites intersection: ['clusters/fixed-2'] 2020-07-04T04:43:32.710 INFO:scrape:suites union: ['cls', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'install', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/thrash/{civetweb', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'thrasher/default', 'thrashosds-health', 'validater/lockdep}', 'validater/valgrind}', 'workload/rgw_s3tests}'] 2020-07-04T04:43:32.711 INFO:scrape: 2020-07-04T04:43:32.711 INFO:scrape:Failure: Command failed on smithi040 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack service create --os-username admin --os-password ADMIN --os-user-domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi040.front.sepia.ceph.com:35357/v3 --description 'Swift Service' --name swift object-store --debug" 2020-07-04T04:43:32.712 INFO:scrape:3 jobs: ['5197670', '5197611', '5197616'] 2020-07-04T04:43:32.712 INFO:scrape:suites intersection: [] 2020-07-04T04:43:32.713 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'frontend/beast', 'frontend/civetweb', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2020-07-04T04:43:32.713 INFO:scrape: 2020-07-04T04:43:32.719 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/ failed: 83 dead: 0 running: 0 waiting: 0 queued: 0 passed: 24 Fail ================================================================= [5197611] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197611/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197611/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=43148d0025d24629971d19d7d14847d8 Command failed on smithi038 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack project create --os-username admin --os-password ADMIN --os-user- domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi038.front.sepia.ceph.com:35357/v3 --description 'Encryption Tenant' --domain default rgwcrypt --debug" [5197613] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197613/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197613/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5c8f6c94443f4d238fa9b36bab1452ab Command failed on smithi022 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197614] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:45:42 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197614/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197614/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d6e92eb81d38435dbe05836ebb2f7cce rgw multisite, test failures [5197616] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:13:24 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197616/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197616/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b5d69bd0f0254a2691c87fa82c90af9e Command failed on smithi097 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack service create --os-username admin --os-password ADMIN --os-user- domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi097.front.sepia.ceph.com:35357/v3 --description 'Swift Service' --name swift object-store --debug" [5197617] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:16:45 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197617/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197617/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ee3fc82ded914a00942613d141dddc52 Command failed on smithi064 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197618] rgw/tools/{centos_latest cluster tasks} ----------------------------------------------------------------- time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197618/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197618/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ca09d5918cfc49bfb294cc5b6d538fb9 Command failed on smithi186 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197619] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197619/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197619/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d6e4b574d5f64dc5afc1a0f01763763b Command failed on smithi151 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197620] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} ----------------------------------------------------------------- time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197620/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197620/ "2020-07-04T03:26:22.550928+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 3 pgs peering (PG_AVAILABILITY)" in cluster log [5197621] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197621/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197621/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=33ab8b14f41d4690835dc07d4463b445 Command failed on smithi112 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197622] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197622/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197622/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f27bc169b662458c947313e1a8120d9c "2020-07-04T03:26:44.603129+0000 mon.b (mon.0) 108 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY)" in cluster log [5197623] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:05:43 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197623/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197623/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1492af91e36541d19bea0260dfe6f4f1 Command failed on smithi062 with status 1: 'sudo yum -y install ceph-mgr- diskprediction-local' [5197624] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197624/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197624/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=77e4de2159ca4fa29b60408035eccdac Command failed on smithi163 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197626] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:42:26 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197626/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197626/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ad46843d76b84dfda8025b9bc6712d2f "2020-07-04T03:22:44.512154+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.4124.0:1 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e18) initiated 2020-07-04T03:22:14.235110+0000 currently delayed" in cluster log [5197628] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197628/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197628/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=34374315fd6c47f8ac921866e862cd00 Command failed on smithi080 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197629] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197629/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197629/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7de8f88d57894d6791b9628b65159d99 Command failed on smithi169 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197630] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:42:16 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197630/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197630/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9c1e1341d6eb4a9799e5319f4f41e962 Scrubbing terminated -- not all pgs were active and clean. [5197631] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_user_quota} ----------------------------------------------------------------- time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197631/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197631/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cd15034f4b7b4a378b16de07db1c2416 Command failed on smithi041 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197632] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:42:19 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197632/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197632/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a27812dda96d4fdcaac0107b6cf7b480 Scrubbing terminated -- not all pgs were active and clean. [5197633] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:27:45 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197633/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197633/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e13ab48831b246f09bd5e82ca0cbadfd "2020-07-04T03:22:27.782332+0000 mon.b (mon.0) 112 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5197634] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197634/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197634/ "2020-07-04T03:27:27.055018+0000 mon.a (mon.0) 169 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log [5197635] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197635/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197635/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2e669d34936646cebc1658306120afce Command failed on smithi082 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197636] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:06:00 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197636/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197636/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b0a4cabb04b1410dbfacafaf1169a755 Command failed on smithi019 with status 1: 'sudo yum -y install ceph-mgr- diskprediction-local' [5197637] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:28:24 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197637/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197637/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d5c573df3f3f454eb9b59df58dc66edd "2020-07-04T03:25:05.735922+0000 mon.a (mon.0) 184 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5197638] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:42:36 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197638/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197638/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=32a4ee3d76fe4e2a8ed530165fade94e "2020-07-04T03:22:57.421140+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.4124.0:1 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e19) initiated 2020-07-04T03:22:26.720074+0000 currently delayed" in cluster log [5197639] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:48 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197639/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197639/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0bd165a0c6ad40bf88c3f0b134a752d4 Command failed on smithi049 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197643] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:42:10 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197643/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197643/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=17334fe2cb3145889434d7da15bdf94d Scrubbing terminated -- not all pgs were active and clean. [5197644] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197644/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197644/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4c18c7851a1c44f4ae2ae1d33946ef54 Command failed on smithi134 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197646] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197646/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197646/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=daee9079d0ca447da63d813365186451 Command failed on smithi026 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197647] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:28 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197647/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197647/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9004c297f71945a697307a3a61df2669 Command failed on smithi003 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197648] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} ----------------------------------------------------------------- time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197648/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197648/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e75155bfe9c340fba25c8146491b94a0 Command failed on smithi005 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197649] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:42:27 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197649/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197649/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=620a3e4518704c42a9767e485ad4d9fb Scrubbing terminated -- not all pgs were active and clean. [5197650] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197650/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197650/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5b539d9f1a4347d0a784bf5117f785ed Command failed on smithi066 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197652] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197652/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197652/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c0455860cffa48d89f393bdc4972893e Command failed on smithi086 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197653] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:48 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197653/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197653/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=85ecff0e5bf0422e8d826dce8a901bd8 Command failed on smithi158 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197654] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197654/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197654/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f61c29d8dfd04a41afdc8d40b132673d Command failed on smithi193 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197655] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} ----------------------------------------------------------------- time: 00:17:20 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197655/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197655/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f5ec8504b7c848c3be8779d1320f4e85 Command failed on smithi191 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197656] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:04:42 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197656/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197656/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=680a6a05b0bb4fa58a2cdab5fb9364f6 Command failed on smithi057 with status 1: 'sudo yum -y install ceph-test' [5197657] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:59 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197657/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197657/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6682bfc496964e47b0347c8833b30847 Command failed on smithi025 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197659] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197659/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197659/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c533aa93b5cf4fb882541634f259aa24 Command failed on smithi027 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197661] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197661/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197661/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d5832020bfa44e2789f701b389568ac6 Command failed on smithi145 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197662] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:37 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197662/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197662/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=19a19062e1324fc8a0cb8a7a194aab0a Command failed on smithi036 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197663] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_user_quota} ----------------------------------------------------------------- time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197663/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197663/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cb53fd5e408d4af6a98a70d5e4e11e4f Command failed on smithi184 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197664] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197664/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197664/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e87ed2b495b34f49b7697c049e933dc4 Command failed on smithi041 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197667] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197667/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197667/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8bd62895b5ff46989e1e40ce4e0fc9a1 Command failed on smithi204 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197668] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:49:41 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197668/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197668/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a848085de3ea4b41ba37eef905a98d16 rgw multisite, test failures [5197670] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197670/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197670/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=128c7db83d0049378564c03cf90fcb9c Command failed on smithi040 with status 1: "cd /home/ubuntu/cephtest/keystone && source .tox/venv/bin/activate && openstack service create --os-username admin --os-password ADMIN --os-user- domain-id default --os-project-name admin --os-project-domain-id default --os-identity-api-version 3 --os-auth-url http://smithi040.front.sepia.ceph.com:35357/v3 --description 'Swift Service' --name swift object-store --debug" [5197671] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197671/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197671/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4eb8b54e30b647269212538d96069645 Command failed on smithi003 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197672] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:14:53 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197672/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197672/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cd65b83dd52b4ae7a658328ef38116bf Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197674] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:13 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197674/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197674/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=48f34a452708458a9a8cc32b8caa3504 Command failed on smithi154 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197675] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197675/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197675/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=02239d1fb4224d69b271f15b6201d56a Command failed on smithi077 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197676] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197676/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197676/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=10afb6ae3bec4272861af4a7d2c5a264 Command failed on smithi086 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197677] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:41:29 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197677/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197677/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4c94d2e67ada46c7949daa705bd56802 "2020-07-04T03:44:56.083828+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.4143.0:1 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e18) initiated 2020-07-04T03:44:25.493317+0000 currently delayed" in cluster log [5197678] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:27:18 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197678/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197678/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=98909668ca1f4e7a95b92cf13db2c0f2 "2020-07-04T03:46:09.428391+0000 mon.b (mon.0) 107 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5197679] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197679/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197679/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3e03a2125fe94933a24db67523ef4fb1 Command failed on smithi062 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197680] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_s3tests} ----------------------------------------------------------------- time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197680/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197680/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=13ead3a882054d3fac3fb4c8d8d32fdb "2020-07-04T03:48:36.527975+0000 mon.b (mon.0) 113 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5197681] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197681/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197681/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f0968bd13c6e4d9babd9f6471356570f Command failed on smithi190 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197682] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:15:40 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197682/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197682/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8286336c243b471787b588948fc792be Command failed on smithi062 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197683] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:41:32 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197683/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197683/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9ed5a220f2ff438e8947824c9ef28700 Scrubbing terminated -- not all pgs were active and clean. [5197684] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_user_quota} ----------------------------------------------------------------- time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197684/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197684/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=77350234ae1d46f0a738458770768ee4 Command failed on smithi194 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197685] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197685/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197685/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2f764369a1024c378c23feb8cc065bb6 Command failed on smithi144 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197686] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197686/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197686/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b9ba012f6d7c47469d8c8a6fa417f326 Command failed on smithi097 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197688] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197688/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197688/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b4acd12e6bca4ce5a2580ce66829974b Command failed on smithi039 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197689] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197689/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197689/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b849fcac05b94491a6072908a09085e0 Command failed on smithi026 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197690] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197690/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197690/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ec4dd51659434e7cbe1835d15742d21e Command failed on smithi077 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197691] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:19:58 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197691/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197691/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5881c657077a4cea8077909836ef28c9 Command failed on smithi050 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197692] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:17 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197692/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197692/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=37c80b25d29d4cfc8252754920e7b120 Command failed on smithi059 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197697] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197697/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197697/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dfcf415555384c92bd8857593c570e84 Command failed on smithi051 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197699] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:54 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197699/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197699/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0a6cddeb128c4d55883d5fe0cb8db4fb Command failed on smithi149 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197700] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197700/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197700/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f02daf86a7804374a600edd9fe742523 Command failed on smithi110 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197701] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} ----------------------------------------------------------------- time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197701/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197701/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9e5d3c417e0241fc99daa2ca57d5c517 Command failed on smithi196 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197702] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:42:05 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197702/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197702/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=773689e4399646e9a396af449025f829 "2020-07-04T04:00:00.000106+0000 mon.a (mon.0) 263 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive, 1 pg peering" in cluster log [5197703] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197703/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197703/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=015db6d4c7dc4b8d91a88e2dfcee65e6 Command failed on smithi026 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197705] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197705/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197705/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1c2c5848144d459789b448e33fcb944c Command failed on smithi040 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197706] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:41:48 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197706/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197706/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=74dba3858e1a47f7b15206d186838edd Scrubbing terminated -- not all pgs were active and clean. [5197707] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197707/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197707/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ec38d7749e9a4dfbbafd2f513937bb9d Command failed on smithi006 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197708] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} ----------------------------------------------------------------- time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197708/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197708/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=59dc7d7e334c497c882b6d54e6310892 Command failed on smithi201 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197709] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:41:05 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197709/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197709/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=841fa19c03794d649612c5d9eaf0f424 "2020-07-04T04:00:00.000184+0000 mon.a (mon.0) 215 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive, 1 pg peering" in cluster log [5197710] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197710/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197710/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f51c58fa2c5e43b8b9c3bbd0a4ed9333 Command failed on smithi083 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197712] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197712/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197712/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8a615324f4cc4b97b59a379edb5a6dee Command failed on smithi144 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197714] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197714/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197714/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b33265d499304cb8884526df1b930ef8 Command failed on smithi067 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197715] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} ----------------------------------------------------------------- time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197715/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197715/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2804df513747478cab48f7d75de7b7f5 Command failed on smithi064 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197716] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_user_quota} ----------------------------------------------------------------- time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197716/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197716/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=31599358cbb348fe84de3b14d78a06e6 Command failed on smithi132 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5197717] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} ----------------------------------------------------------------- time: 00:15:08 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197717/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197717/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1b6bd57505004a3e92357bc04c287b5b Command failed on smithi101 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' Pass ================================================================= [5197612] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197612/ [5197615] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197615/ [5197625] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_ragweed} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197625/ [5197627] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_s3tests} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197627/ [5197640] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197640/ [5197641] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197641/ [5197642] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197642/ [5197645] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197645/ [5197651] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197651/ [5197658] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_ragweed} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197658/ [5197660] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_s3tests} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197660/ [5197665] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197665/ [5197666] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:15:28 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197666/ [5197669] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197669/ [5197673] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:18:43 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197673/ [5197687] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197687/ [5197693] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_ragweed} time: 00:09:20 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197693/ [5197694] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197694/ [5197695] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:25:49 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197695/ [5197696] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197696/ [5197698] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197698/ [5197704] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197704/ [5197711] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_ragweed} time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197711/ [5197713] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_s3tests} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2020-07-04_03:05:02-rgw-master-distro-basic-smithi/5197713/