2021-04-02T02:12:32.490 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-02T02:12:32.492 INFO:teuthology.results:subset: '1/20' 2021-04-02T02:12:32.492 INFO:teuthology.results:seed: '831' 2021-04-02T02:25:34.772 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-02T02:25:34.778 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-04-02T02:41:48.793 INFO:teuthology.results:Tests finished! gathering results... 2021-04-02T02:41:50.292 INFO:scrape:Found 35 jobs 2021-04-02T02:41:52.436 INFO:scrape:Found 2 distinct failure reasons 2021-04-02T02:41:52.437 INFO:scrape:Failure: "2021-04-02T02:31:53.187586+0000 mon.a (mon.0) 174 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log 2021-04-02T02:41:52.437 INFO:scrape:2 jobs: ['6015611', '6015603'] 2021-04-02T02:41:52.437 INFO:scrape:suites intersection: ['frontend/civetweb', 'overrides', 'rgw/multifs/{clusters/fixed-2'] 2021-04-02T02:41:52.438 INFO:scrape:suites union: ['frontend/civetweb', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'tasks/rgw_multipart_upload}', 'tasks/rgw_ragweed}'] 2021-04-02T02:41:52.438 INFO:scrape: 2021-04-02T02:41:52.439 INFO:scrape:Failure: Command failed on smithi063 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd dump --format=json' 2021-04-02T02:41:52.439 INFO:scrape:33 jobs 2021-04-02T02:41:52.440 INFO:scrape:suites intersection: [] 2021-04-02T02:41:52.440 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/barbican', '2-kms/testing', '2-kms/vault_kv', '2-kms/vault_transit', '3-rgw/rgw', '4-tests/{s3tests}}', 'cluster', 'clusters/fixed-2', 'frontend/beast', 'frontend/civetweb', 'hadoop/default', 'hadoop/v32', 'http', 'install', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/hadoop-s3a/{clusters/fixed-2', 'rgw/multifs/{clusters/fixed-2', 'rgw/multisite/{clusters', 'rgw/singleton/{all/radosgw-admin', 'rgw/tempest/{clusters/fixed-1', 'rgw/thrash/{civetweb', 'rgw/tools/{centos_latest', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3a-hadoop}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rgw_bucket_quota}', 'tasks/rgw_multipart_upload}', 'tasks/rgw_s3tests}', 'tasks/rgw_tempest', 'tasks/rgw_user_quota}', 'tasks/s3tests-website', 'tasks/test_multi', 'tasks}', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest}', 'valgrind}', 'workload/rgw_bucket_quota}', 'workload/rgw_multipart_upload}', 'workload/rgw_s3tests}', 'workload/rgw_user_quota}'] 2021-04-02T02:41:52.441 INFO:scrape: 2021-04-02T02:41:52.442 INFO:teuthology.results:Sending results to ivancich@redhat.com: Test Run: ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/ failed: 35 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [6015600] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} ----------------------------------------------------------------- time: 00:06:18 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015600/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015600/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ff942f239dc4e4ebf18217f73bbe94e Command failed on smithi136 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015601] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:05:26 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015601/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015601/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0f2eb813eed64db096cb36560c5fed50 Command failed on smithi132 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015602] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:06:31 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015602/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015602/ sentry: https://sentry.ceph.com/organizations/ceph/?query=db504de7a2cc4acea563c700b3a015cf Command failed on smithi072 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015603] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:06:13 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015603/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015603/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a2898a3aef2403893bde4dc726a1f70 "2021-04-02T02:29:03.807893+0000 mon.a (mon.0) 229 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log [6015604] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:05:45 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015604/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015604/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48095041588349219cac284df60a38c8 Command failed on smithi003 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd dump --format=json' [6015605] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:06:59 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015605/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015605/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b56956a29cdd47d38062ec85fbabdb7a Command failed on smithi055 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015606] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:05:40 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015606/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015606/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f906e13707f147ec95ca1c4d9b303ed5 Command failed on smithi046 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015607] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:06:22 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015607/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015607/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d559e0f6788047aca96046741294ec76 Command failed on smithi041 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015608] rgw/tools/{centos_latest cluster tasks} ----------------------------------------------------------------- time: 00:06:41 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015608/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015608/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c55c24c0494b4013b2a729935e5bc188 Command failed on smithi008 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015609] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} ----------------------------------------------------------------- time: 00:06:17 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015609/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015609/ sentry: https://sentry.ceph.com/organizations/ceph/?query=519d397172da482393321eea7bea5ec5 Command failed on smithi066 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015610] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:05:52 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015610/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015610/ sentry: https://sentry.ceph.com/organizations/ceph/?query=36e252553b3a4d709ac845aab3df27b5 Command failed on smithi032 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015611] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:06:03 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015611/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015611/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61764b0583c74caf9f99e55c211a88bf "2021-04-02T02:31:53.187586+0000 mon.a (mon.0) 174 : cluster [WRN] Health check failed: 6 osds down (OSD_DOWN)" in cluster log [6015612] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:05:51 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015612/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015612/ sentry: https://sentry.ceph.com/organizations/ceph/?query=820277b7bd0a492d9f780e105aa6e9f2 Command failed on smithi156 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015613] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:05:45 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015613/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015613/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7620d98fafbc4ed8a87d25c8954753e4 Command failed on smithi047 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015614] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:05:41 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015614/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015614/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5528f9d26ae64bf5a6128706d483a190 Command failed on smithi087 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd dump --format=json' [6015615] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015615/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015615/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f349dffa920345e0b8dea870d021e927 Command failed on smithi029 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015616] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} ----------------------------------------------------------------- time: 00:06:32 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015616/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015616/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6348385011874ae09d0ee3bba22ba61b Command failed on smithi042 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015617] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:06:37 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015617/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015617/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9058a9baa4b541f18c6f26ecd144d98f Command failed on smithi018 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015618] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} ----------------------------------------------------------------- time: 00:06:06 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015618/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015618/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c43e670b70e4a64991ee320d34d2d98 Command failed on smithi016 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015619] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:05:13 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015619/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015619/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b06f7c5431994c44a7e2ef0998a318fe Command failed on smithi195 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015620] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:06:02 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015620/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015620/ sentry: https://sentry.ceph.com/organizations/ceph/?query=513b4093892744b39da99beeca4fa763 Command failed on smithi117 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015621] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} ----------------------------------------------------------------- time: 00:05:43 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015621/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015621/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f8a74b760bd044a483a5460459db041a Command failed on smithi077 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015622] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:05:29 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015622/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015622/ sentry: https://sentry.ceph.com/organizations/ceph/?query=345cb0b4926e4cd7b1f779deeec15977 Command failed on smithi063 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd dump --format=json' [6015623] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:05:27 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015623/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015623/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3afe5e37ac494b76abcc0dcebc5e00ed Command failed on smithi090 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015624] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} ----------------------------------------------------------------- time: 00:05:24 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015624/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015624/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2517eafce8c4f2a922c8d82bfd571dc Command failed on smithi118 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015625] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:05:40 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015625/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015625/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24938ebf8dca453b9d7a9f1c2bc8b6bb Command failed on smithi058 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015626] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} ----------------------------------------------------------------- time: 00:06:04 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015626/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015626/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a042347da78b4e5eb471ab43989fb94a Command failed on smithi062 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015627] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:06:09 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015627/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015627/ sentry: https://sentry.ceph.com/organizations/ceph/?query=60fad23a78184ed0b77a7a1e1a1ca652 Command failed on smithi002 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015628] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} ----------------------------------------------------------------- time: 00:06:09 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015628/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015628/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91df71c172b94726980b93d8b2c38830 Command failed on smithi122 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015629] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:06:32 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015629/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015629/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d6c92646c1b24041b9170744fdec6ff2 Command failed on smithi120 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015630] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:05:16 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015630/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015630/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9a8bd5019cc48bf894afedf8c824bd1 Command failed on smithi081 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015631] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:05:38 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015631/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015631/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef1fa66c8ad7485a8669c59d91591554 Command failed on smithi083 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 --log-early osd dump --format=json' [6015632] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} ----------------------------------------------------------------- time: 00:05:59 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015632/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015632/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac6171addb4e47e3a85158860a0ddd21 Command failed on smithi093 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015633] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} ----------------------------------------------------------------- time: 00:06:05 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015633/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015633/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3294ddc26a484c27a1d39952a61605a5 Command failed on smithi036 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [6015634] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:10:23 info: http://pulpito.ceph.com/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015634/ log: http://qa-proxy.ceph.com/teuthology/ivancich-2021-04-01_23:15:45-rgw-wip-eric-testing-2-distro-basic-smithi/6015634/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b681a178be414191b95d03f1249b33ec Command failed on smithi125 with status 22: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json'