2021-07-31T22:06:52.853 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-07-31T22:06:52.855 INFO:teuthology.results:subset: '111/120000' 2021-07-31T22:06:52.856 INFO:teuthology.results:seed: '4800' 2021-07-31T22:20:26.955 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-07-31T22:20:26.994 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-08-01T01:02:39.083 INFO:teuthology.results:Tests finished! gathering results... 2021-08-01T01:02:42.954 INFO:scrape:Found 39 jobs 2021-08-01T01:02:45.666 WARNING:scrape:Not-understood crash indication 2021-07-31T22:55:16.974 INFO:tasks.rgw.c2.client.0.smithi180.stderr:daemon-helper: command crashed with signal 11 2021-08-01T01:02:45.667 WARNING:scrape:Not-understood crash indication 2021-07-31T22:55:17.162 INFO:tasks.rgw.c1.client.1.smithi053.stderr:daemon-helper: command crashed with signal 11 2021-08-01T01:02:45.668 WARNING:scrape:Not-understood crash indication 2021-08-01T01:02:45.700 WARNING:scrape:Not-understood crash indication 2021-07-31T22:55:16.974 INFO:tasks.rgw.c2.client.0.smithi180.stderr:daemon-helper: command crashed with signal 11 2021-08-01T01:02:45.701 WARNING:scrape:Not-understood crash indication 2021-07-31T22:55:17.162 INFO:tasks.rgw.c1.client.1.smithi053.stderr:daemon-helper: command crashed with signal 11 2021-08-01T01:02:45.701 WARNING:scrape:Not-understood crash indication 2021-08-01T01:02:45.735 WARNING:scrape:Not-understood crash indication 2021-07-31T22:55:16.974 INFO:tasks.rgw.c2.client.0.smithi180.stderr:daemon-helper: command crashed with signal 11 2021-08-01T01:02:45.736 WARNING:scrape:Not-understood crash indication 2021-07-31T22:55:17.162 INFO:tasks.rgw.c1.client.1.smithi053.stderr:daemon-helper: command crashed with signal 11 2021-08-01T01:02:45.736 WARNING:scrape:Not-understood crash indication 2021-08-01T01:02:45.737 INFO:scrape:Found 4 distinct failure reasons 2021-08-01T01:02:45.738 INFO:scrape:Failure: Command failed on smithi027 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2' 2021-08-01T01:02:45.738 INFO:scrape:2 jobs: ['6304673', '6304693'] 2021-08-01T01:02:45.739 INFO:scrape:suites intersection: ['overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2021-08-01T01:02:45.739 INFO:scrape:suites union: ['hadoop/default', 'hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2021-08-01T01:02:45.739 INFO:scrape: 2021-08-01T01:02:45.740 INFO:scrape:Failure: Command failed on smithi091 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2021-08-01T01:02:45.740 INFO:scrape:1 jobs: ['6304683'] 2021-08-01T01:02:45.741 INFO:scrape:suites: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 'tasks/rgw_ragweed}'] 2021-08-01T01:02:45.741 INFO:scrape: 2021-08-01T01:02:45.742 INFO:scrape:Failure: rgw multisite, test failures 2021-08-01T01:02:45.742 INFO:scrape:2 jobs: ['6304675', '6304695'] 2021-08-01T01:02:45.743 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-08-01T01:02:45.743 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-08-01T01:02:45.743 INFO:scrape: 2021-08-01T01:02:45.744 INFO:scrape:Failure: Cannot create secret 2021-08-01T01:02:45.744 INFO:scrape:1 jobs: ['6304672'] 2021-08-01T01:02:45.745 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2021-08-01T01:02:45.745 INFO:scrape: 2021-08-01T01:02:45.747 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 33 Fail ================================================================= [6304672] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304672/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304672/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ceb82700999d4c23b97110a7c8a53563 Cannot create secret [6304673] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:09:30 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304673/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304673/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8996da78df144219c2bed2007108e13 Command failed on smithi027 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2' [6304675] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:31:30 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304675/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304675/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91cdab5815344e7ebce915fa9860d033 rgw multisite, test failures [6304683] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:07:21 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304683/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304683/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4be64e71e5c447baa10916d2ff1d8d72 Command failed on smithi091 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6304693] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:10:09 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304693/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304693/ sentry: https://sentry.ceph.com/organizations/ceph/?query=275dfee7b52448ecb3a85de4dbe3fdd7 Command failed on smithi143 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0' [6304695] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:49:05 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304695/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304695/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7cfac84935824654aa7a0bb5972bd183 rgw multisite, rgw multisite pubsub, test failures Pass ================================================================= [6304674] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:08:54 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304674/ [6304676] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} time: 00:10:30 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304676/ [6304677] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} time: 00:21:21 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304677/ [6304678] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:13:13 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304678/ [6304679] rgw/tools/{centos_latest cluster tasks} time: 02:42:37 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304679/ [6304680] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:23:12 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304680/ [6304681] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:44 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304681/ [6304682] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:12:07 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304682/ [6304684] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_18.04}} time: 00:09:41 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304684/ [6304685] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:38 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304685/ [6304686] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:21:44 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304686/ [6304687] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304687/ [6304688] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:27:17 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304688/ [6304689] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304689/ [6304690] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_18.04}} time: 00:09:57 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304690/ [6304691] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:12:04 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304691/ [6304692] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:10 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304692/ [6304694] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:08:28 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304694/ [6304696] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} time: 00:11:46 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304696/ [6304697] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:21:00 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304697/ [6304698] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:43 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304698/ [6304699] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:23:06 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304699/ [6304700] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304700/ [6304701] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304701/ [6304702] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:09:52 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304702/ [6304703] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} time: 00:21:37 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304703/ [6304704] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:07 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304704/ [6304705] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:21:21 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304705/ [6304706] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:14:13 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304706/ [6304707] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:27:42 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304707/ [6304708] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:08:31 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304708/ [6304709] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:09:45 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304709/ [6304710] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2021-07-31_15:27:51-rgw-octopus-distro-basic-smithi/6304710/