2021-09-23T22:10:23.825 INFO:root:teuthology version: 1.1.0-d3a488f5 2021-09-23T22:10:23.827 INFO:teuthology.results:subset: '111/120000' 2021-09-23T22:10:23.827 INFO:teuthology.results:seed: '5357' 2021-09-23T22:30:31.073 INFO:root:teuthology version: 1.1.0-d3a488f5 2021-09-23T22:30:31.106 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-09-24T01:07:40.897 INFO:teuthology.results:Tests finished! gathering results... 2021-09-24T01:07:44.094 INFO:scrape:Found 39 jobs 2021-09-24T01:07:44.292 WARNING:scrape:Not-understood crash indication 2021-09-23T22:53:15.871 INFO:tasks.rgw.c2.client.0.smithi042.stderr:daemon-helper: command crashed with signal 11 2021-09-24T01:07:44.293 WARNING:scrape:Not-understood crash indication 2021-09-23T22:53:15.953 INFO:tasks.rgw.c1.client.1.smithi016.stderr:daemon-helper: command crashed with signal 11 2021-09-24T01:07:44.293 WARNING:scrape:Not-understood crash indication 2021-09-24T01:07:44.325 WARNING:scrape:Not-understood crash indication 2021-09-23T22:53:15.871 INFO:tasks.rgw.c2.client.0.smithi042.stderr:daemon-helper: command crashed with signal 11 2021-09-24T01:07:44.326 WARNING:scrape:Not-understood crash indication 2021-09-23T22:53:15.953 INFO:tasks.rgw.c1.client.1.smithi016.stderr:daemon-helper: command crashed with signal 11 2021-09-24T01:07:44.326 WARNING:scrape:Not-understood crash indication 2021-09-24T01:07:44.364 WARNING:scrape:Not-understood crash indication 2021-09-23T22:53:15.871 INFO:tasks.rgw.c2.client.0.smithi042.stderr:daemon-helper: command crashed with signal 11 2021-09-24T01:07:44.365 WARNING:scrape:Not-understood crash indication 2021-09-23T22:53:15.953 INFO:tasks.rgw.c1.client.1.smithi016.stderr:daemon-helper: command crashed with signal 11 2021-09-24T01:07:44.365 WARNING:scrape:Not-understood crash indication 2021-09-24T01:07:45.126 WARNING:scrape:Not-understood crash indication 2021-09-23T23:06:07.269 INFO:tasks.rgw.c2.client.0.smithi179.stderr:daemon-helper: command crashed with signal 11 2021-09-24T01:07:45.127 WARNING:scrape:Not-understood crash indication 2021-09-23T23:06:07.339 INFO:tasks.rgw.c1.client.1.smithi037.stderr:daemon-helper: command crashed with signal 11 2021-09-24T01:07:45.127 WARNING:scrape:Not-understood crash indication 2021-09-24T01:07:45.473 INFO:scrape:Found 4 distinct failure reasons 2021-09-24T01:07:45.474 INFO:scrape:Failure: rgw multisite, rgw multisite pubsub, test failures 2021-09-24T01:07:45.474 INFO:scrape:2 jobs: ['6404894', '6404914'] 2021-09-24T01:07:45.474 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-09-24T01:07:45.475 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2021-09-24T01:07:45.475 INFO:scrape: 2021-09-24T01:07:45.476 INFO:scrape:Failure: Command failed on smithi183 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0' 2021-09-24T01:07:45.476 INFO:scrape:2 jobs: ['6404912', '6404892'] 2021-09-24T01:07:45.477 INFO:scrape:suites intersection: ['overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2021-09-24T01:07:45.477 INFO:scrape:suites union: ['hadoop/default', 'hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2021-09-24T01:07:45.478 INFO:scrape: 2021-09-24T01:07:45.478 INFO:scrape:Failure: Command failed on smithi017 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2021-09-24T01:07:45.479 INFO:scrape:1 jobs: ['6404902'] 2021-09-24T01:07:45.479 INFO:scrape:suites: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 'tasks/rgw_ragweed}'] 2021-09-24T01:07:45.479 INFO:scrape: 2021-09-24T01:07:45.480 INFO:scrape:Failure: Cannot create secret 2021-09-24T01:07:45.480 INFO:scrape:1 jobs: ['6404891'] 2021-09-24T01:07:45.481 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2021-09-24T01:07:45.481 INFO:scrape: 2021-09-24T01:07:45.483 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 33 Fail ================================================================= [6404891] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:13:53 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404891/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404891/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6139775e0831407092747b224d7d3c32 Cannot create secret [6404892] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404892/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404892/ sentry: https://sentry.ceph.com/organizations/ceph/?query=888c840aef5040468bcc76bacfef89ac Command failed on smithi022 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2' [6404894] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:47:19 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404894/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404894/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25d666c4dcff4545aafb9498f0e7627d rgw multisite, rgw multisite pubsub, test failures [6404902] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:06:36 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404902/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404902/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ab14d4cdd6c48779e50080c22c091ab Command failed on smithi017 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6404912] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:09:06 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404912/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404912/ sentry: https://sentry.ceph.com/organizations/ceph/?query=496e6029a8a04dc6b7edea91c92899ac Command failed on smithi183 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0' [6404914] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:48:55 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404914/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404914/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab5f7ff187764e7da73eb66e5d41df21 rgw multisite, rgw multisite pubsub, test failures Pass ================================================================= [6404893] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:08:00 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404893/ [6404895] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404895/ [6404896] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} time: 00:20:52 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404896/ [6404897] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:59 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404897/ [6404898] rgw/tools/{centos_latest cluster tasks} time: 02:43:06 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404898/ [6404899] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:21:44 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404899/ [6404900] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:13:58 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404900/ [6404901] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:10:37 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404901/ [6404903] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} time: 00:18:53 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404903/ [6404904] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404904/ [6404905] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:20:40 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404905/ [6404906] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:14:40 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404906/ [6404907] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:27:07 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404907/ [6404908] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404908/ [6404909] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}} time: 00:18:20 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404909/ [6404910] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:04 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404910/ [6404911] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:05 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404911/ [6404913] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:07:23 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404913/ [6404915] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404915/ [6404916] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:20:14 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404916/ [6404917] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:13 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404917/ [6404918] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:22:38 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404918/ [6404919] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:13:52 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404919/ [6404920] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:11:37 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404920/ [6404921] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404921/ [6404922] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_18.04}} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404922/ [6404923] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404923/ [6404924] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:20:53 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404924/ [6404925] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:14:22 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404925/ [6404926] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:27:46 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404926/ [6404927] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:07:46 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404927/ [6404928] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404928/ [6404929] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2021-09-23_20:28:51-rgw-wip-yuri-testing-2021-09-23-0811-octopus-distro-basic-smithi/6404929/