2022-01-25T20:13:28.052 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-25T20:13:28.054 INFO:teuthology.results:subset: '111/120000' 2022-01-25T20:13:28.054 INFO:teuthology.results:seed: '5616' 2022-01-25T20:46:31.688 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-25T20:46:31.693 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-25T23:31:44.105 INFO:teuthology.results:Tests finished! gathering results... 2022-01-25T23:31:47.527 INFO:scrape:Found 39 jobs 2022-01-25T23:31:47.701 WARNING:scrape:Not-understood crash indication 2022-01-25T21:15:48.300 INFO:tasks.rgw.c2.client.0.smithi195.stderr:daemon-helper: command crashed with signal 11 2022-01-25T23:31:47.702 WARNING:scrape:Not-understood crash indication 2022-01-25T21:15:48.310 INFO:tasks.rgw.c1.client.1.smithi106.stderr:daemon-helper: command crashed with signal 11 2022-01-25T23:31:47.703 WARNING:scrape:Not-understood crash indication 2022-01-25T23:31:47.731 WARNING:scrape:Not-understood crash indication 2022-01-25T21:15:48.300 INFO:tasks.rgw.c2.client.0.smithi195.stderr:daemon-helper: command crashed with signal 11 2022-01-25T23:31:47.732 WARNING:scrape:Not-understood crash indication 2022-01-25T21:15:48.310 INFO:tasks.rgw.c1.client.1.smithi106.stderr:daemon-helper: command crashed with signal 11 2022-01-25T23:31:47.732 WARNING:scrape:Not-understood crash indication 2022-01-25T23:31:47.759 WARNING:scrape:Not-understood crash indication 2022-01-25T21:15:48.300 INFO:tasks.rgw.c2.client.0.smithi195.stderr:daemon-helper: command crashed with signal 11 2022-01-25T23:31:47.760 WARNING:scrape:Not-understood crash indication 2022-01-25T21:15:48.310 INFO:tasks.rgw.c1.client.1.smithi106.stderr:daemon-helper: command crashed with signal 11 2022-01-25T23:31:47.761 WARNING:scrape:Not-understood crash indication 2022-01-25T23:31:48.726 WARNING:scrape:Not-understood crash indication 2022-01-25T20:57:16.022 INFO:tasks.rgw.c2.client.0.smithi198.stderr:daemon-helper: command crashed with signal 11 2022-01-25T23:31:48.727 WARNING:scrape:Not-understood crash indication 2022-01-25T20:57:16.113 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 2022-01-25T23:31:48.728 WARNING:scrape:Not-understood crash indication 2022-01-25T23:31:48.728 INFO:scrape:Found 4 distinct failure reasons 2022-01-25T23:31:48.729 INFO:scrape:Failure: rgw multisite, rgw multisite pubsub, test failures 2022-01-25T23:31:48.729 INFO:scrape:2 jobs: ['6640192', '6640172'] 2022-01-25T23:31:48.730 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2022-01-25T23:31:48.731 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2022-01-25T23:31:48.732 INFO:scrape: 2022-01-25T23:31:48.732 INFO:scrape:Failure: Command failed on smithi067 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2022-01-25T23:31:48.732 INFO:scrape:1 jobs: ['6640180'] 2022-01-25T23:31:48.733 INFO:scrape:suites: ['frontend/civetweb', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 'tasks/rgw_ragweed}'] 2022-01-25T23:31:48.734 INFO:scrape: 2022-01-25T23:31:48.734 INFO:scrape:Failure: Command failed on smithi105 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2' 2022-01-25T23:31:48.735 INFO:scrape:2 jobs: ['6640170', '6640190'] 2022-01-25T23:31:48.735 INFO:scrape:suites intersection: ['overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2022-01-25T23:31:48.735 INFO:scrape:suites union: ['hadoop/default', 'hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2022-01-25T23:31:48.736 INFO:scrape: 2022-01-25T23:31:48.736 INFO:scrape:Failure: Cannot create secret 2022-01-25T23:31:48.737 INFO:scrape:1 jobs: ['6640169'] 2022-01-25T23:31:48.737 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2022-01-25T23:31:48.738 INFO:scrape: 2022-01-25T23:31:48.740 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 33 Fail ================================================================= [6640169] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:14:06 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640169/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1d5004992419405e85b3e62d1767e763 Cannot create secret [6640170] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:09:52 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640170/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640170/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6cddb5e373a488b911a09dad937ed27 Command failed on smithi105 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-2.9.2 rel/release-2.9.2' [6640172] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:48:10 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640172/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640172/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc07a1256d88472a9a97ab698b4e22f6 rgw multisite, rgw multisite pubsub, test failures [6640180] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:06:50 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640180/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640180/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b1a6ede37ac49519af7c406b6e3e86b Command failed on smithi067 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [6640190] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} ----------------------------------------------------------------- time: 00:09:22 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640190/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640190/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f9e1e5d61dc4cb39cf15328b063cdbd Command failed on smithi082 with status 4: 'cd /home/ubuntu/cephtest && wget http://www-us.apache.org/dist/maven/maven-3/3.6.3/binaries/apache- maven-3.6.3-bin.tar.gz && tar -xvf apache-maven-3.6.3-bin.tar.gz && git clone https://github.com/apache/hadoop && cd hadoop && git checkout -b hadoop-3.2.0 rel/release-3.2.0' [6640192] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:48:35 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640192/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640192/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4db7a73e9d414177aeec9c238799ab46 rgw multisite, rgw multisite pubsub, test failures Pass ================================================================= [6640171] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:08:29 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640171/ [6640173] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:19:56 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640173/ [6640174] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} time: 00:20:01 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640174/ [6640175] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:12:18 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640175/ [6640176] rgw/tools/{centos_latest cluster tasks} time: 03:00:50 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640176/ [6640177] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:40:04 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640177/ [6640178] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:14:12 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640178/ [6640179] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:10:43 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640179/ [6640181] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_18.04}} time: 00:09:15 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640181/ [6640182] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:15 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640182/ [6640183] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:20:52 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640183/ [6640184] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:15:16 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640184/ [6640185] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:28:33 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640185/ [6640186] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:11:21 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640186/ [6640187] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:10:01 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640187/ [6640188] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:37 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640188/ [6640189] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:33 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640189/ [6640191] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:07:52 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640191/ [6640193] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} time: 00:20:46 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640193/ [6640194] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:19:31 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640194/ [6640195] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:46 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640195/ [6640196] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:30:14 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640196/ [6640197] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:14:53 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640197/ [6640198] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:10:42 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640198/ [6640199] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640199/ [6640200] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} time: 00:20:22 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640200/ [6640201] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:20 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640201/ [6640202] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:20:52 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640202/ [6640203] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:14:05 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640203/ [6640204] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:29:25 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640204/ [6640205] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:08:07 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640205/ [6640206] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}} time: 00:19:24 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640206/ [6640207] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2022-01-25_20:03:52-rgw-wip-yuri10-testing-2022-01-24-0810-octopus-distro-default-smithi/6640207/