2022-05-14T07:17:26.505 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-14T07:17:26.506 INFO:teuthology.results:subset: '111/120000' 2022-05-14T07:17:26.507 INFO:teuthology.results:seed: '5339' 2022-05-14T07:39:24.963 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-14T07:39:24.996 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-05-14T10:51:41.153 INFO:teuthology.results:Tests finished! gathering results... 2022-05-14T10:51:43.904 INFO:scrape:Found 39 jobs 2022-05-14T10:51:44.161 WARNING:scrape:Not-understood crash indication 2022-05-14T07:58:21.541 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-05-14T10:51:44.162 WARNING:scrape:Not-understood crash indication 2022-05-14T07:58:21.631 INFO:tasks.rgw.c1.client.1.smithi101.stderr:daemon-helper: command crashed with signal 11 2022-05-14T10:51:44.162 WARNING:scrape:Not-understood crash indication 2022-05-14T10:51:44.198 WARNING:scrape:Not-understood crash indication 2022-05-14T07:58:21.541 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-05-14T10:51:44.199 WARNING:scrape:Not-understood crash indication 2022-05-14T07:58:21.631 INFO:tasks.rgw.c1.client.1.smithi101.stderr:daemon-helper: command crashed with signal 11 2022-05-14T10:51:44.200 WARNING:scrape:Not-understood crash indication 2022-05-14T10:51:44.228 WARNING:scrape:Not-understood crash indication 2022-05-14T07:58:21.541 INFO:tasks.rgw.c2.client.0.smithi121.stderr:daemon-helper: command crashed with signal 11 2022-05-14T10:51:44.229 WARNING:scrape:Not-understood crash indication 2022-05-14T07:58:21.631 INFO:tasks.rgw.c1.client.1.smithi101.stderr:daemon-helper: command crashed with signal 11 2022-05-14T10:51:44.230 WARNING:scrape:Not-understood crash indication 2022-05-14T10:51:44.614 WARNING:scrape:Not-understood crash indication 2022-05-14T08:10:16.628 INFO:tasks.rgw.c1.client.1.smithi092.stderr:daemon-helper: command crashed with signal 11 2022-05-14T10:51:44.615 WARNING:scrape:Not-understood crash indication 2022-05-14T08:10:16.665 INFO:tasks.rgw.c2.client.0.smithi154.stderr:daemon-helper: command crashed with signal 11 2022-05-14T10:51:44.615 WARNING:scrape:Not-understood crash indication 2022-05-14T10:51:44.845 INFO:scrape:Found 2 distinct failure reasons 2022-05-14T10:51:44.846 INFO:scrape:Failure: rgw multisite pubsub, test failures 2022-05-14T10:51:44.847 INFO:scrape:3 jobs: ['6832495', '6832515', '6832525'] 2022-05-14T10:51:44.847 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2022-05-14T10:51:44.848 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2022-05-14T10:51:44.848 INFO:scrape: 2022-05-14T10:51:44.849 INFO:scrape:Failure: Cannot create secret 2022-05-14T10:51:44.849 INFO:scrape:1 jobs: ['6832492'] 2022-05-14T10:51:44.849 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2022-05-14T10:51:44.850 INFO:scrape: 2022-05-14T10:51:44.852 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 35 Fail ================================================================= [6832492] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832492/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832492/ sentry: https://sentry.ceph.com/organizations/ceph/?query=74b9c026d9e4490997861530634f82bb Cannot create secret [6832495] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 03:11:40 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832495/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832495/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa36b80b04584f1384ee2e096926bde4 rgw multisite pubsub, test failures [6832515] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 03:11:59 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832515/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832515/ sentry: https://sentry.ceph.com/organizations/ceph/?query=10a8b470b9b24033b747791eca5ffb0c rgw multisite pubsub, test failures [6832525] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:20:34 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832525/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed9f0d9dee974e82b88de84791ac9a16 rgw multisite, test failures Pass ================================================================= [6832493] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832493/ [6832494] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832494/ [6832496] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} time: 00:10:33 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832496/ [6832497] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} time: 00:21:56 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832497/ [6832498] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832498/ [6832499] rgw/tools/{centos_latest cluster tasks} time: 02:44:16 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832499/ [6832500] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:24:59 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832500/ [6832501] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:12 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832501/ [6832502] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832502/ [6832503] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} time: 00:08:37 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832503/ [6832504] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_18.04}} time: 00:10:13 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832504/ [6832505] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:56 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832505/ [6832506] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:21:46 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832506/ [6832507] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832507/ [6832508] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:27:55 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832508/ [6832509] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832509/ [6832510] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:10:30 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832510/ [6832511] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:12:06 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832511/ [6832512] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:34 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832512/ [6832513] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:13:22 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832513/ [6832514] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:08:36 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832514/ [6832516] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:21:47 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832516/ [6832517] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:21:40 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832517/ [6832518] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832518/ [6832519] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:23:41 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832519/ [6832520] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:52 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832520/ [6832521] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:12:17 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832521/ [6832522] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:10:03 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832522/ [6832523] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:10:32 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832523/ [6832524] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:11:34 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832524/ [6832526] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:15:43 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832526/ [6832527] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:28:34 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832527/ [6832528] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832528/ [6832529] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} time: 00:12:11 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832529/ [6832530] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:12:42 info: http://pulpito.ceph.com/yuriw-2022-05-13_14:13:05-rgw-wip-yuri3-testing-2022-05-12-1609-octopus-distro-default-smithi/6832530/