2022-06-21T16:32:45.412 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0 2022-06-21T16:32:45.414 INFO:teuthology.results:subset: '111/120000' 2022-06-21T16:32:45.414 INFO:teuthology.results:seed: '2144' 2022-06-21T17:17:57.365 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0 2022-06-21T17:17:57.403 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-21T19:52:11.023 INFO:teuthology.results:Tests finished! gathering results... 2022-06-21T19:52:15.865 INFO:scrape:Found 39 jobs 2022-06-21T19:52:16.306 WARNING:scrape:Not-understood crash indication 2022-06-21T17:40:57.925 INFO:tasks.rgw.c2.client.0.smithi158.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.307 WARNING:scrape:Not-understood crash indication 2022-06-21T17:40:57.947 INFO:tasks.rgw.c1.client.1.smithi087.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.308 WARNING:scrape:Not-understood crash indication 2022-06-21T19:52:16.352 WARNING:scrape:Not-understood crash indication 2022-06-21T17:40:57.925 INFO:tasks.rgw.c2.client.0.smithi158.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.353 WARNING:scrape:Not-understood crash indication 2022-06-21T17:40:57.947 INFO:tasks.rgw.c1.client.1.smithi087.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.354 WARNING:scrape:Not-understood crash indication 2022-06-21T19:52:16.394 WARNING:scrape:Not-understood crash indication 2022-06-21T17:40:57.925 INFO:tasks.rgw.c2.client.0.smithi158.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.395 WARNING:scrape:Not-understood crash indication 2022-06-21T17:40:57.947 INFO:tasks.rgw.c1.client.1.smithi087.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.396 WARNING:scrape:Not-understood crash indication 2022-06-21T19:52:16.437 WARNING:scrape:Not-understood crash indication 2022-06-21T17:40:57.925 INFO:tasks.rgw.c2.client.0.smithi158.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.439 WARNING:scrape:Not-understood crash indication 2022-06-21T17:40:57.947 INFO:tasks.rgw.c1.client.1.smithi087.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.440 WARNING:scrape:Not-understood crash indication 2022-06-21T19:52:16.667 WARNING:scrape:Not-understood crash indication 2022-06-21T17:10:45.030 INFO:tasks.rgw.c2.client.0.smithi111.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.668 WARNING:scrape:Not-understood crash indication 2022-06-21T17:10:45.068 INFO:tasks.rgw.c1.client.1.smithi022.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.669 WARNING:scrape:Not-understood crash indication 2022-06-21T19:52:16.732 WARNING:scrape:Not-understood crash indication 2022-06-21T17:10:45.030 INFO:tasks.rgw.c2.client.0.smithi111.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.733 WARNING:scrape:Not-understood crash indication 2022-06-21T17:10:45.068 INFO:tasks.rgw.c1.client.1.smithi022.stderr:daemon-helper: command crashed with signal 11 2022-06-21T19:52:16.734 WARNING:scrape:Not-understood crash indication 2022-06-21T19:52:16.735 INFO:scrape:Found 2 distinct failure reasons 2022-06-21T19:52:16.736 INFO:scrape:Failure: Cannot create secret 2022-06-21T19:52:16.736 INFO:scrape:1 jobs: ['6889496'] 2022-06-21T19:52:16.737 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}}', 'rgw/crypt/{0-cluster/fixed-1'] 2022-06-21T19:52:16.737 INFO:scrape: 2022-06-21T19:52:16.739 INFO:scrape:Failure: rgw multisite pubsub, test failures 2022-06-21T19:52:16.739 INFO:scrape:2 jobs: ['6889542', '6889502'] 2022-06-21T19:52:16.740 INFO:scrape:suites intersection: ['omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2022-06-21T19:52:16.740 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2022-06-21T19:52:16.742 INFO:scrape: 2022-06-21T19:52:16.743 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 36 Fail ================================================================= [6889496] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests}} ----------------------------------------------------------------- time: 00:16:33 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889496/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889496/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91bd9c7e5e184d5eadae5a752441df08 Cannot create secret [6889502] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 03:11:32 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889502/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9b53c863293483fa12192c0312b433c rgw multisite pubsub, test failures [6889542] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 02:19:14 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889542/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889542/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c4043c586764fe09ec0c9dd0368f0e5 rgw multisite pubsub, test failures Pass ================================================================= [6889498] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:17:45 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889498/ [6889500] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:09:42 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889500/ [6889504] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} time: 00:09:50 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889504/ [6889506] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} time: 00:21:47 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889506/ [6889508] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:12:28 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889508/ [6889510] rgw/tools/{centos_latest cluster tasks} time: 02:42:07 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889510/ [6889512] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:21:33 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889512/ [6889514] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:13:49 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889514/ [6889516] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:10:27 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889516/ [6889518] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} time: 00:06:57 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889518/ [6889520] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889520/ [6889522] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests}} time: 00:09:59 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889522/ [6889524] rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:20:09 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889524/ [6889526] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:14:54 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889526/ [6889528] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:25:51 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889528/ [6889530] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889530/ [6889532] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889532/ [6889534] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:39 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889534/ [6889536] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests}} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889536/ [6889538] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889538/ [6889540] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:07:08 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889540/ [6889544] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:23:15 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889544/ [6889546] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:20:36 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889546/ [6889548] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889548/ [6889550] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/lockdep} time: 00:21:50 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889550/ [6889552] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889552/ [6889554] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:11:09 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889554/ [6889556] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889556/ [6889558] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:08:56 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889558/ [6889560] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests}} time: 00:09:46 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889560/ [6889562] rgw/multisite/{clusters frontend/beast omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} time: 00:18:51 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889562/ [6889564] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889564/ [6889566] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed s3tests-java s3tests} validater/valgrind} time: 00:25:33 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889566/ [6889568] rgw/multifs/{clusters/fixed-2 frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889568/ [6889570] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{rhel_8}} time: 00:22:07 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889570/ [6889572] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:59 info: http://pulpito.ceph.com/yuriw-2022-06-21_16:31:09-rgw-wip-yuri-testing-2022-06-21-0703-octopus-distro-default-smithi/6889572/