2022-03-22T17:22:10.343 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-22T17:22:10.345 INFO:teuthology.results:subset: '111/120000' 2022-03-22T17:22:10.345 INFO:teuthology.results:seed: '5700' 2022-03-22T18:08:55.347 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-22T18:08:55.362 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-23T00:44:24.822 INFO:teuthology.results:Tests finished! gathering results... 2022-03-23T00:44:31.381 INFO:scrape:Found 43 jobs 2022-03-23T00:44:31.644 WARNING:scrape:Not-understood crash indication 2022-03-22T17:49:29.605 INFO:tasks.rgw.c1.client.0.smithi148.stderr:daemon-helper: command crashed with signal 11 2022-03-23T00:44:31.645 WARNING:scrape:Not-understood crash indication 2022-03-23T00:44:31.947 INFO:scrape:Found 3 distinct failure reasons 2022-03-23T00:44:31.948 INFO:scrape:Dead: b'2022-03-23T00:06:07.257 DEBUG:teuthology.exit:Finished running handlers' 2022-03-23T00:44:31.948 INFO:scrape:4 jobs: ['6753514', '6753547', '6753536', '6753526'] 2022-03-23T00:44:31.949 INFO:scrape:suites intersection: ['ignore-pg-availability', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2022-03-23T00:44:31.949 INFO:scrape:suites union: ['frontend/beast', 'frontend/civetweb', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'tasks/test_multi', 'valgrind}'] 2022-03-23T00:44:31.950 INFO:scrape: 2022-03-23T00:44:31.950 INFO:scrape:Failure: Command failed on smithi059 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2022-03-23T00:44:31.951 INFO:scrape:1 jobs: ['6753524'] 2022-03-23T00:44:31.951 INFO:scrape:suites: ['frontend/civetweb', 'ignore-pg-availability', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 'tasks/rgw_ragweed}'] 2022-03-23T00:44:31.952 INFO:scrape: 2022-03-23T00:44:31.952 INFO:scrape:Failure: Cannot create secret 2022-03-23T00:44:31.952 INFO:scrape:1 jobs: ['6753511'] 2022-03-23T00:44:31.953 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability}', 'rgw/crypt/{0-cluster/fixed-1'] 2022-03-23T00:44:31.953 INFO:scrape: 2022-03-23T00:44:31.955 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/ failed: 2 dead: 4 running: 0 waiting: 0 queued: 0 passed: 37 Fail ================================================================= [6753511] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} ----------------------------------------------------------------- time: 00:15:07 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753511/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753511/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3638f77ae9df49a89a0f590fd4ddc1d6 Cannot create secret [6753524] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} ----------------------------------------------------------------- time: 00:06:43 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753524/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753524/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01ccc3e8bf2747d3ac103d1b16280e21 Command failed on smithi059 with status 2: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Dead ================================================================= [6753514] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753514/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753514/ hit max job timeout [6753526] rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753526/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753526/ hit max job timeout [6753536] rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753536/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753536/ hit max job timeout [6753547] rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753547/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753547/ hit max job timeout Pass ================================================================= [6753512] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/default overrides s3a-hadoop} time: 00:15:07 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753512/ [6753513] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile tasks/rgw_multipart_upload} time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753513/ [6753515] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{rhel_8}} time: 00:18:39 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753515/ [6753516] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast supported-random-distro$/{centos_8} tasks/{0-install ststests webidentity}} time: 00:28:20 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753516/ [6753517] rgw/tempest/{clusters/fixed-1 frontend/beast overrides tasks/rgw_tempest ubuntu_latest} time: 00:20:58 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753517/ [6753518] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:12:18 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753518/ [6753519] rgw/tools/{centos_latest cluster tasks} time: 02:43:58 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753519/ [6753520] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:26:00 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753520/ [6753521] rgw/website/{clusters/fixed-2 frontend/beast http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:00 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753521/ [6753522] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:13:32 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753522/ [6753523] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/kmip 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} time: 00:11:29 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753523/ [6753525] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec supported-random-distro$/{rhel_8}} time: 00:19:18 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753525/ [6753527] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:15:51 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753527/ [6753528] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 00:30:47 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753528/ [6753529] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/testing 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} time: 00:10:28 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753529/ [6753530] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated tasks/rgw_s3tests} time: 00:11:43 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753530/ [6753531] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_8}} time: 00:11:57 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753531/ [6753532] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:20 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753532/ [6753533] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753533/ [6753534] rgw/hadoop-s3a/{clusters/fixed-2 hadoop/v32 overrides s3a-hadoop} time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753534/ [6753535] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile tasks/rgw_user_quota} time: 00:07:58 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753535/ [6753537] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_8}} time: 00:11:31 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753537/ [6753538] rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/civetweb supported-random-distro$/{rhel_8} tasks/{0-install ststests webidentity}} time: 00:35:58 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753538/ [6753539] rgw/tempest/{clusters/fixed-1 frontend/civetweb overrides tasks/rgw_tempest ubuntu_latest} time: 00:21:00 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753539/ [6753540] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_bucket_quota} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753540/ [6753541] rgw/verify/{centos_latest clusters/fixed-2 frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/lockdep} time: 00:27:04 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753541/ [6753542] rgw/website/{clusters/fixed-2 frontend/civetweb http overrides tasks/s3tests-website ubuntu_latest} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753542/ [6753543] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_multipart_upload} time: 00:11:55 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753543/ [6753544] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_old 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753544/ [6753545] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec tasks/rgw_bucket_quota} time: 00:09:38 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753545/ [6753546] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753546/ [6753548] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/filestore-xfs thrasher/default thrashosds-health workload/rgw_s3tests} time: 00:14:18 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753548/ [6753549] rgw/verify/{centos_latest clusters/fixed-2 frontend/civetweb ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{default} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} time: 00:32:19 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753549/ [6753550] rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability} time: 00:10:53 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753550/ [6753551] rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/replicated tasks/rgw_multipart_upload} time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753551/ [6753552] rgw/singleton/{all/radosgw-admin frontend/civetweb objectstore/filestore-xfs overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753552/ [6753553] rgw/thrash/{civetweb clusters/fixed-2 install objectstore/bluestore-bitmap thrasher/default thrashosds-health workload/rgw_user_quota} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2022-03-22_17:19:38-rgw-wip-yuri3-testing-2022-03-22-0721-pacific-distro-default-smithi/6753553/