Found 37 jobs Not-understood crash indication 2021-06-15T16:56:43.033 INFO:tasks.rgw.client.1.smithi164.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-06-15T16:56:43.033 INFO:tasks.rgw.client.1.smithi164.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-06-15T16:56:43.033 INFO:tasks.rgw.client.1.smithi164.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Found 7 distinct failure reasons Failure: rgw multisite test failures 1 jobs: ['6173942'] suites: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/multisite/{clusters', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}'] Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=79eb0c853ca1ee491410e0c6c6796675a7449ef9 2 jobs: ['6173961', '6173940'] suites intersection: ['overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] suites union: ['hadoop/default', 'hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] Failure: Command failed (s3 tests against rgw) on smithi046 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!test_of_sts,!webidentity_test,!fails_with_subdomain'" 4 jobs: ['6173960', '6173968', '6173950', '6173973'] suites intersection: [] suites union: ['1-ceph-install/install', '2-kms/vault_kv', '2-kms/vault_old', '2-kms/vault_transit', '3-rgw/rgw', '4-tests/{s3tests}', 'frontend/beast', 'http', 'ignore-pg-availability', 'overrides', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/website/{clusters/fixed-2', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'tasks/s3tests-website', 'ubuntu_latest}'] Failure: Command failed on smithi050 with status 1: "cd /home/ubuntu/cephtest/tempest && source .tox/venv/bin/activate && tempest run --workspace-path /home/ubuntu/cephtest/tempest/workspace.yaml --workspace rgw --regex '^tempest.api.object_storage' --black-regex '.*test_account_quotas_negative.AccountQuotasNegativeTest.test_user_modify_quota|.*test_container_acl_negative.ObjectACLsNegativeTest.*|.*test_container_services_negative.ContainerNegativeTest.test_create_container_metadata_.*|.*test_container_staticweb.StaticWebTest.test_web_index|.*test_container_staticweb.StaticWebTest.test_web_listing_css|.*test_container_synchronization.*|.*test_object_services.PublicObjectTest.test_access_public_container_object_without_using_creds'" 1 jobs: ['6173946'] suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] Failure: too many values to unpack (expected 1) 2 jobs: ['6173954', '6173970'] suites intersection: ['frontend/beast', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/rgw_cephadm', 'supported-random-distro$/{ubuntu_latest}}'] suites union: ['frontend/beast', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/rgw_cephadm', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'supported-random-distro$/{ubuntu_latest}}'] Crash: "2021-06-15T16:55:07.757914+0000 mon.a (mon.0) 293 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log ceph version 17.0.0-5278-g79eb0c85 (79eb0c853ca1ee491410e0c6c6796675a7449ef9) quincy (dev) 1: /lib64/libpthread.so.0(+0x12b20) [0x7f7920251b20] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a0) [0x7f7920bc1c4a] 5: /usr/lib64/ceph/libceph-common.so.2(+0x27ce04) [0x7f7920bc1e04] 6: (std::__detail::__variant::__gen_vtable_impl > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::tuple const&>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f33b82ea71] 7: radosgw-admin(+0x6e96e7) [0x55f33b8276e7] 8: (RGWBucketReshard::execute(int, FaultInjector > > const&, int, DoutPrefixProvider const*, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xd6) [0x55f33b82b1f6] 9: main() 10: __libc_start_main() 11: _start() 1 jobs: ['6173949'] suites: ['cls', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{centos_latest', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{0-install', 'validater/lockdep}'] Dead: b"2021-06-16T00:01:52.255 INFO:tasks.ceph.mon.a.smithi042.stdout: serial 'INTEL SSDPED1D480GA_PHMB75130021480DGN'" 1 jobs: ['6173952'] suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 'supported-random-distro$/{centos_8}}']