Found 131 jobs Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Not-understood crash indication 2021-12-13T16:25:08.411 INFO:tasks.rgw.c1.client.0.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication 2021-12-13T16:25:12.476 INFO:tasks.rgw.c1.client.1.smithi052.stderr:daemon-helper: command crashed with signal 11 Not-understood crash indication Found 9 distinct failure reasons Failure: Command failed on smithi033 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-9587-g8e96c707-1focal ceph-mds=17.0.0-9587-g8e96c707-1focal ceph-common=17.0.0-9587-g8e96c707-1focal ceph-fuse=17.0.0-9587-g8e96c707-1focal ceph-test=17.0.0-9587-g8e96c707-1focal radosgw=17.0.0-9587-g8e96c707-1focal python-ceph=17.0.0-9587-g8e96c707-1focal libcephfs1=17.0.0-9587-g8e96c707-1focal libcephfs-java=17.0.0-9587-g8e96c707-1focal libcephfs-jni=17.0.0-9587-g8e96c707-1focal librados2=17.0.0-9587-g8e96c707-1focal librbd1=17.0.0-9587-g8e96c707-1focal rbd-fuse=17.0.0-9587-g8e96c707-1focal' 13 jobs: ['6560488', '6560511', '6560491', '6560539', '6560532', '6560528', '6560476', '6560536', '6560529', '6560523', '6560516', '6560499', '6560513'] suites intersection: ['frontend/beast'] suites union: ['frontend/beast', 'ignore-pg-availability', 'install', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw/thrash/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'tasks/rgw_bucket_quota', 'tasks/rgw_multipart_upload', 'tasks/rgw_ragweed', 'tasks/rgw_s3tests', 'tasks/rgw_user_quota', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest', 'ubuntu_latest}', 'workload/rgw_s3tests}', 'workload/rgw_user_quota}'] Failure: No module named 'tasks.ceph' 15 jobs: ['6560481', '6560482', '6560514', '6560477', '6560495', '6560542', '6560500', '6560510', '6560478', '6560497', '6560519', '6560527', '6560503', '6560508', '6560485'] suites intersection: [] suites union: ['1-ceph-install/install', '2-kms/vault_kv', '3-rgw/rgw', '4-tests/{s3tests}', 'bluestore-bitmap', 'centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'datacache/rgw-ioc-datacache', 'fixed-2', 'frontend/beast', 'http', 'ignore-pg-availability', 'install', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'omap_limits', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'realms/three-zone-plus-pubsub', 'reshard', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multifs/{clusters/fixed-2', 'rgw/multisite/{clusters', 'rgw/notifications/{beast', 'rgw/tempest/{clusters/fixed-1', 'rgw/thrash/{clusters/fixed-2', 'rgw/verify/{0-install', 'rgw/website/{clusters/fixed-2', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'supported-all-distro$/{centos_8}', 'supported-random-distro$/{centos_8.stream}}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rgw_bucket_quota', 'tasks/rgw_multipart_upload', 'tasks/rgw_s3tests', 'tasks/rgw_tempest', 'tasks/rgw_user_quota', 'tasks/s3tests-website', 'tasks/test_multi}', 'tasks/{0-install', 'tasks/{cls', 'test_amqp', 'test_kafka', 'test_others}}', 'thrasher/default', 'thrashosds-health', 'ubuntu_latest', 'ubuntu_latest}', 'validater/lockdep}', 'workload/rgw_bucket_quota}', 'workload/rgw_multipart_upload}'] Failure: Command failed on smithi121 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse ceph-immutable-object-cache s3cmd s3cmd s3cmd s3cmd' 11 jobs: ['6560487', '6560486', '6560520', '6560525', '6560484', '6560498', '6560493', '6560506', '6560507', '6560490', '6560496'] suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls'] suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'datacache/rgw-ioc-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] Failure: Command failed on smithi180 with status 1: 'sudo yum -y install cephfs-java' 2 jobs: ['6560524', '6560504'] suites intersection: ['frontend/beast', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'supported-random-distro$/{centos_8}}'] suites union: ['frontend/beast', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/ec', 'rgw_pool_type/replicated', 'supported-random-distro$/{centos_8}}'] Failure: "2021-12-13T16:21:26.390681+0000 mon.a (mon.0) 123 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log 8 jobs: ['6560533', '6560512', '6560535', '6560583', '6560588', '6560590', '6560538', '6560568'] suites intersection: ['centos_latest', 'clusters/fixed-2', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls'] suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'datacache/rgw-datacache', 'datacache/rgw-ioc-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] Failure: reached maximum tries (90) after waiting for 540 seconds 2 jobs: ['6560597', '6560494'] suites intersection: ['centos_latest', 'clusters/fixed-2', 'datacache/rgw-ioc-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 's3tests-java', 's3tests}', 'tasks/{cls'] suites union: ['centos_latest', 'clusters/fixed-2', 'datacache/rgw-ioc-datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{default}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/lockdep}', 'validater/valgrind}'] Failure: [Errno 2] No such file or directory: '/home/teuthworker/src/github.com_ceph_ceph-c_8e96c70797d8d91ea9a66eb5085b28b6230b295a/qa/tasks/boto.cfg.template' 1 jobs: ['6560502'] suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 'supported-random-distro$/{ubuntu_latest}}'] Failure: Command failed (s3 tests against rgw) on smithi105 with status 1: 'S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a test_of_sts' 1 jobs: ['6560480'] suites: ['first', 'ignore-pg-availability', 'objectstore', 'overrides', 'pool-type', 'rgw/sts/{cluster', 'rgw_frontend/beast', 'ststests}}', 'supported-random-distro$/{rhel_8}', 'tasks/{0-install'] Failure: rgw multisite test failures 1 jobs: ['6560545'] suites: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_latest}', 'tasks/test_multi}']