2023-08-03T15:39:27.745 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5 2023-08-03T15:39:27.746 INFO:teuthology.results:subset: '1/99999' 2023-08-03T15:39:27.747 INFO:teuthology.results:seed: '1460' 2023-08-03T17:56:47.268 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5 2023-08-03T17:56:47.286 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-08-03T19:58:55.806 INFO:teuthology.results:Tests finished! gathering results... 2023-08-03T19:58:58.596 INFO:scrape:Found 42 jobs 2023-08-03T19:58:59.845 WARNING:scrape:Not-understood crash indication 2023-08-03T16:44:32.273 INFO:tasks.rgw.c2.client.0.smithi161.stderr:daemon-helper: command crashed with signal 11 2023-08-03T19:58:59.846 WARNING:scrape:Not-understood crash indication 2023-08-03T18:07:24.319 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi161.stderr: INFO: daemon-helper: command crashed with signal 11 2023-08-03T19:58:59.847 WARNING:scrape:Not-understood crash indication 2023-08-03T19:59:00.149 WARNING:scrape:Not-understood crash indication 2023-08-03T16:44:32.273 INFO:tasks.rgw.c2.client.0.smithi161.stderr:daemon-helper: command crashed with signal 11 2023-08-03T19:59:00.150 WARNING:scrape:Not-understood crash indication 2023-08-03T18:07:24.319 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi161.stderr: INFO: daemon-helper: command crashed with signal 11 2023-08-03T19:59:00.151 WARNING:scrape:Not-understood crash indication 2023-08-03T19:59:00.446 WARNING:scrape:Not-understood crash indication 2023-08-03T16:44:32.273 INFO:tasks.rgw.c2.client.0.smithi161.stderr:daemon-helper: command crashed with signal 11 2023-08-03T19:59:00.447 WARNING:scrape:Not-understood crash indication 2023-08-03T18:07:24.319 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi161.stderr: INFO: daemon-helper: command crashed with signal 11 2023-08-03T19:59:00.447 WARNING:scrape:Not-understood crash indication 2023-08-03T19:59:00.733 WARNING:scrape:Not-understood crash indication 2023-08-03T16:44:32.273 INFO:tasks.rgw.c2.client.0.smithi161.stderr:daemon-helper: command crashed with signal 11 2023-08-03T19:59:00.734 WARNING:scrape:Not-understood crash indication 2023-08-03T18:07:24.319 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi161.stderr: INFO: daemon-helper: command crashed with signal 11 2023-08-03T19:59:00.734 WARNING:scrape:Not-understood crash indication 2023-08-03T19:59:01.043 WARNING:scrape:Not-understood crash indication 2023-08-03T16:44:32.273 INFO:tasks.rgw.c2.client.0.smithi161.stderr:daemon-helper: command crashed with signal 11 2023-08-03T19:59:01.044 WARNING:scrape:Not-understood crash indication 2023-08-03T18:07:24.319 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi161.stderr: INFO: daemon-helper: command crashed with signal 11 2023-08-03T19:59:01.044 WARNING:scrape:Not-understood crash indication 2023-08-03T19:59:02.298 WARNING:scrape:Not-understood crash indication 2023-08-03T18:57:29.480 INFO:tasks.rgw.c1.client.1.smithi078.stderr:daemon-helper: command crashed with signal 11 2023-08-03T19:59:02.299 WARNING:scrape:Not-understood crash indication 2023-08-03T19:37:40.674 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi078.stderr: INFO: daemon-helper: command crashed with signal 11 2023-08-03T19:59:02.299 WARNING:scrape:Not-understood crash indication 2023-08-03T19:59:02.602 WARNING:scrape:Not-understood crash indication 2023-08-03T18:57:29.480 INFO:tasks.rgw.c1.client.1.smithi078.stderr:daemon-helper: command crashed with signal 11 2023-08-03T19:59:02.603 WARNING:scrape:Not-understood crash indication 2023-08-03T19:37:40.674 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi078.stderr: INFO: daemon-helper: command crashed with signal 11 2023-08-03T19:59:02.603 WARNING:scrape:Not-understood crash indication 2023-08-03T19:59:02.914 WARNING:scrape:Not-understood crash indication 2023-08-03T18:57:29.480 INFO:tasks.rgw.c1.client.1.smithi078.stderr:daemon-helper: command crashed with signal 11 2023-08-03T19:59:02.915 WARNING:scrape:Not-understood crash indication 2023-08-03T19:37:40.674 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi078.stderr: INFO: daemon-helper: command crashed with signal 11 2023-08-03T19:59:02.915 WARNING:scrape:Not-understood crash indication 2023-08-03T19:59:02.915 INFO:scrape:Found 5 distinct failure reasons 2023-08-03T19:59:02.916 INFO:scrape:Failure: Command failed on smithi099 with status 1: 'set -ex\nsudo dd of=/home/ubuntu/cephtest/valgrind.supp' 2023-08-03T19:59:02.916 INFO:scrape:1 jobs: ['7359452'] 2023-08-03T19:59:02.916 INFO:scrape:suites: ['clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests', 's3tests-branch', 's3tests-java', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{rhel_8}', 'tasks/{cls', 'validater/lockdep}', 'versioning}'] 2023-08-03T19:59:02.917 INFO:scrape: 2023-08-03T19:59:02.917 INFO:scrape:Failure: Command failed on smithi136 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump" 2023-08-03T19:59:02.917 INFO:scrape:1 jobs: ['7359451'] 2023-08-03T19:59:02.918 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec', 's3tests-branch', 'tasks/rgw_ragweed', 'ubuntu_latest}'] 2023-08-03T19:59:02.918 INFO:scrape: 2023-08-03T19:59:02.918 INFO:scrape:Failure: rgw multisite test failures 2023-08-03T19:59:02.918 INFO:scrape:2 jobs: ['7359459', '7359482'] 2023-08-03T19:59:02.919 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}'] 2023-08-03T19:59:02.919 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}'] 2023-08-03T19:59:02.919 INFO:scrape: 2023-08-03T19:59:02.920 INFO:scrape:Failure: 'Namespace' object has no attribute 'admin_endpoints' 2023-08-03T19:59:02.920 INFO:scrape:1 jobs: ['7359454'] 2023-08-03T19:59:02.920 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'supported-random-distro$/{rhel_8}}'] 2023-08-03T19:59:02.920 INFO:scrape: 2023-08-03T19:59:02.921 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi117 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not fails_with_subdomain and not sse_s3'" 2023-08-03T19:59:02.921 INFO:scrape:1 jobs: ['7359463'] 2023-08-03T19:59:02.921 INFO:scrape:suites: ['1-keycloak', '2-s3tests}}', 'ignore-pg-availability', 'objectstore', 'overrides', 'pool-type', 'rgw/sts/{cluster', 'rgw_frontend/beast', 's3tests-branch', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install'] 2023-08-03T19:59:02.922 INFO:scrape: