2023-08-04T12:01:58.380 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5
2023-08-04T12:01:58.382 INFO:teuthology.results:subset: '1/2'
2023-08-04T12:01:58.382 INFO:teuthology.results:seed: '4579'
2023-08-04T13:49:56.796 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5
2023-08-04T13:49:56.817 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-08-04T17:18:11.546 INFO:teuthology.results:Tests finished! gathering results...
2023-08-04T17:18:15.241 INFO:scrape:Found 50 jobs
2023-08-04T17:18:15.489 WARNING:scrape:Not-understood crash indication 2023-08-04T13:29:34.833 INFO:tasks.rgw.c1.client.0.smithi005.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:15.490 WARNING:scrape:Not-understood crash indication 2023-08-04T13:29:41.219 INFO:tasks.rgw.c1.client.1.smithi005.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:15.490 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:15.541 WARNING:scrape:Not-understood crash indication 2023-08-04T13:29:34.833 INFO:tasks.rgw.c1.client.0.smithi005.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:15.542 WARNING:scrape:Not-understood crash indication 2023-08-04T13:29:41.219 INFO:tasks.rgw.c1.client.1.smithi005.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:15.542 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:15.591 WARNING:scrape:Not-understood crash indication 2023-08-04T13:29:34.833 INFO:tasks.rgw.c1.client.0.smithi005.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:15.592 WARNING:scrape:Not-understood crash indication 2023-08-04T13:29:41.219 INFO:tasks.rgw.c1.client.1.smithi005.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:15.592 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:15.950 WARNING:scrape:Not-understood crash indication 2023-08-04T12:22:41.342 INFO:tasks.rgw.client.0.smithi078.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:15.952 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:16.026 WARNING:scrape:Not-understood crash indication 2023-08-04T12:22:41.342 INFO:tasks.rgw.client.0.smithi078.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:16.027 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:16.100 WARNING:scrape:Not-understood crash indication 2023-08-04T12:22:41.342 INFO:tasks.rgw.client.0.smithi078.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:16.101 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:16.173 WARNING:scrape:Not-understood crash indication 2023-08-04T12:22:41.342 INFO:tasks.rgw.client.0.smithi078.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:16.174 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:16.248 WARNING:scrape:Not-understood crash indication 2023-08-04T12:22:41.342 INFO:tasks.rgw.client.0.smithi078.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:16.249 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:16.980 WARNING:scrape:Not-understood crash indication 2023-08-04T12:29:38.226 INFO:tasks.rgw.client.0.smithi181.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:16.980 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:18.808 WARNING:scrape:Not-understood crash indication 2023-08-04T12:31:30.546 INFO:tasks.rgw.c1.client.0.smithi064.stderr:daemon-helper: command crashed with signal 11
2023-08-04T17:18:18.809 WARNING:scrape:Not-understood crash indication 
2023-08-04T17:18:18.873 INFO:scrape:Found 6 distinct failure reasons
2023-08-04T17:18:18.874 INFO:scrape:Failure: 
2023-08-04T17:18:18.875 INFO:scrape:4 jobs: ['7360292', '7360261', '7360262', '7360265']
2023-08-04T17:18:18.875 INFO:scrape:suites intersection: ['overrides']
2023-08-04T17:18:18.875 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/d4n/{cluster', 'rgw/dbstore/{cluster', 'rgw/multisite/{clusters', 's3tests-branch', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{ubuntu_20.04}', 'tasks/rgw_d4ntests}', 'tasks/rgw_s3tests}', 'tasks/test_multi}']
2023-08-04T17:18:18.876 INFO:scrape:
2023-08-04T17:18:18.876 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific
2023-08-04T17:18:18.876 INFO:scrape:2 jobs: ['7360273', '7360303']
2023-08-04T17:18:18.876 INFO:scrape:suites intersection: ['2-setup', 'cluster', 'frontend/beast', 'install', 'objectstore/bluestore-bitmap', 'overrides}', 'rgw/upgrade/{1-install/pacific/{distro$/{centos_latest}']
2023-08-04T17:18:18.877 INFO:scrape:suites union: ['2-setup', '3-upgrade-sequence/osds-then-rgws', '3-upgrade-sequence/rgws-then-osds', 'cluster', 'frontend/beast', 'install', 'objectstore/bluestore-bitmap', 'overrides}', 'rgw/upgrade/{1-install/pacific/{distro$/{centos_latest}']
2023-08-04T17:18:18.877 INFO:scrape:
2023-08-04T17:18:18.877 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi078 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3 and cloud_transition'"
2023-08-04T17:18:18.878 INFO:scrape:2 jobs: ['7360259', '7360269']
2023-08-04T17:18:18.878 INFO:scrape:suites intersection: ['overrides', 's3tests-branch']
2023-08-04T17:18:18.878 INFO:scrape:suites union: ['1-keycloak', '2-s3tests}}', 'ignore-pg-availability', 'objectstore', 'overrides', 'pool-type', 'rgw/cloud-transition/{cluster', 'rgw/sts/{cluster', 'rgw_frontend/beast', 's3tests-branch', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'tasks/cloud_transition_s3tests}', 'tasks/{0-install']
2023-08-04T17:18:18.879 INFO:scrape:
2023-08-04T17:18:18.879 INFO:scrape:Failure: 'Namespace' object has no attribute 'admin_endpoints'
2023-08-04T17:18:18.879 INFO:scrape:1 jobs: ['7360260']
2023-08-04T17:18:18.879 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/barbican', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'supported-random-distro$/{centos_8}}']
2023-08-04T17:18:18.880 INFO:scrape:
2023-08-04T17:18:18.880 INFO:scrape:Failure: Command failed (bucket notification tests against different endpoints) on smithi007 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a amqp_test'
2023-08-04T17:18:18.880 INFO:scrape:1 jobs: ['7360266']
2023-08-04T17:18:18.881 INFO:scrape:suites: ['bluestore-bitmap', 'fixed-2', 'overrides', 'rgw/notifications/{beast', 'supported-all-distro$/{centos_8}', 'tasks/{0-install', 'test_amqp', 'test_kafka', 'test_others}}']
2023-08-04T17:18:18.881 INFO:scrape:
2023-08-04T17:18:18.881 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rgw/test_librgw_file.sh
2023-08-04T17:18:18.881 INFO:scrape:1 jobs: ['7360306']
2023-08-04T17:18:18.882 INFO:scrape:suites: ['clusters/fixed-2', 'datacache/rgw-datacache', 'frontend/beast', 'ignore-pg-availability', 'inline-data$/{on}', 'mp_reupload', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests', 's3tests-branch', 's3tests-java', 'sharding$/{single}', 'striping$/{stripe-greater-than-chunk}', 'supported-random-distro$/{centos_latest}', 'tasks/{cls', 'validater/lockdep}', 'versioning}']
2023-08-04T17:18:18.882 INFO:scrape: