2023-12-08T17:12:30.096 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T17:12:30.096 INFO:teuthology.results:seed: '2184' 2023-12-08T18:06:12.238 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T18:06:12.269 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-12-08T20:12:22.792 INFO:teuthology.results:Tests finished! gathering results... 2023-12-08T20:12:31.444 INFO:scrape:Found 72 jobs 2023-12-08T20:12:33.471 WARNING:scrape:Not-understood crash indication 2023-12-08T17:55:53.697 INFO:tasks.rgw.client.0.smithi045.stderr:daemon-helper: command crashed with signal 6 2023-12-08T20:12:33.472 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:33.533 WARNING:scrape:Not-understood crash indication 2023-12-08T17:55:53.697 INFO:tasks.rgw.client.0.smithi045.stderr:daemon-helper: command crashed with signal 6 2023-12-08T20:12:33.534 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:33.599 WARNING:scrape:Not-understood crash indication 2023-12-08T17:55:53.697 INFO:tasks.rgw.client.0.smithi045.stderr:daemon-helper: command crashed with signal 6 2023-12-08T20:12:33.600 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:33.663 WARNING:scrape:Not-understood crash indication 2023-12-08T17:55:53.697 INFO:tasks.rgw.client.0.smithi045.stderr:daemon-helper: command crashed with signal 6 2023-12-08T20:12:33.663 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:33.725 WARNING:scrape:Not-understood crash indication 2023-12-08T17:55:53.697 INFO:tasks.rgw.client.0.smithi045.stderr:daemon-helper: command crashed with signal 6 2023-12-08T20:12:33.726 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:33.906 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:15.454 INFO:tasks.rgw.c1.client.1.smithi172.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.906 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:30.300 INFO:tasks.rgw.c2.client.0.smithi183.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.906 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.284 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi172.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.907 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.294 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi183.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.907 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:33.940 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:15.454 INFO:tasks.rgw.c1.client.1.smithi172.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.941 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:30.300 INFO:tasks.rgw.c2.client.0.smithi183.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.941 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.284 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi172.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.941 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.294 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi183.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.941 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:33.971 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:15.454 INFO:tasks.rgw.c1.client.1.smithi172.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.971 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:30.300 INFO:tasks.rgw.c2.client.0.smithi183.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.972 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.284 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi172.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.972 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.294 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi183.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:33.972 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:34.005 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:15.454 INFO:tasks.rgw.c1.client.1.smithi172.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.005 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:30.300 INFO:tasks.rgw.c2.client.0.smithi183.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.005 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.284 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi172.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.006 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.294 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi183.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.006 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:34.040 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:15.454 INFO:tasks.rgw.c1.client.1.smithi172.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.040 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:30.300 INFO:tasks.rgw.c2.client.0.smithi183.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.040 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.284 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi172.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.040 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.294 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi183.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.040 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:34.073 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:15.454 INFO:tasks.rgw.c1.client.1.smithi172.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.074 WARNING:scrape:Not-understood crash indication 2023-12-08T17:40:30.300 INFO:tasks.rgw.c2.client.0.smithi183.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.074 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.284 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi172.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.074 WARNING:scrape:Not-understood crash indication 2023-12-08T19:19:43.294 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi183.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.074 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:34.744 WARNING:scrape:Not-understood crash indication 2023-12-08T18:10:36.735 INFO:tasks.rgw.c1.client.0.smithi043.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.745 WARNING:scrape:Not-understood crash indication 2023-12-08T18:10:36.767 INFO:tasks.rgw.c1.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.745 WARNING:scrape:Not-understood crash indication 2023-12-08T19:37:17.831 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi043.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.745 WARNING:scrape:Not-understood crash indication 2023-12-08T19:37:17.831 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi043.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:34.745 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:35.019 WARNING:scrape:Not-understood crash indication 2023-12-08T18:10:36.735 INFO:tasks.rgw.c1.client.0.smithi043.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.020 WARNING:scrape:Not-understood crash indication 2023-12-08T18:10:36.767 INFO:tasks.rgw.c1.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.020 WARNING:scrape:Not-understood crash indication 2023-12-08T19:37:17.831 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi043.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.020 WARNING:scrape:Not-understood crash indication 2023-12-08T19:37:17.831 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi043.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.020 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:35.300 WARNING:scrape:Not-understood crash indication 2023-12-08T18:10:36.735 INFO:tasks.rgw.c1.client.0.smithi043.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.301 WARNING:scrape:Not-understood crash indication 2023-12-08T18:10:36.767 INFO:tasks.rgw.c1.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.301 WARNING:scrape:Not-understood crash indication 2023-12-08T19:37:17.831 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi043.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.302 WARNING:scrape:Not-understood crash indication 2023-12-08T19:37:17.831 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi043.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.302 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:35.579 WARNING:scrape:Not-understood crash indication 2023-12-08T18:10:36.735 INFO:tasks.rgw.c1.client.0.smithi043.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.579 WARNING:scrape:Not-understood crash indication 2023-12-08T18:10:36.767 INFO:tasks.rgw.c1.client.1.smithi043.stderr:daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.579 WARNING:scrape:Not-understood crash indication 2023-12-08T19:37:17.831 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi043.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.579 WARNING:scrape:Not-understood crash indication 2023-12-08T19:37:17.831 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi043.stderr: INFO: daemon-helper: command crashed with signal 11 2023-12-08T20:12:35.580 WARNING:scrape:Not-understood crash indication 2023-12-08T20:12:35.580 INFO:scrape:Found 4 distinct failure reasons 2023-12-08T20:12:35.580 INFO:scrape:Failure: Command failed on smithi080 with status 100: 'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install python-dev' 2023-12-08T20:12:35.580 INFO:scrape:1 jobs: ['7482927'] 2023-12-08T20:12:35.581 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'ubuntu_latest}'] 2023-12-08T20:12:35.581 INFO:scrape: 2023-12-08T20:12:35.581 INFO:scrape:Failure: 2023-12-08T20:12:35.581 INFO:scrape:3 jobs: ['7482914', '7482959', '7482938'] 2023-12-08T20:12:35.581 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'supported-random-distro$/{ubuntu_latest}}'] 2023-12-08T20:12:35.581 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/singleton/{all/radosgw-admin', 'rgw_pool_type/ec', 'rgw_pool_type/ec-profile', 'rgw_pool_type/replicated', 'supported-random-distro$/{ubuntu_latest}}'] 2023-12-08T20:12:35.581 INFO:scrape: 2023-12-08T20:12:35.581 INFO:scrape:Failure: Command failed (bucket notification tests against different endpoints) on smithi045 with status 1: 'BNTESTS_CONF=/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/bn-tests.client.0.conf /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/bin/python -m nose -s /home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py -v -a kafka_test' 2023-12-08T20:12:35.582 INFO:scrape:1 jobs: ['7482912'] 2023-12-08T20:12:35.582 INFO:scrape:suites: ['bluestore-bitmap', 'centos_latest', 'fixed-2', 'ignore-pg-availability', 'overrides', 'rgw/notifications/{beast', 'tasks/{0-install', 'test_amqp', 'test_kafka', 'test_others}}'] 2023-12-08T20:12:35.582 INFO:scrape: 2023-12-08T20:12:35.582 INFO:scrape:Failure: rgw multisite test failures 2023-12-08T20:12:35.582 INFO:scrape:2 jobs: ['7482911', '7482947'] 2023-12-08T20:12:35.582 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_latest}', 'tasks/test_multi}'] 2023-12-08T20:12:35.582 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_latest}', 'tasks/test_multi}'] 2023-12-08T20:12:35.583 INFO:scrape: