2023-09-26T09:08:32.627 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-26T09:08:32.628 INFO:teuthology.results:subset: '111/120000' 2023-09-26T09:08:32.628 INFO:teuthology.results:seed: '4306' 2023-09-26T09:44:42.257 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-26T09:44:42.282 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-09-26T12:10:52.358 INFO:teuthology.results:Tests finished! gathering results... 2023-09-26T12:10:55.086 INFO:scrape:Found 42 jobs 2023-09-26T12:10:56.029 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.029 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.029 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.030 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.039 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.039 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.040 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.040 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.423 WARNING:scrape:Not-understood crash indication 2023-09-26T10:37:19.177 INFO:tasks.rgw.c1.client.1.smithi083.stderr:daemon-helper: command crashed with signal 11 2023-09-26T12:10:56.423 WARNING:scrape:Not-understood crash indication 2023-09-26T11:17:27.119 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi083.stderr: INFO: daemon-helper: command crashed with signal 11 2023-09-26T12:10:56.423 WARNING:scrape:Not-understood crash indication 2023-09-26T12:10:56.569 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.570 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.570 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.570 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.580 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.580 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.580 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.580 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.797 WARNING:scrape:Not-understood crash indication 2023-09-26T10:37:19.177 INFO:tasks.rgw.c1.client.1.smithi083.stderr:daemon-helper: command crashed with signal 11 2023-09-26T12:10:56.798 WARNING:scrape:Not-understood crash indication 2023-09-26T11:17:27.119 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi083.stderr: INFO: daemon-helper: command crashed with signal 11 2023-09-26T12:10:56.798 WARNING:scrape:Not-understood crash indication 2023-09-26T12:10:56.940 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.940 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.941 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.941 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.950 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.950 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.950 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:56.950 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.167 WARNING:scrape:Not-understood crash indication 2023-09-26T10:37:19.177 INFO:tasks.rgw.c1.client.1.smithi083.stderr:daemon-helper: command crashed with signal 11 2023-09-26T12:10:57.168 WARNING:scrape:Not-understood crash indication 2023-09-26T11:17:27.119 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi083.stderr: INFO: daemon-helper: command crashed with signal 11 2023-09-26T12:10:57.168 WARNING:scrape:Not-understood crash indication 2023-09-26T12:10:57.300 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.300 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.301 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.301 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.310 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.310 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.311 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.311 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.522 WARNING:scrape:Not-understood crash indication 2023-09-26T10:37:19.177 INFO:tasks.rgw.c1.client.1.smithi083.stderr:daemon-helper: command crashed with signal 11 2023-09-26T12:10:57.523 WARNING:scrape:Not-understood crash indication 2023-09-26T11:17:27.119 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi083.stderr: INFO: daemon-helper: command crashed with signal 11 2023-09-26T12:10:57.523 WARNING:scrape:Not-understood crash indication 2023-09-26T12:10:57.660 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.660 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.660 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.661 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.669 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.670 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.670 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.670 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:57.888 WARNING:scrape:Not-understood crash indication 2023-09-26T10:37:19.177 INFO:tasks.rgw.c1.client.1.smithi083.stderr:daemon-helper: command crashed with signal 11 2023-09-26T12:10:57.889 WARNING:scrape:Not-understood crash indication 2023-09-26T11:17:27.119 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi083.stderr: INFO: daemon-helper: command crashed with signal 11 2023-09-26T12:10:57.889 WARNING:scrape:Not-understood crash indication 2023-09-26T12:10:58.036 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:58.036 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:58.036 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:58.036 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:58.046 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:58.046 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:58.046 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:58.046 WARNING:scrape:Saw end of BT but not start 2023-09-26T12:10:58.265 WARNING:scrape:Not-understood crash indication 2023-09-26T10:37:19.177 INFO:tasks.rgw.c1.client.1.smithi083.stderr:daemon-helper: command crashed with signal 11 2023-09-26T12:10:58.266 WARNING:scrape:Not-understood crash indication 2023-09-26T11:17:27.119 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.1.smithi083.stderr: INFO: daemon-helper: command crashed with signal 11 2023-09-26T12:10:58.266 WARNING:scrape:Not-understood crash indication 2023-09-26T12:10:59.216 INFO:scrape:Found 5 distinct failure reasons 2023-09-26T12:10:59.216 INFO:scrape:Failure: Command failed (ragweed tests against rgw) on smithi033 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw'" 2023-09-26T12:10:59.217 INFO:scrape:2 jobs: ['7402270', '7402296'] 2023-09-26T12:10:59.217 INFO:scrape:suites intersection: ['2-setup', '3-upgrade-sequence/osds-then-rgws', 'cluster', 'frontend/beast', 'ignore-pg-availability', 'install', 'objectstore/bluestore-bitmap', 'overrides}'] 2023-09-26T12:10:59.217 INFO:scrape:suites union: ['2-setup', '3-upgrade-sequence/osds-then-rgws', 'cluster', 'frontend/beast', 'ignore-pg-availability', 'install', 'objectstore/bluestore-bitmap', 'overrides}', 'rgw/upgrade/{1-install/pacific/{distro$/{ubuntu_20.04}', 'rgw/upgrade/{1-install/quincy/{distro$/{ubuntu_20.04}'] 2023-09-26T12:10:59.217 INFO:scrape: 2023-09-26T12:10:59.217 INFO:scrape:Failure: [':stderr: Running command git clone --filter=blob:none --quiet https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-nh820u5o', 'Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-nh820u5o', 'See above for output.', 'error: subprocess-exited-with-error', 'exit code: 128', "fatal: unable to access 'https://github.com/sebastian-philipp/registries-conf-ctl/': Failed to connect to github.com port 443 after 33 ms: Connection refused", 'git clone --filter=blob:none --quiet https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-nh820u5o did not run successfully.', 'note: This error originates from a subprocess, and is likely not a problem with pip.', 'stdout: Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl'] 2023-09-26T12:10:59.217 INFO:scrape:1 jobs: ['7402307'] 2023-09-26T12:10:59.217 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'objectstore/bluestore-bitmap', 'overrides', 'rgw/multifs/{clusters/fixed-2', 'rgw_pool_type/ec-profile', 's3tests-branch', 'tasks/rgw_s3tests', 'ubuntu_latest}'] 2023-09-26T12:10:59.217 INFO:scrape: 2023-09-26T12:10:59.218 INFO:scrape:Failure: Command failed on smithi191 with status 100: 'DEBIAN_FRONTEND=noninteractive sudo -E apt-get -y --force-yes install python-dev' 2023-09-26T12:10:59.218 INFO:scrape:1 jobs: ['7402300'] 2023-09-26T12:10:59.218 INFO:scrape:suites: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'ignore-pg-availability', 'rgw/crypt/{0-cluster/fixed-1', 's3tests-branch', 'ubuntu_latest}'] 2023-09-26T12:10:59.218 INFO:scrape: 2023-09-26T12:10:59.218 INFO:scrape:Failure: rgw multisite test failures 2023-09-26T12:10:59.218 INFO:scrape:2 jobs: ['7402268', '7402288'] 2023-09-26T12:10:59.218 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_20.04}', 'tasks/test_multi}'] 2023-09-26T12:10:59.218 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{ubuntu_20.04}', 'tasks/test_multi}'] 2023-09-26T12:10:59.218 INFO:scrape: 2023-09-26T12:10:59.219 INFO:scrape:Failure: Command failed on smithi112 with status 127: 'cd /home/ubuntu/cephtest/keycloak-11.0.0 && cd bin && ./jboss-cli.sh --file=adapter-elytron-install-offline.cli' 2023-09-26T12:10:59.219 INFO:scrape:1 jobs: ['7402292'] 2023-09-26T12:10:59.219 INFO:scrape:suites: ['1-keycloak', '2-s3tests}}', 'ignore-pg-availability', 'objectstore', 'overrides', 'pool-type', 'rgw/sts/{cluster', 'rgw_frontend/beast', 's3tests-branch', 'supported-random-distro$/{centos_latest}', 'tasks/{0-install'] 2023-09-26T12:10:59.219 INFO:scrape: