2021-11-11T20:30:35.389 INFO:root:teuthology version: 1.1.0-d4737010
2021-11-11T20:30:35.390 INFO:teuthology.results:subset: '1/2'
2021-11-11T20:30:35.390 INFO:teuthology.results:seed: '3897'
2021-11-11T21:09:28.823 INFO:root:teuthology version: 1.1.0-d4737010
2021-11-11T21:09:28.854 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-11-12T09:10:25.087 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2021-11-12T09:10:31.432 INFO:scrape:Found 68 jobs
2021-11-12T09:10:33.135 WARNING:scrape:Not-understood crash indication 2021-11-11T21:35:01.510 INFO:tasks.rgw.c1.client.1.smithi068.stderr:daemon-helper: command crashed with signal 11
2021-11-12T09:10:33.136 WARNING:scrape:Not-understood crash indication 
2021-11-12T09:10:33.162 WARNING:scrape:Not-understood crash indication 2021-11-11T21:35:01.510 INFO:tasks.rgw.c1.client.1.smithi068.stderr:daemon-helper: command crashed with signal 11
2021-11-12T09:10:33.163 WARNING:scrape:Not-understood crash indication 
2021-11-12T09:10:33.188 WARNING:scrape:Not-understood crash indication 2021-11-11T21:35:01.510 INFO:tasks.rgw.c1.client.1.smithi068.stderr:daemon-helper: command crashed with signal 11
2021-11-12T09:10:33.189 WARNING:scrape:Not-understood crash indication 
2021-11-12T09:10:33.214 WARNING:scrape:Not-understood crash indication 2021-11-11T21:35:01.510 INFO:tasks.rgw.c1.client.1.smithi068.stderr:daemon-helper: command crashed with signal 11
2021-11-12T09:10:33.215 WARNING:scrape:Not-understood crash indication 
2021-11-12T09:10:33.240 WARNING:scrape:Not-understood crash indication 2021-11-11T21:35:01.510 INFO:tasks.rgw.c1.client.1.smithi068.stderr:daemon-helper: command crashed with signal 11
2021-11-12T09:10:33.241 WARNING:scrape:Not-understood crash indication 
2021-11-12T09:10:33.266 WARNING:scrape:Not-understood crash indication 2021-11-11T21:35:01.510 INFO:tasks.rgw.c1.client.1.smithi068.stderr:daemon-helper: command crashed with signal 11
2021-11-12T09:10:33.267 WARNING:scrape:Not-understood crash indication 
2021-11-12T09:10:33.292 WARNING:scrape:Not-understood crash indication 2021-11-11T21:35:01.510 INFO:tasks.rgw.c1.client.1.smithi068.stderr:daemon-helper: command crashed with signal 11
2021-11-12T09:10:33.293 WARNING:scrape:Not-understood crash indication 
2021-11-12T09:10:33.512 WARNING:scrape:Not-understood crash indication 2021-11-11T21:41:29.263 INFO:tasks.rgw.c1.client.1.smithi096.stderr:daemon-helper: command crashed with signal 11
2021-11-12T09:10:33.513 WARNING:scrape:Not-understood crash indication 
2021-11-12T09:10:34.430 INFO:scrape:Found 7 distinct failure reasons
2021-11-12T09:10:34.431 INFO:scrape:Failure: Command failed on smithi093 with status 1: 'cd /home/ubuntu/cephtest/tempest && /home/ubuntu/cephtest/tox-venv/bin/tox -e venv --notest'
2021-11-12T09:10:34.432 INFO:scrape:1 jobs: ['6497990']
2021-11-12T09:10:34.432 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}']
2021-11-12T09:10:34.433 INFO:scrape:
2021-11-12T09:10:34.433 INFO:scrape:Failure: reached maximum tries (90) after waiting for 540 seconds
2021-11-12T09:10:34.433 INFO:scrape:1 jobs: ['6498009']
2021-11-12T09:10:34.434 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/http', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/valgrind}']
2021-11-12T09:10:34.434 INFO:scrape:
2021-11-12T09:10:34.435 INFO:scrape:Failure: Command failed (s3 tests against rgw) on smithi105 with status 1: 'S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a test_of_sts'
2021-11-12T09:10:34.435 INFO:scrape:1 jobs: ['6497989']
2021-11-12T09:10:34.436 INFO:scrape:suites: ['first', 'ignore-pg-availability', 'objectstore', 'overrides', 'pool-type', 'rgw/sts/{cluster', 'rgw_frontend/beast', 'ststests}}', 'supported-random-distro$/{centos_8.stream}', 'tasks/{0-install']
2021-11-12T09:10:34.436 INFO:scrape:
2021-11-12T09:10:34.437 INFO:scrape:Failure: Command failed (workunit test rgw/run-reshard.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3a8018ba3cfe536252b397411bf18b7828c6098 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh'
2021-11-12T09:10:34.437 INFO:scrape:1 jobs: ['6498027']
2021-11-12T09:10:34.438 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec', 's3tests-java', 's3tests}', 'sharding$/{default}', 'striping$/{stripe-greater-than-chunk}', 'tasks/{cls', 'validater/valgrind}']
2021-11-12T09:10:34.438 INFO:scrape:
2021-11-12T09:10:34.439 INFO:scrape:Failure: rgw multisite test failures
2021-11-12T09:10:34.439 INFO:scrape:1 jobs: ['6498022']
2021-11-12T09:10:34.440 INFO:scrape:suites: ['frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}']
2021-11-12T09:10:34.440 INFO:scrape:
2021-11-12T09:10:34.441 INFO:scrape:Dead: b'2021-11-12T08:37:35.780 DEBUG:teuthology.exit:Finished running handlers'
2021-11-12T09:10:34.441 INFO:scrape:2 jobs: ['6497986', '6498001']
2021-11-12T09:10:34.442 INFO:scrape:suites intersection: ['ignore-pg-availability']
2021-11-12T09:10:34.442 INFO:scrape:suites union: ['1-ceph-install/install', '2-kms/kmip', '3-rgw/rgw', '4-tests/{s3tests}', 'frontend/beast', 'ignore-pg-availability', 'omap_limits', 'overrides', 'realms/three-zone-plus-pubsub', 'rgw/crypt/{0-cluster/fixed-1', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}']
2021-11-12T09:10:34.442 INFO:scrape:
2021-11-12T09:10:34.443 INFO:scrape:Failure: "2021-11-11T20:55:09.570602+0000 mon.a (mon.0) 283 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log
2021-11-12T09:10:34.443 INFO:scrape:1 jobs: ['6497999']
2021-11-12T09:10:34.444 INFO:scrape:suites: ['centos_latest', 'clusters/fixed-2', 'datacache/no_datacache', 'frontend/beast', 'ignore-pg-availability', 'msgr-failures/few', 'objectstore/filestore-xfs', 'overrides', 'proto/https', 'ragweed', 'reshard', 'rgw/verify/{0-install', 'rgw_pool_type/ec-profile', 's3tests-java', 's3tests}', 'sharding$/{single}', 'striping$/{stripe-equals-chunk}', 'tasks/{cls', 'validater/valgrind}']
2021-11-12T09:10:34.444 INFO:scrape: