2023-08-23T08:18:32.313 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T08:18:32.337 INFO:teuthology.results:seed: '2349' 2023-08-23T08:42:27.809 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T08:42:27.830 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-08-23T11:51:42.527 INFO:teuthology.results:Tests finished! gathering results... 2023-08-23T11:51:44.905 INFO:scrape:Found 33 jobs 2023-08-23T11:51:46.039 INFO:scrape:Found 3 distinct failure reasons 2023-08-23T11:51:46.040 INFO:scrape:Failure: "2023-08-23T08:43:14.832739+0000 mon.a (mon.0) 148 : cluster [WRN] Health check failed: Degraded data redundancy: 169/9670 objects degraded (1.748%), 8 pgs degraded (PG_DEGRADED)" in cluster log 2023-08-23T11:51:46.041 INFO:scrape:6 jobs: ['7377609', '7377614', '7377627', '7377629', '7377635', '7377612'] 2023-08-23T11:51:46.041 INFO:scrape:suites intersection: ['crimson-rados/perf/{clusters/{fixed-2}', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'settings/optimized'] 2023-08-23T11:51:46.041 INFO:scrape:suites union: ['crimson-rados/perf/{clusters/{fixed-2}', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'settings/optimized', 'workloads/radosbench_4K_rand_read}', 'workloads/radosbench_4K_seq_read}', 'workloads/radosbench_4M_rand_read}', 'workloads/radosbench_4M_seq_read}', 'workloads/radosbench_4M_write}', 'workloads/sample_radosbench}'] 2023-08-23T11:51:46.042 INFO:scrape: 2023-08-23T11:51:46.042 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2023-08-23T11:51:46.042 INFO:scrape:1 jobs: ['7377620'] 2023-08-23T11:51:46.042 INFO:scrape:suites: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}'] 2023-08-23T11:51:46.043 INFO:scrape: 2023-08-23T11:51:46.043 INFO:scrape:Failure: Command failed on smithi078 with status 6: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats' 2023-08-23T11:51:46.043 INFO:scrape:1 jobs: ['7377610'] 2023-08-23T11:51:46.044 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/small-objects-localized}'] 2023-08-23T11:51:46.044 INFO:scrape: