2023-10-12T01:30:34.265 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T01:30:34.266 INFO:teuthology.results:seed: '9555' 2023-10-12T01:53:41.226 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T01:53:41.231 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-12T13:43:36.932 INFO:teuthology.results:Tests finished! gathering results... 2023-10-12T13:43:39.904 INFO:scrape:Found 34 jobs 2023-10-12T13:43:41.070 INFO:scrape:Found 4 distinct failure reasons 2023-10-12T13:43:41.072 INFO:scrape:Failure: "2023-10-12T02:09:27.648577+0000 mon.a (mon.0) 150 : cluster [WRN] Health check failed: Degraded data redundancy: 25/1648 objects degraded (1.517%), 4 pgs degraded (PG_DEGRADED)" in cluster log 2023-10-12T13:43:41.072 INFO:scrape:6 jobs: ['7422357', '7422351', '7422349', '7422353', '7422347', '7422364'] 2023-10-12T13:43:41.073 INFO:scrape:suites intersection: ['crimson-rados/perf/{clusters/{fixed-2}', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'settings/optimized'] 2023-10-12T13:43:41.074 INFO:scrape:suites union: ['crimson-rados/perf/{clusters/{fixed-2}', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'settings/optimized', 'workloads/radosbench_4K_rand_read}', 'workloads/radosbench_4K_seq_read}', 'workloads/radosbench_4M_rand_read}', 'workloads/radosbench_4M_seq_read}', 'workloads/radosbench_4M_write}', 'workloads/sample_radosbench}'] 2023-10-12T13:43:41.075 INFO:scrape: 2023-10-12T13:43:41.076 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_librbd_python.sh -m \ 2023-10-12T13:43:41.076 INFO:scrape:1 jobs: ['7422361'] 2023-10-12T13:43:41.077 INFO:scrape:suites: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_python_api_tests_old_format}'] 2023-10-12T13:43:41.078 INFO:scrape: 2023-10-12T13:43:41.079 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2023-10-12T13:43:41.079 INFO:scrape:1 jobs: ['7422333'] 2023-10-12T13:43:41.080 INFO:scrape:suites: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}'] 2023-10-12T13:43:41.080 INFO:scrape: 2023-10-12T13:43:41.081 INFO:scrape:Dead: b'2023-10-12T13:40:47.063 DEBUG:teuthology.exit:Finished running handlers' 2023-10-12T13:43:41.081 INFO:scrape:1 jobs: ['7422337'] 2023-10-12T13:43:41.082 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/pool-snaps-few-objects}'] 2023-10-12T13:43:41.083 INFO:scrape: 2023-10-12T13:43:41.085 INFO:teuthology.results:Sending results to yingxin.cheng@intel.com: Test Run: yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/ failed: 8 dead: 1 running: 0 waiting: 0 queued: 0 passed: 25 Fail ================================================================= [7422333] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} ----------------------------------------------------------------- time: 03:12:49 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422333/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422333/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d201c2f1fab42bf814fddb3614b9475 Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi037 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6b24e899e33913e9eb55d38d1531a93a0747f52c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims on_librbd.sh' [7422347] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4K_rand_read} ----------------------------------------------------------------- time: 00:12:50 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422347/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422347/ "2023-10-12T02:00:38.234396+0000 mon.a (mon.0) 152 : cluster [WRN] Health check failed: Degraded data redundancy: 199/9608 objects degraded (2.071%), 7 pgs degraded (PG_DEGRADED)" in cluster log [7422349] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4K_seq_read} ----------------------------------------------------------------- time: 00:11:55 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422349/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422349/ "2023-10-12T02:03:41.397242+0000 mon.a (mon.0) 148 : cluster [WRN] Health check failed: Degraded data redundancy: 158/10832 objects degraded (1.459%), 8 pgs degraded (PG_DEGRADED)" in cluster log [7422351] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_rand_read} ----------------------------------------------------------------- time: 00:13:02 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422351/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422351/ "2023-10-12T02:05:02.641291+0000 mon.a (mon.0) 154 : cluster [WRN] Health check failed: Degraded data redundancy: 24/1504 objects degraded (1.596%), 9 pgs degraded (PG_DEGRADED)" in cluster log [7422353] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_seq_read} ----------------------------------------------------------------- time: 00:12:15 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422353/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422353/ "2023-10-12T02:06:11.427958+0000 mon.a (mon.0) 152 : cluster [WRN] Health check failed: Degraded data redundancy: 30/1704 objects degraded (1.761%), 6 pgs degraded (PG_DEGRADED)" in cluster log [7422357] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_write} ----------------------------------------------------------------- time: 00:12:00 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422357/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422357/ "2023-10-12T02:09:27.648577+0000 mon.a (mon.0) 150 : cluster [WRN] Health check failed: Degraded data redundancy: 25/1648 objects degraded (1.517%), 4 pgs degraded (PG_DEGRADED)" in cluster log [7422361] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 03:11:12 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422361/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422361/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc4ff74c4ca140eebabed576d6676d63 Command failed (workunit test rbd/test_librbd_python.sh) on smithi135 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6b24e899e33913e9eb55d38d1531a93a0747f52c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh -m \'not skip_if_crimson\'' [7422364] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/sample_radosbench} ----------------------------------------------------------------- time: 00:11:59 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422364/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422364/ "2023-10-12T02:13:05.683962+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: Degraded data redundancy: 166/9444 objects degraded (1.758%), 8 pgs degraded (PG_DEGRADED)" in cluster log Dead ================================================================= [7422337] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422337/ log: http://qa-proxy.ceph.com/teuthology/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422337/ hit max job timeout Pass ================================================================= [7422331] crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} time: 00:27:38 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422331/ [7422332] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4K_rand_read} time: 00:16:11 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422332/ [7422334] crimson-rados/singleton/{all/osd-backfill crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/bluestore rados} time: 00:15:54 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422334/ [7422335] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:16:05 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422335/ [7422336] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4K_rand_rw} time: 00:16:10 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422336/ [7422338] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4M_rand_read} time: 00:14:51 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422338/ [7422339] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests_old_format} time: 00:18:25 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422339/ [7422340] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:25:13 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422340/ [7422341] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4M_rand_rw} time: 00:15:54 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422341/ [7422342] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench} time: 00:26:20 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422342/ [7422343] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4M_rand_write} time: 00:16:15 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422343/ [7422344] crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_python} time: 00:16:46 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422344/ [7422345] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_cls_tests} time: 00:12:22 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422345/ [7422346] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:20:15 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422346/ [7422348] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:20:18 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422348/ [7422350] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_lock_and_fence} time: 00:11:20 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422350/ [7422352] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} time: 00:22:05 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422352/ [7422354] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:15 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422354/ [7422355] crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/readwrite} time: 00:14:01 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422355/ [7422356] crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests} time: 00:22:50 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422356/ [7422358] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:19 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422358/ [7422359] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_omap_write} time: 00:22:37 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422359/ [7422360] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:29:47 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422360/ [7422362] crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/sample_fio} time: 00:15:52 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422362/ [7422363] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:37 info: http://pulpito.ceph.com/yingxin-2023-10-12_01:26:17-crimson-rados-wip-yingxin-crimson-baseline-20231011-distro-default-smithi/7422363/