2026-02-21T14:23:18.041 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-21T14:23:18.041 INFO:teuthology.results:seed: '2477' 2026-02-21T14:24:22.943 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-21T14:24:22.943 INFO:teuthology.results:Waiting up to 7200 seconds for tests to finish... 2026-02-21T16:24:36.241 WARNING:teuthology.results:test(s) did not finish before timeout of 7200 seconds 2026-02-21T16:24:37.358 INFO:scrape:Found 71 jobs 2026-02-21T16:24:39.804 INFO:scrape:Found 6 distinct failure reasons 2026-02-21T16:24:39.804 INFO:scrape:Failure: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-21T16:24:39.805 INFO:scrape:2 jobs: ['62745', '62733'] 2026-02-21T16:24:39.805 INFO:scrape:suites intersection: ['0-size-min-size-overrides/3-size-2-min-size', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'thrashosds-health'] 2026-02-21T16:24:39.805 INFO:scrape:suites union: ['0-size-min-size-overrides/3-size-2-min-size', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'thrashers/{default}', 'thrashers/{pggrow}', 'thrashosds-health', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}'] 2026-02-21T16:24:39.805 INFO:scrape: 2026-02-21T16:24:39.805 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json 2026-02-21T16:24:39.805 INFO:scrape:1 jobs: ['62723'] 2026-02-21T16:24:39.805 INFO:scrape:suites: ['0-size-min-size-overrides/3-size-2-min-size', '1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'thrashers/{default}', 'thrashosds-health', 'workloads/write_fadvise_dontneed}'] 2026-02-21T16:24:39.805 INFO:scrape: 2026-02-21T16:24:39.805 INFO:scrape:Failure: Command failed (workunit test cephtool/test_crimson_dump_metrics.sh) on trial160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_crimson_dump_metrics.sh' 2026-02-21T16:24:39.805 INFO:scrape:2 jobs: ['62727', '62697'] 2026-02-21T16:24:39.805 INFO:scrape:suites intersection: ['all/osd-dump-metrics', 'crimson-rados/singleton/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'rados}'] 2026-02-21T16:24:39.805 INFO:scrape:suites union: ['all/osd-dump-metrics', 'crimson-rados/singleton/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'objectstore/seastore/rbm$/{crimson_seastore_rbm}', 'objectstore/seastore/segmented$/{crimson_seastore_segmented}', 'rados}'] 2026-02-21T16:24:39.805 INFO:scrape: 2026-02-21T16:24:39.805 INFO:scrape:Dead: b'2026-02-21T15:11:31.294 INFO:tasks.ceph.mgr.x.trial055.stderr:2026-02-21T15:11:31.302+0000 7f14be3f8640 -1 mgr handle_mgr_signal *** Got signal Terminated ***' 2026-02-21T16:24:39.805 INFO:scrape:1 jobs: ['62712'] 2026-02-21T16:24:39.805 INFO:scrape:suites: ['clusters/crimson-fixed-1', 'crimson-rados/rbd/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented}', 'tasks/rbd_api_tests}'] 2026-02-21T16:24:39.805 INFO:scrape: 2026-02-21T16:24:39.805 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd_python.sh) on trial017 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' 2026-02-21T16:24:39.805 INFO:scrape:4 jobs: ['62732', '62751', '62708', '62704'] 2026-02-21T16:24:39.805 INFO:scrape:suites intersection: ['clusters/crimson-fixed-1', 'crimson-rados/rbd/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph'] 2026-02-21T16:24:39.805 INFO:scrape:suites union: ['clusters/crimson-fixed-1', 'crimson-rados/rbd/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/rbm$/{crimson_seastore_rbm_2q}', 'objectstore/seastore/rbm$/{crimson_seastore_rbm}', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'objectstore/seastore/segmented$/{crimson_seastore_segmented}', 'tasks/rbd_python_api_tests_old_format}', 'tasks/rbd_python_api_tests}'] 2026-02-21T16:24:39.805 INFO:scrape: 2026-02-21T16:24:39.805 INFO:scrape:Failure: Command failed on trial134 with status 6: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats' 2026-02-21T16:24:39.805 INFO:scrape:3 jobs: ['62749', '62758', '62719'] 2026-02-21T16:24:39.805 INFO:scrape:suites intersection: ['0-size-min-size-overrides/3-size-2-min-size', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'thrashosds-health'] 2026-02-21T16:24:39.806 INFO:scrape:suites union: ['0-size-min-size-overrides/3-size-2-min-size', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'thrashers/{default}', 'thrashers/{pggrow}', 'thrashosds-health', 'workloads/pool-snaps-few-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/write_fadvise_dontneed}'] 2026-02-21T16:24:39.806 INFO:scrape: 2026-02-21T16:24:39.807 INFO:teuthology.results:Sending results to xxhdx1985126@gmail.com: Test Run: xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial ================================================================= info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/ logs: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/ failed: 12 dead: 0 running: 1 waiting: 0 queued: 0 passed: 58 Fail ================================================================= [62697] crimson-rados/singleton/{0-crimson_install all/osd-dump-metrics crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/rbm$/{crimson_seastore_rbm} rados} ----------------------------------------------------------------- time: 00:28:05 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62697/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62697/ Command failed (workunit test cephtool/test_crimson_dump_metrics.sh) on trial198 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/cephtool/test_crimson_dump_metrics.sh' [62704] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/rbd_python_api_tests} ----------------------------------------------------------------- time: 00:21:03 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62704/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62704/ Command failed (workunit test rbd/test_librbd_python.sh) on trial164 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python .sh' [62708] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 00:20:33 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62708/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62708/ Command failed (workunit test rbd/test_librbd_python.sh) on trial036 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' [62719] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:55:09 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62719/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62719/ Command failed on trial152 with status 6: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats' [62723] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:50:05 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62723/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62723/ Command failed on trial044 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' [62727] crimson-rados/singleton/{0-crimson_install all/osd-dump-metrics crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/segmented$/{crimson_seastore_segmented} rados} ----------------------------------------------------------------- time: 00:28:13 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62727/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62727/ Command failed (workunit test cephtool/test_crimson_dump_metrics.sh) on trial160 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/cephtool/test_crimson_dump_metrics.sh' [62732] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 00:20:35 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62732/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62732/ Command failed (workunit test rbd/test_librbd_python.sh) on trial017 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' [62733] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 00:52:17 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62733/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62733/ The WatchDog barked due to Daemon ceph.osd.0 has failed [62745] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 01:17:05 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62745/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62745/ The WatchDog barked due to Daemon ceph.osd.2 has failed [62749] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 01:33:15 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62749/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62749/ Command failed on trial134 with status 6: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats' [62751] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rbd_python_api_tests} ----------------------------------------------------------------- time: 00:25:13 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62751/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62751/ Command failed (workunit test rbd/test_librbd_python.sh) on trial187 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python .sh' [62758] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:43:25 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62758/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62758/ Command failed on trial109 with status 6: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats' Running ================================================================= [62712] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_api_tests} info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62712/ Pass ================================================================= [62688] crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool} time: 00:30:36 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62688/ [62689] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/pool-snaps-few-objects} time: 00:51:04 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62689/ [62690] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/radosbench-high-concurrency} time: 00:54:46 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62690/ [62691] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rbd_api_tests_old_format} time: 00:55:06 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62691/ [62692] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/small-objects-balanced} time: 00:42:37 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62692/ [62693] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} time: 00:39:45 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62693/ [62694] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/rados_api_tests} time: 00:50:36 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62694/ [62695] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} time: 01:23:08 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62695/ [62696] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_cls_tests} time: 00:32:25 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62696/ [62698] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-localized} time: 00:48:11 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62698/ [62699] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/write_fadvise_dontneed} time: 00:33:38 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62699/ [62700] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rados_python} time: 00:33:08 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62700/ [62701] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/admin_socket_objecter_requests} time: 00:38:02 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62701/ [62702] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/radosbench-high-concurrency} time: 00:43:21 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62702/ [62703] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/radosbench} time: 00:49:32 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62703/ [62705] crimson-rados/singleton/{0-crimson_install all/osd-pg-splitting crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/segmented$/{crimson_seastore_segmented} rados} time: 00:34:48 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62705/ [62706] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} time: 00:39:31 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62706/ [62707] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/small-objects} time: 00:43:31 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62707/ [62709] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects-localized} time: 01:22:18 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62709/ [62710] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects} time: 00:50:26 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62710/ [62711] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/cls} time: 00:29:41 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62711/ [62713] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/admin_socket_objecter_requests} time: 00:36:30 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62713/ [62714] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/pool-snaps-few-objects} time: 00:50:24 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62714/ [62715] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/radosbench} time: 00:50:13 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62715/ [62716] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects-balanced} time: 00:41:06 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62716/ [62717] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rados_api_tests} time: 00:50:04 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62717/ [62718] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects} time: 00:41:36 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62718/ [62720] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rbd_cls_tests} time: 00:30:35 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62720/ [62721] crimson-rados/singleton/{0-crimson_install all/osd-backfill crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/rbm$/{crimson_seastore_rbm} rados} time: 00:29:46 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62721/ [62722] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects} time: 00:50:59 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62722/ [62724] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_lock_and_fence} time: 00:31:21 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62724/ [62725] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/pool-snaps-few-objects} time: 01:32:48 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62725/ [62726] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/radosbench-high-concurrency} time: 00:49:46 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62726/ [62728] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects-balanced} time: 00:36:21 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62728/ [62729] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/small-objects-localized} time: 00:41:25 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62729/ [62730] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/readwrite} time: 00:32:31 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62730/ [62731] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} time: 01:16:30 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62731/ [62734] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/write_fadvise_dontneed} time: 00:34:10 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62734/ [62735] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/cls} time: 00:31:04 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62735/ [62736] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rbd_api_tests} time: 01:36:01 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62736/ [62737] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/admin_socket_objecter_requests} time: 00:34:36 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62737/ [62738] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/radosbench-high-concurrency} time: 00:51:15 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62738/ [62739] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/radosbench} time: 00:49:32 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62739/ [62740] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_api_tests_old_format} time: 00:57:04 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62740/ [62741] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} time: 00:40:48 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62741/ [62742] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects} time: 00:44:06 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62742/ [62743] crimson-rados/singleton/{0-crimson_install all/osd-pg-splitting crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} rados} time: 00:30:24 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62743/ [62744] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-localized} time: 00:46:24 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62744/ [62746] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/rados_python} time: 00:26:04 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62746/ [62747] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/rbd_lock_and_fence} time: 00:30:11 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62747/ [62748] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/admin_socket_objecter_requests} time: 00:36:01 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62748/ [62750] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/radosbench} time: 00:45:20 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62750/ [62752] crimson-rados/singleton/{0-crimson_install all/osd-backfill crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/segmented$/{crimson_seastore_segmented} rados} time: 00:31:55 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62752/ [62753] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/small-objects-balanced} time: 00:39:01 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62753/ [62754] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/readwrite} time: 00:31:40 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62754/ [62755] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/small-objects} time: 00:41:22 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62755/ [62756] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-balanced} time: 00:48:58 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62756/ [62757] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects} time: 00:48:35 info: https://pulpito.ceph.com/xuxuehan-2026-02-21_14:23:14-crimson-rados-wip-trans-cc-opt-rbm-drop-brf-distro-debug-trial/62757/ 2026-02-21T16:24:39.814 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 33, in main results(args['--archive-dir'], args['--name'], args['--email'], File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 78, in results email_results( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 95, in email_results smtp = smtplib.SMTP('localhost') ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 255, in __init__ (code, msg) = self.connect(host, port) ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 341, in connect self.sock = self._get_socket(host, port, self.timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket return socket.create_connection((host, port), timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect self._internal_connect(address) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect raise _SocketError(err, strerror(err)) ConnectionRefusedError: [Errno 111] Connection refused