2026-02-20T07:28:46.360 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T07:28:46.360 INFO:teuthology.results:seed: '2477' 2026-02-20T08:00:59.481 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T08:00:59.488 INFO:teuthology.results:Waiting up to 7200 seconds for tests to finish... 2026-02-20T10:01:12.462 WARNING:teuthology.results:test(s) did not finish before timeout of 7200 seconds 2026-02-20T10:01:14.077 INFO:scrape:Found 71 jobs 2026-02-20T10:01:15.709 INFO:scrape:Found 5 distinct failure reasons 2026-02-20T10:01:15.709 INFO:scrape:Failure: Command failed on trial013 with status 6: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats' 2026-02-20T10:01:15.709 INFO:scrape:3 jobs: ['59877', '59883', '59876'] 2026-02-20T10:01:15.709 INFO:scrape:suites intersection: ['0-size-min-size-overrides/3-size-2-min-size', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'thrashosds-health'] 2026-02-20T10:01:15.709 INFO:scrape:suites union: ['0-size-min-size-overrides/3-size-2-min-size', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/rbm$/{crimson_seastore_rbm_2q}', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'thrashers/{default}', 'thrashers/{pggrow}', 'thrashosds-health', 'workloads/small-objects-balanced}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}'] 2026-02-20T10:01:15.709 INFO:scrape: 2026-02-20T10:01:15.709 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd_python.sh) on trial043 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' 2026-02-20T10:01:15.709 INFO:scrape:4 jobs: ['59875', '59899', '59871', '59918'] 2026-02-20T10:01:15.709 INFO:scrape:suites intersection: ['clusters/crimson-fixed-1', 'crimson-rados/rbd/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph'] 2026-02-20T10:01:15.709 INFO:scrape:suites union: ['clusters/crimson-fixed-1', 'crimson-rados/rbd/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/rbm$/{crimson_seastore_rbm_2q}', 'objectstore/seastore/rbm$/{crimson_seastore_rbm}', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'objectstore/seastore/segmented$/{crimson_seastore_segmented}', 'tasks/rbd_python_api_tests_old_format}', 'tasks/rbd_python_api_tests}'] 2026-02-20T10:01:15.709 INFO:scrape: 2026-02-20T10:01:15.709 INFO:scrape:Dead: b'2026-02-20T08:13:52.469 INFO:tasks.ceph.mgr.x.trial178.stderr:2026-02-20T08:13:52.472+0000 7f2c3cff8640 -1 mgr handle_mgr_signal *** Got signal Terminated ***' 2026-02-20T10:01:15.709 INFO:scrape:2 jobs: ['59907', '59879'] 2026-02-20T10:01:15.710 INFO:scrape:suites intersection: ['clusters/crimson-fixed-1', 'crimson-rados/rbd/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented}'] 2026-02-20T10:01:15.710 INFO:scrape:suites union: ['clusters/crimson-fixed-1', 'crimson-rados/rbd/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented}', 'tasks/rbd_api_tests_old_format}', 'tasks/rbd_api_tests}'] 2026-02-20T10:01:15.710 INFO:scrape: 2026-02-20T10:01:15.710 INFO:scrape:Failure: Command failed (workunit test cephtool/test_crimson_dump_metrics.sh) on trial163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_crimson_dump_metrics.sh' 2026-02-20T10:01:15.710 INFO:scrape:2 jobs: ['59864', '59894'] 2026-02-20T10:01:15.710 INFO:scrape:suites intersection: ['all/osd-dump-metrics', 'crimson-rados/singleton/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'rados}'] 2026-02-20T10:01:15.710 INFO:scrape:suites union: ['all/osd-dump-metrics', 'crimson-rados/singleton/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'objectstore/seastore/rbm$/{crimson_seastore_rbm}', 'objectstore/seastore/segmented$/{crimson_seastore_segmented}', 'rados}'] 2026-02-20T10:01:15.710 INFO:scrape: 2026-02-20T10:01:15.710 INFO:scrape:Failure: The WatchDog barked due to Thrasher ceph.osd.0 threw exception timed out waiting for admin_socket to appear after osd.0 restart 2026-02-20T10:01:15.710 INFO:scrape:2 jobs: ['59916', '59912'] 2026-02-20T10:01:15.710 INFO:scrape:suites intersection: ['0-size-min-size-overrides/3-size-2-min-size', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'thrashers/{default}', 'thrashosds-health'] 2026-02-20T10:01:15.710 INFO:scrape:suites union: ['0-size-min-size-overrides/3-size-2-min-size', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'clusters/{crimson-fixed-2}', 'crimson-rados/thrash/{0-crimson_install', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/seastore/segmented$/{crimson_seastore_segmented_2q}', 'thrashers/{default}', 'thrashosds-health', 'workloads/pool-snaps-few-objects}', 'workloads/snaps-few-objects}'] 2026-02-20T10:01:15.710 INFO:scrape: 2026-02-20T10:01:15.711 INFO:teuthology.results:Sending results to xxhdx1985126@gmail.com: Test Run: xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial ================================================================= info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/ logs: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/ failed: 11 dead: 0 running: 2 waiting: 0 queued: 0 passed: 58 Fail ================================================================= [59864] crimson-rados/singleton/{0-crimson_install all/osd-dump-metrics crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/rbm$/{crimson_seastore_rbm} rados} ----------------------------------------------------------------- time: 00:20:08 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59864/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59864/ Command failed (workunit test cephtool/test_crimson_dump_metrics.sh) on trial163 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/cephtool/test_crimson_dump_metrics.sh' [59871] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/rbd_python_api_tests} ----------------------------------------------------------------- time: 00:12:44 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59871/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59871/ Command failed (workunit test rbd/test_librbd_python.sh) on trial033 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python .sh' [59875] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 00:13:48 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59875/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59875/ Command failed (workunit test rbd/test_librbd_python.sh) on trial043 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' [59876] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 01:23:17 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59876/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59876/ Command failed on trial046 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' [59877] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:48:16 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59877/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59877/ Command failed on trial013 with status 6: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats' [59883] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:33:42 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59883/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59883/ Command failed on trial084 with status 6: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats' [59894] crimson-rados/singleton/{0-crimson_install all/osd-dump-metrics crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/segmented$/{crimson_seastore_segmented} rados} ----------------------------------------------------------------- time: 00:21:25 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59894/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59894/ Command failed (workunit test cephtool/test_crimson_dump_metrics.sh) on trial076 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/cephtool/test_crimson_dump_metrics.sh' [59899] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 00:12:20 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59899/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59899/ Command failed (workunit test rbd/test_librbd_python.sh) on trial127 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cep htest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh' [59912] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:44:13 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59912/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59912/ The WatchDog barked due to Thrasher ceph.osd.3 threw exception timed out waiting for admin_socket to appear after osd.3 restart [59916] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 00:49:33 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59916/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59916/ The WatchDog barked due to Thrasher ceph.osd.0 threw exception timed out waiting for admin_socket to appear after osd.0 restart [59918] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rbd_python_api_tests} ----------------------------------------------------------------- time: 00:06:29 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59918/ log: https://qa-proxy.ceph.com/teuthology/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59918/ Command failed (workunit test rbd/test_librbd_python.sh) on trial007 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c8fda9e9b7a6ecf86711fef9f31d8fff56203e8f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python .sh' Running ================================================================= [59879] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_api_tests} info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59879/ [59907] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_api_tests_old_format} info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59907/ Pass ================================================================= [59855] crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool} time: 00:23:10 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59855/ [59856] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/pool-snaps-few-objects} time: 00:37:33 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59856/ [59857] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/radosbench-high-concurrency} time: 00:41:58 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59857/ [59858] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rbd_api_tests_old_format} time: 00:47:37 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59858/ [59859] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/small-objects-balanced} time: 00:32:33 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59859/ [59860] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} time: 00:36:05 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59860/ [59861] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/rados_api_tests} time: 00:36:57 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59861/ [59862] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} time: 01:07:14 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59862/ [59863] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_cls_tests} time: 00:22:16 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59863/ [59865] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-localized} time: 00:40:46 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59865/ [59866] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/write_fadvise_dontneed} time: 00:22:16 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59866/ [59867] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rados_python} time: 00:21:51 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59867/ [59868] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/admin_socket_objecter_requests} time: 00:29:16 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59868/ [59869] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/radosbench-high-concurrency} time: 00:38:14 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59869/ [59870] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/radosbench} time: 00:37:11 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59870/ [59872] crimson-rados/singleton/{0-crimson_install all/osd-pg-splitting crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/segmented$/{crimson_seastore_segmented} rados} time: 00:22:16 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59872/ [59873] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} time: 00:34:14 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59873/ [59874] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/small-objects} time: 00:30:38 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59874/ [59878] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/cls} time: 00:20:40 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59878/ [59880] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/admin_socket_objecter_requests} time: 00:28:25 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59880/ [59881] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/pool-snaps-few-objects} time: 00:41:20 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59881/ [59882] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/radosbench} time: 00:41:02 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59882/ [59884] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rados_api_tests} time: 00:42:09 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59884/ [59885] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects} time: 00:33:58 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59885/ [59886] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-balanced} time: 00:41:48 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59886/ [59887] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rbd_cls_tests} time: 00:25:14 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59887/ [59888] crimson-rados/singleton/{0-crimson_install all/osd-backfill crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/rbm$/{crimson_seastore_rbm} rados} time: 00:20:46 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59888/ [59889] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects} time: 00:40:56 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59889/ [59890] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/write_fadvise_dontneed} time: 00:29:59 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59890/ [59891] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_lock_and_fence} time: 00:19:40 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59891/ [59892] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/pool-snaps-few-objects} time: 01:20:43 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59892/ [59893] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/radosbench-high-concurrency} time: 00:33:36 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59893/ [59895] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects-balanced} time: 00:26:20 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59895/ [59896] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/small-objects-localized} time: 00:25:48 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59896/ [59897] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/readwrite} time: 00:17:10 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59897/ [59898] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} time: 01:07:03 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59898/ [59900] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-localized} time: 00:33:34 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59900/ [59901] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:23 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59901/ [59902] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/cls} time: 00:13:52 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59902/ [59903] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} tasks/rbd_api_tests} time: 01:18:44 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59903/ [59904] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/admin_socket_objecter_requests} time: 00:19:25 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59904/ [59905] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/radosbench-high-concurrency} time: 00:31:12 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59905/ [59906] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/radosbench} time: 00:29:53 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59906/ [59908] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} time: 00:22:21 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59908/ [59909] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/small-objects} time: 00:20:03 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59909/ [59910] crimson-rados/singleton/{0-crimson_install all/osd-pg-splitting crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} rados} time: 00:10:23 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59910/ [59911] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:49 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59911/ [59913] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/rados_python} time: 00:11:56 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59913/ [59914] crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} tasks/rbd_lock_and_fence} time: 00:07:31 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59914/ [59915] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/admin_socket_objecter_requests} time: 00:13:25 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59915/ [59917] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/radosbench} time: 00:24:43 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59917/ [59919] crimson-rados/singleton/{0-crimson_install all/osd-backfill crimson-supported-all-distro/centos_latest crimson_qa_overrides objectstore/seastore/segmented$/{crimson_seastore_segmented} rados} time: 00:10:36 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59919/ [59920] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/small-objects-balanced} time: 00:19:44 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59920/ [59921] crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/readwrite} time: 00:10:33 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59921/ [59922] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{pggrow} thrashosds-health workloads/small-objects} time: 00:18:59 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59922/ [59923] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:40 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59923/ [59924] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{pggrow} thrashosds-health workloads/snaps-few-objects} time: 00:26:24 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59924/ [59925] crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{pggrow} thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:02 info: https://pulpito.ceph.com/xuxuehan-2026-02-20_07:28:41-crimson-rados-wip-trans-cc-opt-rbm-drop-backref-distro-debug-trial/59925/ 2026-02-20T10:01:15.719 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 33, in main results(args['--archive-dir'], args['--name'], args['--email'], File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 78, in results email_results( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/results.py", line 95, in email_results smtp = smtplib.SMTP('localhost') ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 255, in __init__ (code, msg) = self.connect(host, port) ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 341, in connect self.sock = self._get_socket(host, port, self.timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket return socket.create_connection((host, port), timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect self._internal_connect(address) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect raise _SocketError(err, strerror(err)) ConnectionRefusedError: [Errno 111] Connection refused