2026-02-18T21:17:23.674 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-18T21:17:23.674 INFO:teuthology.results:seed: '7741'
2026-02-18T22:48:27.572 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-18T22:48:27.580 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2026-02-19T03:43:46.851 INFO:teuthology.results:Tests finished! gathering results...
2026-02-19T03:43:49.229 INFO:scrape:Found 72 jobs
2026-02-19T03:43:49.563 INFO:scrape:Found 5 distinct failure reasons
2026-02-19T03:43:49.563 INFO:scrape:Failure: "2026-02-18T22:51:39.928853+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 109557.412521 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log
2026-02-19T03:43:49.563 INFO:scrape:56 jobs
2026-02-19T03:43:49.564 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}']
2026-02-19T03:43:49.564 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '2-first-half-tasks/rbd-cls', '2-first-half-tasks/rbd-import-export', '2-first-half-tasks/rbd_api', '2-first-half-tasks/readwrite', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic', 'mon_election/connectivity', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x:stress-split/{0-distro/centos_9.stream', 'upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc', 'upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04']
2026-02-19T03:43:49.564 INFO:scrape:
2026-02-19T03:43:49.564 INFO:scrape:Failure: "2026-02-18T22:30:00.000198+0000 mon.a (mon.0) 5414 : cluster [WRN]     pg 1.1 is stuck undersized for 99s, current state active+undersized, last acting [0,2]" in cluster log
2026-02-19T03:43:49.564 INFO:scrape:11 jobs: ['53345', '53356', '53395', '53399', '53392', '53385', '53348', '53377', '53413', '53406', '53402']
2026-02-19T03:43:49.564 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04']
2026-02-19T03:43:49.564 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '2-first-half-tasks/rbd-cls', '2-first-half-tasks/rbd-import-export', '2-first-half-tasks/rbd_api', '2-first-half-tasks/readwrite', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic', 'mon_election/connectivity', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04']
2026-02-19T03:43:49.564 INFO:scrape:
2026-02-19T03:43:49.564 INFO:scrape:Dead: b'2026-02-19T03:42:47.598 DEBUG:teuthology.exit:Finished running handlers'
2026-02-19T03:43:49.564 INFO:scrape:1 jobs: ['53390']
2026-02-19T03:43:49.564 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', 'mon_election/connectivity', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc']
2026-02-19T03:43:49.564 INFO:scrape:
2026-02-19T03:43:49.564 INFO:scrape:Failure: Command failed on trial129 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8ba2aebd-0d10-11f1-886b-d404e6e7d460 -e sha1=5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --limit 1'"
2026-02-19T03:43:49.564 INFO:scrape:2 jobs: ['53349', '53374']
2026-02-19T03:43:49.564 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', 'mon_election/classic', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04']
2026-02-19T03:43:49.564 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '2-first-half-tasks/rbd-cls', '3-stress-tasks/{radosbench', '4-second-half-tasks/radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04']
2026-02-19T03:43:49.564 INFO:scrape:
2026-02-19T03:43:49.564 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd.sh) on trial055 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh'
2026-02-19T03:43:49.564 INFO:scrape:2 jobs: ['53376', '53360']
2026-02-19T03:43:49.564 INFO:scrape:suites intersection: ['0-roles', '1-start', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}']
2026-02-19T03:43:49.564 INFO:scrape:suites union: ['0-roles', '1-start', '2-first-half-tasks/rbd_api', '2-first-half-tasks/snaps-few-objects', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic', 'mon_election/connectivity', 'overrides/ignorelist_health}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:reef-x:stress-split/{0-distro/centos_9.stream', 'upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc']
2026-02-19T03:43:49.564 INFO:scrape:
2026-02-19T03:43:49.567 INFO:teuthology.results:Sending results to jcollin@redhat.com: Test Run: jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial
=================================================================
info:    https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/
logs:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/
failed:  71
dead:    1
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[53343]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:09:57
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53343/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53343/

    "2026-02-18T21:25:37.108339+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 118623.469535 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53344]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:53:57
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53344/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53344/

    "2026-02-18T21:27:33.928620+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 85693.249246 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53345]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:17:40
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53345/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53345/

    "2026-02-18T22:30:00.000198+0000 mon.a (mon.0) 5414 : cluster [WRN]     pg
    1.1 is stuck undersized for 99s, current state active+undersized, last
    acting [0,2]" in cluster log

[53346]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:29:33
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53346/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53346/

    "2026-02-18T21:27:08.198073+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 104281.829291 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53347]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:02:27
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53347/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53347/

    "2026-02-18T21:28:23.090190+0000 osd.0 (osd.0) 1 : cluster [WRN] OSD bench
    result of 98015.317246 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53348]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:11:33
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53348/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53348/

    "2026-02-18T22:00:00.000121+0000 mon.a (mon.0) 2365 : cluster [WRN]     pg
    1.0 is stuck undersized for 60s, current state active+undersized, last
    acting [0,6]" in cluster log

[53349]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   00:16:12
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53349/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53349/

    Command failed on trial129 with status 22: "sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell
    -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    8ba2aebd-0d10-11f1-886b-d404e6e7d460 -e
    sha1=5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 -- bash -c 'ceph orch upgrade
    start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --limit
    1'"

[53350]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:52:37
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53350/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53350/

    "2026-02-18T21:29:22.263102+0000 osd.6 (osd.6) 3 : cluster [WRN] OSD bench
    result of 88616.637573 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.6. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53351]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:04:33
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53351/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53351/

    "2026-02-18T21:28:49.640900+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 109513.891563 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53352]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:38:10
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53352/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53352/

    "2026-02-18T21:32:06.835372+0000 osd.6 (osd.6) 3 : cluster [WRN] OSD bench
    result of 81917.570172 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.6. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53353]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:01:20
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53353/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53353/

    "2026-02-18T21:29:30.117573+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 116699.037035 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53354]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:04:58
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53354/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53354/

    "2026-02-18T21:30:18.092292+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 80452.563908 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53355]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:11:33
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53355/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53355/

    "2026-02-18T21:30:14.021507+0000 osd.5 (osd.5) 3 : cluster [WRN] OSD bench
    result of 92160.620971 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.5. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53356]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:02:41
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53356/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53356/

    "2026-02-18T22:00:00.000153+0000 mon.a (mon.0) 1730 : cluster [WRN]     pg
    1.1 is stuck undersized for 64s, current state active+undersized, last
    acting [7,0]" in cluster log

[53357]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:01:14
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53357/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53357/

    "2026-02-18T21:31:48.677564+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 108601.857157 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53358]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:27:37
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53358/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53358/

    "2026-02-18T21:31:59.915853+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 100621.195010 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53359]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:12:42
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53359/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53359/

    "2026-02-18T21:31:37.853574+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 86501.872910 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53360]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:38:11
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53360/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53360/

    Command failed (workunit test rbd/test_librbd.sh) on trial028 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph"
    CEPH_ID="0" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh'

[53361]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:21:16
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53361/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53361/

    "2026-02-18T21:32:52.507015+0000 osd.6 (osd.6) 3 : cluster [WRN] OSD bench
    result of 94982.552971 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.6. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53362]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:53:05
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53362/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53362/

    "2026-02-18T21:32:14.584646+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 104752.187749 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53363]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:14:52
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53363/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53363/

    "2026-02-18T21:34:55.551770+0000 osd.4 (osd.4) 3 : cluster [WRN] OSD bench
    result of 83649.759461 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53364]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:29:49
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53364/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53364/

    "2026-02-18T21:33:39.102078+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 121647.511171 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53365]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:03:09
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53365/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53365/

    "2026-02-18T21:33:37.031430+0000 osd.0 (osd.0) 1 : cluster [WRN] OSD bench
    result of 105151.921920 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53366]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:16:15
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53366/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53366/

    "2026-02-18T22:10:13.149753+0000 osd.0 (osd.0) 1 : cluster [WRN] OSD bench
    result of 81108.256731 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53367]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:25:49
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53367/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53367/

    "2026-02-18T21:34:56.238875+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 115710.795215 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53368]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:53:26
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53368/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53368/

    "2026-02-18T21:33:57.559616+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 115604.722330 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53369]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:01:55
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53369/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53369/

    "2026-02-18T21:34:08.252527+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 108546.000275 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53370]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:38:35
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53370/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53370/

    "2026-02-18T21:37:28.597286+0000 osd.7 (osd.7) 3 : cluster [WRN] OSD bench
    result of 85126.013883 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.7. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53371]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:02:06
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53371/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53371/

    "2026-02-18T21:34:54.019543+0000 osd.2 (osd.2) 3 : cluster [WRN] OSD bench
    result of 122728.148560 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.2. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53372]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:00:56
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53372/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53372/

    "2026-02-18T21:34:40.886581+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 88339.696049 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53373]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:08:55
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53373/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53373/

    "2026-02-18T21:35:16.957876+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 86185.426969 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53374]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   00:13:54
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53374/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53374/

    Command failed on trial130 with status 22: "sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell
    -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    7b70e8cc-0d11-11f1-aec0-d404e6e7d460 -e
    sha1=5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 -- bash -c 'ceph orch upgrade
    start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --limit
    1'"

[53375]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:04:54
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53375/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53375/

    "2026-02-18T21:35:48.251177+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 92009.967869 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53376]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:43:33
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53376/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53376/

    Command failed (workunit test rbd/test_librbd.sh) on trial055 with status
    134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=reef TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph"
    CEPH_ID="0" PATH=$PATH:/usr/sbin
    CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh'

[53377]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:23:14
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53377/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53377/

    "2026-02-18T22:10:00.000116+0000 mon.a (mon.0) 2069 : cluster [WRN]     pg
    8.1 is stuck undersized for 2m, current state
    active+recovering+undersized+remapped, last acting [5,1]" in cluster log

[53378]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:06:29
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53378/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53378/

    "2026-02-18T21:37:42.089253+0000 osd.2 (osd.2) 3 : cluster [WRN] OSD bench
    result of 107340.532400 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.2. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53379]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:57:08
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53379/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53379/

    "2026-02-18T21:38:01.635680+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 92804.915344 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53380]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:05:17
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53380/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53380/

    "2026-02-18T21:45:09.667350+0000 osd.2 (osd.2) 1 : cluster [WRN] OSD bench
    result of 116485.022511 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.2. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53381]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:18:14
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53381/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53381/

    "2026-02-18T21:54:00.250919+0000 osd.3 (osd.3) 1 : cluster [WRN] OSD bench
    result of 81350.719139 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53382]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:39:04
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53382/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53382/

    "2026-02-18T21:43:23.387888+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 103654.204598 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53383]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:51:35
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53383/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53383/

    "2026-02-18T21:38:38.136018+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 89235.365355 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53384]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:24:39
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53384/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53384/

    "2026-02-18T21:40:18.711183+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 80290.342726 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53385]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:19:06
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53385/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53385/

    "2026-02-18T22:06:55.165492+0000 mon.a (mon.0) 1081 : cluster [WRN] Health
    check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in
    cluster log

[53386]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:03:11
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53386/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53386/

    "2026-02-18T21:40:58.336336+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 92464.973806 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53387]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:51:56
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53387/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53387/

    "2026-02-18T21:40:48.783767+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 84789.206402 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53388]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:52:25
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53388/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53388/

    "2026-02-18T21:55:54.573636+0000 osd.0 (osd.0) 1 : cluster [WRN] OSD bench
    result of 87016.320868 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53389]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:52:22
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53389/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53389/

    "2026-02-18T21:44:43.245405+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 99219.171578 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53391]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:02:55
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53391/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53391/

    "2026-02-18T21:50:19.335602+0000 osd.0 (osd.0) 1 : cluster [WRN] OSD bench
    result of 109311.256735 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53392]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:12:57
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53392/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53392/

    "2026-02-18T22:35:06.758456+0000 mon.a (mon.0) 3359 : cluster [WRN] Health
    check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in
    cluster log

[53393]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:50:31
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53393/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53393/

    "2026-02-18T21:54:50.580707+0000 osd.4 (osd.4) 3 : cluster [WRN] OSD bench
    result of 114551.963596 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.4. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53394]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:38:42
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53394/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53394/

    "2026-02-18T21:54:13.956268+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 108203.159222 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53395]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:07:12
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53395/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53395/

    "2026-02-18T22:20:33.894822+0000 mon.a (mon.0) 1569 : cluster [ERR] Health
    check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED)" in
    cluster log

[53396]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:11:48
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53396/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53396/

    "2026-02-18T21:55:19.691333+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 100341.663364 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53397]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:02:08
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53397/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53397/

    "2026-02-18T22:03:26.881232+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 115914.276756 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53398]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:02:18
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53398/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53398/

    "2026-02-18T21:59:09.642927+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 111960.488994 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53399]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:10:03
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53399/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53399/

    "2026-02-18T22:20:00.000175+0000 mon.a (mon.0) 1047 : cluster [WRN]     pg
    5.e is stuck undersized for 60s, current state
    active+recovering+undersized+remapped, last acting [4,5]" in cluster log

[53400]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:41:01
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53400/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53400/

    "2026-02-18T22:00:54.676888+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 121156.707316 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53401]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:55:46
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53401/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53401/

    "2026-02-18T22:00:37.424920+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 102651.013756 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53402]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:22:33
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53402/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53402/

    "2026-02-18T22:40:00.000197+0000 mon.a (mon.0) 2526 : cluster [WRN]     pg
    1.6 is stuck peering for 2m, current state remapped+peering, last acting
    [0,3]" in cluster log

[53403]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:17:04
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53403/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53403/

    "2026-02-18T22:04:29.735759+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 81425.093298 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53404]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:57:58
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53404/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53404/

    "2026-02-18T22:06:09.952840+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 118406.971550 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53405]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:54:46
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53405/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53405/

    "2026-02-18T22:48:55.266201+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 105823.510090 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53406]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:50:44
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53406/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53406/

    "2026-02-19T00:20:00.000161+0000 mon.a (mon.0) 6429 : cluster [WRN]     pg
    3.1c is stuck peering for 2m, current state peering, last acting [5,4,1]"
    in cluster log

[53407]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:55:22
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53407/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53407/

    "2026-02-18T22:49:42.956417+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 125875.511385 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53408]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:11:48
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53408/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53408/

    "2026-02-18T22:51:12.126359+0000 osd.5 (osd.5) 3 : cluster [WRN] OSD bench
    result of 98626.170323 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.5. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53409]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:01:43
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53409/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53409/

    "2026-02-18T22:51:39.928853+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 109557.412521 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53410]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:12:07
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53410/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53410/

    "2026-02-18T22:52:05.414470+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 92114.950984 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53411]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   01:51:55
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53411/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53411/

    "2026-02-18T22:51:37.968780+0000 osd.1 (osd.1) 3 : cluster [WRN] OSD bench
    result of 123704.315842 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.1. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53412]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:38:08
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53412/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53412/

    "2026-02-18T22:51:57.397619+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 113044.634920 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log

[53413]  upgrade:reef-x:stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:11:00
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53413/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53413/

    "2026-02-18T23:20:00.000125+0000 mon.a (mon.0) 1460 : cluster [WRN]     pg
    1.4 is stuck undersized for 71s, current state active+undersized, last
    acting [5,7]" in cluster log

[53414]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic overrides/ignorelist_health}
-----------------------------------------------------------------
time:   02:15:59
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53414/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53414/

    "2026-02-18T22:55:26.347539+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench
    result of 125307.996613 IOPS is not within the threshold limit range of
    1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is
    unchanged at 21500.000000 IOPS. The recommendation is to establish the
    osd's IOPS capacity using other benchmark tools (e.g. Fio) and then
    override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log



Dead
=================================================================
[53390]  upgrade:reef-x:stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity overrides/ignorelist_health}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53390/
log:    https://qa-proxy.ceph.com/teuthology/jcollin-2026-02-17_12:44:00-upgrade:reef-x:stress-split-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53390/

    killed
2026-02-19T03:43:49.574 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 33, in main
    results(args['--archive-dir'], args['--name'], args['--email'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 78, in results
    email_results(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/results.py", line 95, in email_results
    smtp = smtplib.SMTP('localhost')
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/smtplib.py", line 255, in __init__
    (code, msg) = self.connect(host, port)
                  ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/smtplib.py", line 341, in connect
    self.sock = self._get_socket(host, port, self.timeout)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket
    return socket.create_connection((host, port), timeout,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection
    sock.connect(sa)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect
    self._internal_connect(address)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect
    raise _SocketError(err, strerror(err))
ConnectionRefusedError: [Errno 111] Connection refused