2026-02-16T23:57:14.689 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-16T23:57:14.690 INFO:teuthology.results:subset: '110/12000' 2026-02-16T23:57:14.690 INFO:teuthology.results:seed: '4155' 2026-02-17T00:14:02.936 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-17T00:14:02.942 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2026-02-17T12:14:58.217 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2026-02-17T12:15:00.041 INFO:scrape:Found 84 jobs 2026-02-17T12:15:00.042 WARNING:scrape:Missing teuthology log /home/teuthworker/mnt/teuthology/dgalloway-2026-02-13_23:06:25-orch:cephadm-wip-squid-pr-67199-kefu-1-distro-default-trial/50329/teuthology.log 2026-02-17T12:15:00.885 INFO:scrape:Found 7 distinct failure reasons 2026-02-17T12:15:00.885 INFO:scrape:Dead: None 2026-02-17T12:15:00.885 INFO:scrape:6 jobs: ['50329', '50363', '50362', '50333', '50364', '50359'] 2026-02-17T12:15:00.885 INFO:scrape: 2026-02-17T12:15:00.885 INFO:scrape:Dead: b'2026-02-17T06:07:03.430 DEBUG:teuthology.exit:Finished running handlers' 2026-02-17T12:15:00.885 INFO:scrape:4 jobs: ['50361', '50376', '50408', '50349'] 2026-02-17T12:15:00.885 INFO:scrape:suites intersection: [] 2026-02-17T12:15:00.885 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/17.2.0', '1-start', '2-nfs', '2-repo_digest/defaut', '2-services/rgw-ingress', '3-final}', '3-upgrade-with-workload', '3-upgrade/simple', '4-final}', '4-wait', '5-upgrade-ls', 'agent/on', 'mon_election/classic', 'mon_election/connectivity}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream', 'orch:cephadm/smoke-roleless/{0-distro/centos_9.stream', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream', 'orch:cephadm/workunits/{0-distro/centos_9.stream', 'task/test_iscsi_container/{centos_9.stream', 'test_iscsi_container}}'] 2026-02-17T12:15:00.885 INFO:scrape: 2026-02-17T12:15:00.885 INFO:scrape:Failure: "grep: /var/log/ceph/74579df4-0b98-11f1-9fb9-d404e6e7d460/ceph.log: No such file or directory" in cluster log 2026-02-17T12:15:00.885 INFO:scrape:3 jobs: ['50394', '50330', '50366'] 2026-02-17T12:15:00.885 INFO:scrape:suites intersection: ['1-volume/{0-create', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/quincy'] 2026-02-17T12:15:00.885 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/fuse', '2-client/kclient', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/quincy'] 2026-02-17T12:15:00.885 INFO:scrape: 2026-02-17T12:15:00.885 INFO:scrape:Failure: "2026-02-17T00:13:31.081639+0000 mon.trial167 (mon.0) 281 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log 2026-02-17T12:15:00.885 INFO:scrape:1 jobs: ['50357'] 2026-02-17T12:15:00.885 INFO:scrape:suites: ['1-start', '2-services/basic', '3-final}', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream}'] 2026-02-17T12:15:00.886 INFO:scrape: 2026-02-17T12:15:00.886 INFO:scrape:Failure: Command failed on trial042 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:05b55d192f002ad5df41409624b8d176527d0841 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d39beff5-0b95-11f1-9f0d-d404e6e7d460 -- bash -c 'ceph orch apply nvmeof foo'" 2026-02-17T12:15:00.886 INFO:scrape:3 jobs: ['50373', '50334', '50388'] 2026-02-17T12:15:00.886 INFO:scrape:suites intersection: [] 2026-02-17T12:15:00.886 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-repo_digest/repo_digest', '2-services/nvmeof', '3-final}', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/classic}', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04'] 2026-02-17T12:15:00.886 INFO:scrape: 2026-02-17T12:15:00.886 INFO:scrape:Failure: Failed to reconnect to trial102 2026-02-17T12:15:00.886 INFO:scrape:1 jobs: ['50344'] 2026-02-17T12:15:00.886 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress-rgw-bucket', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc'] 2026-02-17T12:15:00.886 INFO:scrape: 2026-02-17T12:15:00.886 INFO:scrape:Failure: "2026-02-17T00:12:58.353060+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 123665.137891 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.0. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log 2026-02-17T12:15:00.886 INFO:scrape:1 jobs: ['50353'] 2026-02-17T12:15:00.886 INFO:scrape:suites: ['cluster/{fixed-3', 'conf/{disable-pool-app}', 'openstack}', 'orch:cephadm/rbd_iscsi/{base/install', 'supported-container-hosts$/{centos_9.stream}', 'workloads/cephadm_iscsi}'] 2026-02-17T12:15:00.886 INFO:scrape: