Found 90 jobs
Found 7 distinct failure reasons
Failure: Command failed on smithi038 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:445562ab4bc3ddfb386936119050695810860bcb shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e6ad3b04-b3f6-11ee-95ad-87774f69a715 -- ceph orch daemon add osd smithi038:/dev/nvme4n1'
20 jobs: ['7517255', '7517220', '7517208', '7517267', '7517259', '7517224', '7517237', '7517231', '7517270', '7517274', '7517215', '7517281', '7517252', '7517247', '7517212', '7517286', '7517291', '7517227', '7517263', '7517242']
suites intersection: ['fixed-2', 'rados/cephadm/smoke/{0-nvme-loop', 'start}']
suites union: ['distro/centos_8.stream_container_tools', 'distro/rhel_8.6_container_tools_3.0', 'distro/rhel_8.6_container_tools_rhel8', 'distro/ubuntu_18.04', 'distro/ubuntu_20.04', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/smoke/{0-nvme-loop', 'start}']

Failure: reached maximum tries (121) after waiting for 120 seconds
41 jobs
suites intersection: ['0-nvme-loop', '1-start']
suites union: ['0-nvme-loop', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/mirror', '2-services/nfs', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs2', '2-services/rgw', '2-services/rgw-ingress', '3-final}', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/osds/{0-distro/ubuntu_18.04', 'rados/cephadm/osds/{0-distro/ubuntu_20.04', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04']

Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi049 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=445562ab4bc3ddfb386936119050695810860bcb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
4 jobs: ['7517262', '7517219', '7517240', '7517284']
suites intersection: ['task/test_e2e}']
suites union: ['rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}']

Failure: Command failed on smithi087 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a5c4760-b3f7-11ee-95ad-87774f69a715 -e sha1=445562ab4bc3ddfb386936119050695810860bcb -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''
2 jobs: ['7517250', '7517295']
suites intersection: ['1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools']
suites union: ['1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools']

Timeout 6h running clone.client.0/qa/workunits/rados/test.sh
1 jobs: ['7517225']
suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']

Failure: "2024-01-15T22:51:28.212517+0000 mon.a (mon.0) 474 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log
3 jobs: ['7517234', '7517217', '7517287']
suites intersection: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/few', 'openstack}', 'rados']
suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'validater/lockdep}']

Dead: b'2024-01-16T10:13:32.665 DEBUG:teuthology.exit:Finished running handlers'
1 jobs: ['7517223']
suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-wait}', 'rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0']