Found 17 jobs Found 4 distinct failure reasons Failure: SSH connection to smithi003 was lost: 'uname -r' 3 jobs: ['6634319', '6634323', '6634314'] suites intersection: ['ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{ubuntu_18.04}', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashosds-health', 'three-plus-one}'] suites union: ['1-install/jewel-v1only', '1-install/mimic', '1-install/nautilus-v2only', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{ubuntu_18.04}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashers/default', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/test_rbd_api}'] Failure: Command failed on smithi043 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8bf0cf44f8b7544e0e46094d1d10c45070697f32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 364035fc-7ba2-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi043:vg_nvme/lv_4' 7 jobs: ['6634328', '6634316', '6634326', '6634321', '6634313', '6634325', '6634327'] suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{ubuntu_18.04}', 'rados', 'thrashosds-health', 'three-plus-one}'] suites union: ['1-install/jewel', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/off', 'distro$/{ubuntu_18.04}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] Failure: Command failed on smithi060 with status 5: 'sudo systemctl stop ceph-b05200ec-7ba1-11ec-8c35-001a4aab830c@mon.a' 2 jobs: ['6634324', '6634317'] suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2}', 'rados/cephadm/upgrade/{1-start-distro/1-start-centos_8'] suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'fixed-2}', 'rados/cephadm/upgrade/{1-start-distro/1-start-centos_8'] Failure: "2022-01-22T18:18:54.031065+0000 mds.a (mds.0) 2 : cluster [WRN] evicting unresponsive client smithi125: (104111), after 304.505 seconds" in cluster log 1 jobs: ['6634320'] suites: ['1-install/mimic', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'rados/upgrade/mimic-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_18.04}']