Found 111 jobs Missing teuthology log /home/teuthworker/archive/gabrioux-2023-07-27_15:32:12-orch:cephadm-wip-guits-testing-5-2023-07-26-0921-distro-default-smithi/7354604/teuthology.log Found 10 distinct failure reasons Failure: reached maximum tries (301) after waiting for 300 seconds 1 jobs: ['7354569'] suites: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0'] Dead: None 19 jobs: ['7354604', '7354617', '7354659', '7354577', '7354610', '7354598', '7354595', '7354661', '7354662', '7354653', '7354631', '7354605', '7354618', '7354660', '7354644', '7354599', '7354649', '7354652', '7354590'] Failure: Stale jobs detected, aborting. 1 jobs: ['7354581'] suites: ['fixed-2', 'mode/root', 'mon_election/connectivity', 'msgr/async-v2only', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8', 'start', 'tasks/rotate-keys}'] Failure: {"dd: failed to open '/home/ubuntu/.ansible/tmp/ansible-tmp-1690473234.0123048-10153-229378452977024/AnsiballZ_user.py': No such file or directory", 'failed to transfer file to /home/teuthworker/.ansible/tmp/ansible-local-26232qyx3zaaa/tmplj90c2vk /home/ubuntu/.ansible/tmp/ansible-tmp-1690473234.0123048-10153-229378452977024/AnsiballZ_user.py:'} 1 jobs: ['7354579'] suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_nfs}'] Failure: Command failed on smithi172 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:82c085f827575f079a030cf33416b5e78568774f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3ed2080-2ca2-11ee-9b35-001a4aab830c -- ceph orch apply prometheus '1;smithi172=a'" 1 jobs: ['7354655'] suites: ['0-nvme-loop', 'agent/off', 'fixed-2', 'mon_election/connectivity', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'start}'] Dead: b"TypeError: argument of type 'NoneType' is not iterable" 1 jobs: ['7354621'] suites: ['fixed-2', 'mode/packaged', 'mon_election/classic', 'msgr/async-v1only', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0', 'start', 'tasks/rotate-keys}'] Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2 jobs: ['7354620', '7354665'] suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_nfs}'] suites union: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'task/test_nfs}'] Dead: b'2023-07-28T05:17:18.369 DEBUG:teuthology.exit:Finished running handlers' 1 jobs: ['7354657'] suites: ['fixed-2', 'mode/root', 'mon_election/connectivity', 'msgr/async-v2only', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'start', 'tasks/rados_api_tests}'] Failure: SELinux denials found on ubuntu@smithi120.front.sepia.ceph.com: ['type=AVC msg=audit(1690475817.885:20755): avc: denied { ioctl } for pid=112491 comm="iptables" path="/var/lib/containers/storage/overlay/28fd6fa4e60cb361f2aab12c2f7faa1e7bfac6f449769713c26b9aa8e7a47ac7/merged" dev="overlay" ino=2754149 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1690475817.825:20754): avc: denied { ioctl } for pid=112486 comm="iptables" path="/var/lib/containers/storage/overlay/28fd6fa4e60cb361f2aab12c2f7faa1e7bfac6f449769713c26b9aa8e7a47ac7/merged" dev="overlay" ino=2754149 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 1 jobs: ['7354601'] suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}'] Failure: Cannot connect to remote host smithi157 1 jobs: ['7354606'] suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-wait}', 'orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0']