Found 24 jobs Missing teuthology log /home/teuthworker/archive/gabrioux-2023-09-06_12:50:39-orch:cephadm-wip-guits-testing-2-2023-09-05-1426-distro-default-smithi/7390001/teuthology.log Found 6 distinct failure reasons Failure: reached maximum tries (301) after waiting for 300 seconds 3 jobs: ['7389985', '7389994', '7389999'] suites intersection: ['1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] suites union: ['1-bootstrap/16.2.0', '1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] Failure: Command failed on smithi019 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.19:/fake /mnt/foo'" 5 jobs: ['7389993', '7389991', '7390006', '7389990', '7389988'] suites intersection: ['0-nvme-loop', '1-start', '3-final}'] suites union: ['0-nvme-loop', '1-start', '2-services/nfs-haproxy-proto', '2-services/nfs-ingress', '2-services/nfs-ingress2', '2-services/nfs-keepalive-only', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] Failure: Command failed on smithi031 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7e80560-4cb9-11ee-9ab3-7b867c8bd7da -- bash -c 'ceph orch upgrade ls'" 4 jobs: ['7389992', '7389998', '7389986', '7390002'] suites intersection: ['4-wait', '5-upgrade-ls'] suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-upgrade/simple', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/classic}', 'mon_election/connectivity}', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04'] Failure: SELinux denials found on ubuntu@smithi116.front.sepia.ceph.com: ['type=AVC msg=audit(1694007811.340:21266): avc: denied { ioctl } for pid=120462 comm="iptables" path="/var/lib/containers/storage/overlay/a38c978c40050b1dcf1fe66881ff9a2d52f63b66b6b662f312004dee085e96be/merged" dev="overlay" ino=2753966 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 1 jobs: ['7390000'] suites: ['agent/off', 'mon_election/classic', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}'] Failure: Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) 3 jobs: ['7390004', '7389995', '7389987'] suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_nfs}'] suites union: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_nfs}'] Dead: None 1 jobs: ['7390001']