2023-11-16T07:44:54.617 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T07:44:54.617 INFO:teuthology.results:subset: '1/8' 2023-11-16T07:44:54.617 INFO:teuthology.results:seed: '5882' 2023-11-16T07:45:39.798 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T07:45:39.798 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-16T08:25:42.592 INFO:teuthology.results:Tests finished! gathering results... 2023-11-16T08:25:42.736 INFO:scrape:Found 5 jobs 2023-11-16T08:25:42.871 INFO:scrape:Found 2 distinct failure reasons 2023-11-16T08:25:42.871 INFO:scrape:Failure: Command failed on smithi023 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f2694c0fc460010cfe2486d4bfef69bee634c41 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5bf07a-8456-11ee-8dbe-212e2dc638e7 -- ceph rgw realm bootstrap -i -' 2023-11-16T08:25:42.871 INFO:scrape:4 jobs: ['7460407', '7460410', '7460405', '7460411'] 2023-11-16T08:25:42.871 INFO:scrape:suites intersection: [] 2023-11-16T08:25:42.871 INFO:scrape:suites union: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'agent/off', 'mon_election/classic', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_rgw_multisite}'] 2023-11-16T08:25:42.872 INFO:scrape: 2023-11-16T08:25:42.872 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi155.front.sepia.ceph.com: ['type=AVC msg=audit(1700122181.773:21456): avc: denied { ioctl } for pid=120511 comm="iptables" path="/var/lib/containers/storage/overlay/55a5ebfc3b269743e83ec5ee4b1f2de59137dff294d10cc3d5a8747300ba4e61/merged" dev="overlay" ino=2754480 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2023-11-16T08:25:42.872 INFO:scrape:1 jobs: ['7460409'] 2023-11-16T08:25:42.872 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}'] 2023-11-16T08:25:42.872 INFO:scrape: 2023-11-16T08:25:42.872 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [7460405] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:31:45 info: https://pulpito.ceph.com/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460405/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460405/ sentry: https://sentry.ceph.com/organizations/ceph/?query=caf64a936f97447c85b1458270a185d5 Command failed on smithi145 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4af36514-8456-11ee-8dbe-212e2dc638e7 -e sha1=8f2694c0fc460010cfe2486d4bfef69bee634c41 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7460407] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:17:49 info: https://pulpito.ceph.com/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460407/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460407/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6bd5e89b620346e7a5ac7b9e578f1883 Command failed on smithi023 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:8f2694c0fc460010cfe2486d4bfef69bee634c41 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5bf07a-8456-11ee-8dbe-212e2dc638e7 -- ceph rgw realm bootstrap -i -' [7460409] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:20:45 info: https://pulpito.ceph.com/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460409/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460409/ SELinux denials found on ubuntu@smithi155.front.sepia.ceph.com: ['type=AVC msg=audit(1700122181.773:21456): avc: denied { ioctl } for pid=120511 comm="iptables" path="/var/lib/containers/storage/overlay/55a5ebfc3b269743e 83ec5ee4b1f2de59137dff294d10cc3d5a8747300ba4e61/merged" dev="overlay" ino=2754480 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7460410] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:18:48 info: https://pulpito.ceph.com/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460410/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460410/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1abf56a4c2234b2c86de1c0e7955481a Command failed on smithi026 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:8f2694c0fc460010cfe2486d4bfef69bee634c41 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6910a740-8457-11ee-8dbe-212e2dc638e7 -- ceph rgw realm bootstrap -i -' [7460411] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:20:09 info: https://pulpito.ceph.com/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460411/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-11-16_07:44:44-orch:cephadm-wip-guits-fix-cv-raw-list-distro-default-smithi/7460411/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c83f322d4279455b9727416b37219fa5 Command failed on smithi044 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:8f2694c0fc460010cfe2486d4bfef69bee634c41 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid eb31345c-8456-11ee-8dbe-212e2dc638e7 -- ceph rgw realm bootstrap -i -'