2023-07-26T11:23:08.961 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T11:23:08.975 INFO:teuthology.results:subset: '1/8' 2023-07-26T11:23:08.976 INFO:teuthology.results:seed: '9062' 2023-07-26T11:27:22.841 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T11:27:22.844 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-26T12:29:27.661 INFO:teuthology.results:Tests finished! gathering results... 2023-07-26T12:29:27.975 INFO:scrape:Found 6 jobs 2023-07-26T12:29:29.030 INFO:scrape:Found 2 distinct failure reasons 2023-07-26T12:29:29.031 INFO:scrape:Failure: Command failed on smithi097 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a2a957ec-2ba9-11ee-9b35-001a4aab830c -- bash -c 'ceph orch upgrade ls'" 2023-07-26T12:29:29.031 INFO:scrape:4 jobs: ['7352852', '7352853', '7352855', '7352854'] 2023-07-26T12:29:29.032 INFO:scrape:suites intersection: ['4-wait', '5-upgrade-ls'] 2023-07-26T12:29:29.032 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-upgrade/simple', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/classic}', 'mon_election/connectivity}', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04'] 2023-07-26T12:29:29.032 INFO:scrape: 2023-07-26T12:29:29.033 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2023-07-26T12:29:29.033 INFO:scrape:2 jobs: ['7352856', '7352851'] 2023-07-26T12:29:29.033 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}'] 2023-07-26T12:29:29.034 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0'] 2023-07-26T12:29:29.034 INFO:scrape: 2023-07-26T12:29:29.034 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [7352851] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:39:02 info: http://pulpito.ceph.com/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352851/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352851/ sentry: https://sentry.ceph.com/organizations/ceph/?query=669888cee4f64231a7ab145481c4a465 reached maximum tries (301) after waiting for 300 seconds [7352852] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:45:17 info: http://pulpito.ceph.com/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352852/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352852/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd8c3a712a5e43a584e9ebf40f96f7c4 Command failed on smithi097 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a2a957ec-2ba9-11ee-9b35-001a4aab830c -- bash -c 'ceph orch upgrade ls'" [7352853] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:36:25 info: http://pulpito.ceph.com/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352853/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352853/ sentry: https://sentry.ceph.com/organizations/ceph/?query=666fa5498bff47f08303e5392eacc70a Command failed on smithi090 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 80ca2778-2ba9-11ee-9b35-001a4aab830c -- bash -c 'ceph orch upgrade ls'" [7352854] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:46:18 info: http://pulpito.ceph.com/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352854/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352854/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b7f6b563615743de9c89d9ccd922e574 Command failed on smithi008 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cf0cadba-2baa-11ee-9b35-001a4aab830c -- bash -c 'ceph orch upgrade ls'" [7352855] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:35:03 info: http://pulpito.ceph.com/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352855/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352855/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e92b67c27abd46b5a8f43f9807146d07 Command failed on smithi069 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 70c6570c-2ba9-11ee-9b35-001a4aab830c -- bash -c 'ceph orch upgrade ls'" [7352856] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:29:17 info: http://pulpito.ceph.com/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352856/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352856/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5cb4d0d65fcc4b12bf589623a6d33808 reached maximum tries (301) after waiting for 300 seconds