2022-04-21T01:06:58.659 INFO:root:teuthology version: 1.1.0-b37d6865 2022-04-21T01:06:58.659 INFO:teuthology.results:subset: '1/9' 2022-04-21T01:06:58.659 INFO:teuthology.results:seed: '4283' 2022-04-21T01:07:38.425 INFO:root:teuthology version: 1.1.0-b37d6865 2022-04-21T01:07:38.429 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-21T01:48:41.064 INFO:teuthology.results:Tests finished! gathering results... 2022-04-21T01:48:41.216 INFO:scrape:Found 5 jobs 2022-04-21T01:48:41.346 INFO:scrape:Found 1 distinct failure reasons 2022-04-21T01:48:41.346 INFO:scrape:Failure: Command failed on smithi114 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b9367f1c-c110-11ec-8c38-001a4aab830c -e sha1=b8a04373deb68ce97cda9ed3ce573ba2eeca4d79 -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1\'' 2022-04-21T01:48:41.347 INFO:scrape:3 jobs: ['6798331', '6798327', '6798329'] 2022-04-21T01:48:41.347 INFO:scrape:suites intersection: ['2-repo_digest/repo_digest', '3-upgrade/3-staggered-upgrade', '4-wait', '5-upgrade-ls', 'mon_election/connectivity}'] 2022-04-21T01:48:41.347 INFO:scrape:suites union: ['2-repo_digest/repo_digest', '3-upgrade/3-staggered-upgrade', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/connectivity}', 'orch:cephadm:upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04', 'orch:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9'] 2022-04-21T01:48:41.347 INFO:scrape: 2022-04-21T01:48:41.347 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 2 Fail ================================================================= [6798327] orch:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/3-staggered-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:15:00 info: http://pulpito.ceph.com/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/6798327/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/6798327/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bad0463328a44c80a7bc847b5adc9c8d Command failed on smithi019 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1086ca42-c111-11ec-8c38-001a4aab830c -e sha1=b8a04373deb68ce97cda9ed3ce573ba2eeca4d79 -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1\'' [6798329] orch:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/3-staggered-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:16:50 info: http://pulpito.ceph.com/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/6798329/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/6798329/ sentry: https://sentry.ceph.com/organizations/ceph/?query=29b26e97445e4d098c11a97c95709955 Command failed on smithi106 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10daa4d2-c111-11ec-8c38-001a4aab830c -e sha1=b8a04373deb68ce97cda9ed3ce573ba2eeca4d79 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'" [6798331] orch:cephadm:upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/3-staggered-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:12:12 info: http://pulpito.ceph.com/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/6798331/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/6798331/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8315f8801f64168ac4b9396db310186 Command failed on smithi114 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b9367f1c-c110-11ec-8c38-001a4aab830c -e sha1=b8a04373deb68ce97cda9ed3ce573ba2eeca4d79 -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1\'' Pass ================================================================= [6798328] orch:cephadm:upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/3-simple-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:24:17 info: http://pulpito.ceph.com/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/6798328/ [6798330] orch:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/3-simple-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:31:59 info: http://pulpito.ceph.com/adking-2022-04-21_01:06:53-orch:cephadm:upgrade-wip-adk2-testing-2022-04-20-1647-distro-basic-smithi/6798330/