2023-07-11T12:57:42.286 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T12:57:42.287 INFO:teuthology.results:subset: '1/8' 2023-07-11T12:57:42.287 INFO:teuthology.results:seed: '5540' 2023-07-11T13:18:50.203 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T13:18:50.207 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-11T14:22:55.533 INFO:teuthology.results:Tests finished! gathering results... 2023-07-11T14:22:56.960 INFO:scrape:Found 31 jobs 2023-07-11T14:22:58.151 INFO:scrape:Found 2 distinct failure reasons 2023-07-11T14:22:58.153 INFO:scrape:Failure: Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) 2023-07-11T14:22:58.153 INFO:scrape:3 jobs: ['7333736', '7333724', '7333712'] 2023-07-11T14:22:58.154 INFO:scrape:suites intersection: ['task/test_nfs}'] 2023-07-11T14:22:58.154 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0', 'task/test_nfs}'] 2023-07-11T14:22:58.155 INFO:scrape: 2023-07-11T14:22:58.156 INFO:scrape:Failure: Command failed on smithi007 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t' 2023-07-11T14:22:58.156 INFO:scrape:1 jobs: ['7333714'] 2023-07-11T14:22:58.157 INFO:scrape:suites: ['base/install', 'cluster/{fixed-3', 'openstack}', 'orch:cephadm/rbd_iscsi/{0-single-container-host', 'workloads/cephadm_iscsi}'] 2023-07-11T14:22:58.157 INFO:scrape: 2023-07-11T14:22:58.158 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 27 Fail ================================================================= [7333712] orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:27:38 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333712/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333712/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39c54941b5514fd896d5ed7e2abcd188 Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) [7333714] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:35:36 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333714/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333714/ sentry: https://sentry.ceph.com/organizations/ceph/?query=37f009f124c447bcb27e6e2159cdc8bd Command failed on smithi007 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t' [7333724] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:24:14 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333724/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333724/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc2caa22f2074ad98ce63c63e45f2815 Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) [7333736] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:24:49 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333736/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333736/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3c4978f2e254b0eb3013848e624f667 Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) Pass ================================================================= [7333711] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:41 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333711/ [7333713] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:20:27 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333713/ [7333715] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:57:00 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333715/ [7333716] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:27 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333716/ [7333717] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:25:45 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333717/ [7333718] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:32 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333718/ [7333719] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:25:13 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333719/ [7333720] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:27:01 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333720/ [7333721] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:36:48 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333721/ [7333722] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:35:42 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333722/ [7333723] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:26:39 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333723/ [7333725] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:39:14 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333725/ [7333726] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:44:10 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333726/ [7333727] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:44:52 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333727/ [7333728] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} time: 00:21:27 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333728/ [7333729] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:28 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333729/ [7333730] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:20:51 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333730/ [7333731] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:43:18 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333731/ [7333732] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} time: 00:16:33 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333732/ [7333733] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:34:30 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333733/ [7333734] orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} time: 00:10:55 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333734/ [7333735] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:21:03 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333735/ [7333737] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:56:35 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333737/ [7333738] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:27:27 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333738/ [7333739] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:44:58 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333739/ [7333740] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:09 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333740/ [7333741] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:40:04 info: http://pulpito.ceph.com/gabrioux-2023-07-11_12:54:10-orch:cephadm-cv-bluestore-rdr-quincy-distro-default-smithi/7333741/