2024-01-31T15:49:36.573 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-31T15:49:36.573 INFO:teuthology.results:subset: '111/120000' 2024-01-31T15:49:36.573 INFO:teuthology.results:seed: '4163' 2024-01-31T16:59:25.960 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-31T16:59:25.964 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-31T17:28:28.167 INFO:teuthology.results:Tests finished! gathering results... 2024-01-31T17:28:28.698 INFO:scrape:Found 26 jobs 2024-01-31T17:28:29.018 INFO:scrape:Found 1 distinct failure reasons 2024-01-31T17:28:29.018 INFO:scrape:Failure: "2024-01-31T16:09:50.034691+0000 mon.smithi026 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log 2024-01-31T17:28:29.018 INFO:scrape:9 jobs: ['7540406', '7540400', '7540410', '7540413', '7540402', '7540412', '7540422', '7540418', '7540421'] 2024-01-31T17:28:29.018 INFO:scrape:suites intersection: [] 2024-01-31T17:28:29.018 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', 'agent/off', 'agent/on', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados:cephadm/osds/{0-distro/centos_8.stream_container_tools', 'rados:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'rados:cephadm/osds/{0-distro/ubuntu_20.04', 'rados:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'rados:cephadm/smoke/{0-distro/ubuntu_20.04', 'rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'rados:cephadm/workunits/{0-distro/ubuntu_20.04', 'start}', 'task/test_orch_cli_mon}', 'task/test_set_mon_crush_locations}'] 2024-01-31T17:28:29.018 INFO:scrape: 2024-01-31T17:28:29.019 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/ failed: 9 dead: 0 running: 0 waiting: 0 queued: 0 passed: 17 Fail ================================================================= [7540400] rados:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:24:29 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540400/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540400/ "2024-01-31T16:09:14.409681+0000 mon.a (mon.0) 180 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log [7540402] rados:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:14:57 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540402/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540402/ "2024-01-31T16:08:10.233802+0000 mon.smithi078 (mon.0) 258 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log [7540406] rados:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:16:58 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540406/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540406/ "2024-01-31T16:09:50.034691+0000 mon.smithi026 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log [7540410] rados:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:14:41 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540410/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540410/ "2024-01-31T16:13:27.783050+0000 mon.smithi042 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log [7540412] rados:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:19:08 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540412/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540412/ "2024-01-31T16:23:36.339325+0000 mon.a (mon.0) 175 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log [7540413] rados:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:37:38 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540413/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540413/ "2024-01-31T16:40:52.559974+0000 mon.a (mon.0) 427 : cluster 3 [WRN] MON_DOWN: 1/5 mons down, quorum a,e,c,d" in cluster log [7540418] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:18:34 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540418/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540418/ "2024-01-31T16:52:08.342236+0000 mon.a (mon.0) 248 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log [7540421] rados:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:24:05 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540421/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540421/ "2024-01-31T17:04:41.196001+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log [7540422] rados:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:18:35 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540422/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540422/ "2024-01-31T17:09:37.481178+0000 mon.smithi027 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log Pass ================================================================= [7540401] rados:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm} time: 00:18:18 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540401/ [7540403] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:07:26 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540403/ [7540404] rados:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:53 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540404/ [7540405] rados:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:16:52 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540405/ [7540407] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_extra_daemon_features} time: 00:15:55 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540407/ [7540408] rados:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:14 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540408/ [7540409] rados:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:10 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540409/ [7540411] rados:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} time: 00:17:42 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540411/ [7540414] rados:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:31 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540414/ [7540415] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite} time: 00:16:33 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540415/ [7540416] rados:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:08 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540416/ [7540417] rados:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:14:45 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540417/ [7540419] rados:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:01 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540419/ [7540420] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} time: 00:11:16 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540420/ [7540423] rados:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:22:00 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540423/ [7540424] rados:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:49 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540424/ [7540425] rados:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} time: 00:22:05 info: https://pulpito.ceph.com/yuriw-2024-01-31_15:48:29-rados:cephadm-main-distro-default-smithi/7540425/