2023-07-04T03:18:56.248 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-04T03:18:56.249 INFO:teuthology.results:subset: '1/14' 2023-07-04T03:18:56.249 INFO:teuthology.results:seed: '3198' 2023-07-04T04:35:19.266 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-04T04:35:19.290 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-04T05:24:23.500 INFO:teuthology.results:Tests finished! gathering results... 2023-07-04T05:24:29.270 INFO:scrape:Found 93 jobs 2023-07-04T05:24:29.271 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325904/teuthology.log 2023-07-04T05:24:29.507 INFO:scrape:Found 2 distinct failure reasons 2023-07-04T05:24:29.508 INFO:scrape:Dead: None 2023-07-04T05:24:29.509 INFO:scrape:3 jobs: ['7325904', '7325823', '7325858'] 2023-07-04T05:24:29.509 INFO:scrape: 2023-07-04T05:24:29.509 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2023-07-04T05:24:29.510 INFO:scrape:1 jobs: ['7325880'] 2023-07-04T05:24:29.510 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun'] 2023-07-04T05:24:29.510 INFO:scrape: 2023-07-04T05:24:29.516 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/ failed: 1 dead: 3 running: 0 waiting: 0 queued: 0 passed: 89 Fail ================================================================= [7325880] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:29:14 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325880/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b44313dc78014d3cb826c9737e6b575d reached maximum tries (301) after waiting for 300 seconds Dead ================================================================= [7325823] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325823/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325823/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7325858] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325858/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325858/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds [7325904] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325904/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325904/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7325821] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:45:55 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325821/ [7325822] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:39 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325822/ [7325824] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:16:17 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325824/ [7325825] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:22:43 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325825/ [7325826] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:39:12 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325826/ [7325827] orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} time: 00:13:40 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325827/ [7325828] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:32:56 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325828/ [7325829] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:12:57 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325829/ [7325830] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:12:44 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325830/ [7325831] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:31:22 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325831/ [7325832] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:15:55 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325832/ [7325833] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:12:41 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325833/ [7325834] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_nfs} time: 00:38:19 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325834/ [7325835] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:21:11 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325835/ [7325836] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:38:21 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325836/ [7325837] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:36:25 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325837/ [7325838] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:52 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325838/ [7325839] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:53 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325839/ [7325840] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:20:30 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325840/ [7325841] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 00:18:20 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325841/ [7325842] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:48 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325842/ [7325843] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:20:37 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325843/ [7325844] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:40:50 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325844/ [7325845] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:36:43 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325845/ [7325846] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:31:18 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325846/ [7325847] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:15:50 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325847/ [7325848] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:26:01 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325848/ [7325849] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:17 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325849/ [7325850] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:23 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325850/ [7325851] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:21 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325851/ [7325852] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:14:15 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325852/ [7325853] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} time: 00:30:23 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325853/ [7325854] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:43:02 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325854/ [7325855] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:28:29 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325855/ [7325856] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:36 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325856/ [7325857] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:45:13 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325857/ [7325859] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:23:20 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325859/ [7325860] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:39:21 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325860/ [7325861] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:24 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325861/ [7325862] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:09 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325862/ [7325863] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:19 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325863/ [7325864] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:47 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325864/ [7325865] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:42:32 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325865/ [7325866] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:41:53 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325866/ [7325867] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_adoption} time: 00:19:23 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325867/ [7325868] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:19:27 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325868/ [7325869] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:45 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325869/ [7325870] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} time: 00:18:43 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325870/ [7325871] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:13 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325871/ [7325872] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:14:51 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325872/ [7325873] orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} time: 00:13:14 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325873/ [7325874] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:13:52 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325874/ [7325875] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:12:53 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325875/ [7325876] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:51:22 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325876/ [7325877] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:35:42 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325877/ [7325878] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:49 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325878/ [7325879] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:34 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325879/ [7325881] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:23 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325881/ [7325882] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:27:19 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325882/ [7325883] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:08 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325883/ [7325884] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:34:24 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325884/ [7325885] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:20:18 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325885/ [7325886] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:18:40 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325886/ [7325887] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:45:32 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325887/ [7325888] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:41:03 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325888/ [7325889] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:38:44 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325889/ [7325890] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:42 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325890/ [7325891] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:45 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325891/ [7325892] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:21:46 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325892/ [7325893] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:49 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325893/ [7325894] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:33:53 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325894/ [7325895] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:16:19 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325895/ [7325896] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:02 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325896/ [7325897] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:12:39 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325897/ [7325898] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:36:15 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325898/ [7325899] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:27:42 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325899/ [7325900] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} time: 00:34:44 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325900/ [7325901] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:30 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325901/ [7325902] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:28:29 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325902/ [7325903] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:00 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325903/ [7325905] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:25:46 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325905/ [7325906] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} time: 00:18:56 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325906/ [7325907] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:17:35 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325907/ [7325908] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:44:02 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325908/ [7325909] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:34 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325909/ [7325910] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:26:39 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325910/ [7325911] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:29 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325911/ [7325912] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:20:49 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325912/ [7325913] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:12 info: http://pulpito.ceph.com/adking-2023-07-03_21:57:12-orch:cephadm-wip-adk4-testing-2023-07-03-1544-distro-default-smithi/7325913/