2023-07-11T16:35:58.583 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T16:35:58.584 INFO:teuthology.results:subset: '1/14' 2023-07-11T16:35:58.584 INFO:teuthology.results:seed: '7277' 2023-07-11T18:19:09.180 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T18:19:09.209 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-11T19:10:13.632 INFO:teuthology.results:Tests finished! gathering results... 2023-07-11T19:10:19.991 INFO:scrape:Found 93 jobs 2023-07-11T19:10:19.996 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333944/teuthology.log 2023-07-11T19:10:20.602 INFO:scrape:Found 3 distinct failure reasons 2023-07-11T19:10:20.603 INFO:scrape:Dead: None 2023-07-11T19:10:20.603 INFO:scrape:1 jobs: ['7333944'] 2023-07-11T19:10:20.604 INFO:scrape: 2023-07-11T19:10:20.604 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2023-07-11T19:10:20.604 INFO:scrape:1 jobs: ['7333984'] 2023-07-11T19:10:20.604 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun'] 2023-07-11T19:10:20.605 INFO:scrape: 2023-07-11T19:10:20.605 INFO:scrape:Failure: Test failure: test_apply_mon_three (tasks.cephadm_cases.test_cli_mon.TestCephadmCLI) 2023-07-11T19:10:20.605 INFO:scrape:1 jobs: ['7333950'] 2023-07-11T19:10:20.606 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_orch_cli_mon}'] 2023-07-11T19:10:20.606 INFO:scrape: 2023-07-11T19:10:20.610 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/ failed: 2 dead: 1 running: 0 waiting: 0 queued: 0 passed: 90 Fail ================================================================= [7333950] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:33:29 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333950/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333950/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a6760315ede45d1a11aff9594e23818 Test failure: test_apply_mon_three (tasks.cephadm_cases.test_cli_mon.TestCephadmCLI) [7333984] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:28:30 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333984/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333984/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d084d7b05fe84cd0aae751d1bcece82f reached maximum tries (301) after waiting for 300 seconds Dead ================================================================= [7333944] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333944/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333944/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7333925] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:47:28 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333925/ [7333926] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:09 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333926/ [7333927] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:48 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333927/ [7333928] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:11 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333928/ [7333929] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:30:56 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333929/ [7333930] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:42:39 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333930/ [7333931] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} time: 00:21:17 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333931/ [7333932] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:43:08 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333932/ [7333933] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:15:17 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333933/ [7333934] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:05 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333934/ [7333935] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:40:46 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333935/ [7333936] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:04 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333936/ [7333937] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:08:33 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333937/ [7333938] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_nfs} time: 00:38:19 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333938/ [7333939] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:22:37 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333939/ [7333940] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:38:50 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333940/ [7333941] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:37:05 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333941/ [7333942] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:22:47 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333942/ [7333943] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:20:59 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333943/ [7333945] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 00:19:40 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333945/ [7333946] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:36:33 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333946/ [7333947] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:22:18 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333947/ [7333948] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:33:38 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333948/ [7333949] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:43:50 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333949/ [7333951] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:50 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333951/ [7333952] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:30:30 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333952/ [7333953] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:45 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333953/ [7333954] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:25:00 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333954/ [7333955] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:26:52 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333955/ [7333956] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:49 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333956/ [7333957] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} time: 00:32:00 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333957/ [7333958] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:38:29 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333958/ [7333959] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:25:14 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333959/ [7333960] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:43 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333960/ [7333961] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:46:14 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333961/ [7333962] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:39:51 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333962/ [7333963] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:32:35 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333963/ [7333964] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:40:27 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333964/ [7333965] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:20:55 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333965/ [7333966] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:24:12 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333966/ [7333967] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:46 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333967/ [7333968] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:49 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333968/ [7333969] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:44:44 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333969/ [7333970] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:46:25 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333970/ [7333971] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_adoption} time: 00:23:12 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333971/ [7333972] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:21:59 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333972/ [7333973] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:40 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333973/ [7333974] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} time: 00:20:29 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333974/ [7333975] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:32:03 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333975/ [7333976] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:23 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333976/ [7333977] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli} time: 00:19:02 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333977/ [7333978] orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:20:09 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333978/ [7333979] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:37 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333979/ [7333980] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:55:24 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333980/ [7333981] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:35:22 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333981/ [7333982] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:09 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333982/ [7333983] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:07 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333983/ [7333985] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:12 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333985/ [7333986] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:26:24 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333986/ [7333987] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:18:59 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333987/ [7333988] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:31 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333988/ [7333989] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:06 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333989/ [7333990] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:20:03 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333990/ [7333991] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:45:34 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333991/ [7333992] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:38:40 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333992/ [7333993] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:39:09 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333993/ [7333994] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:48 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333994/ [7333995] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:16 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333995/ [7333996] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:21:23 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333996/ [7333997] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:30:35 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333997/ [7333998] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:29:58 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333998/ [7333999] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:15:47 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7333999/ [7334000] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:59 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334000/ [7334001] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:23 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334001/ [7334002] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:45:34 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334002/ [7334003] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:28:02 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334003/ [7334004] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} time: 00:33:30 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334004/ [7334005] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:52 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334005/ [7334006] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:33:38 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334006/ [7334007] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:37 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334007/ [7334008] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:48 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334008/ [7334009] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:21:33 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334009/ [7334010] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} time: 00:18:50 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334010/ [7334011] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:18:24 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334011/ [7334012] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:37:17 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334012/ [7334013] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:17 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334013/ [7334014] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:33:19 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334014/ [7334015] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:36:06 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334015/ [7334016] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:20:32 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334016/ [7334017] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:05 info: http://pulpito.ceph.com/adking-2023-07-11_16:35:52-orch:cephadm-wip-adk-testing-2023-07-11-0946-distro-default-smithi/7334017/