2023-10-03T19:55:59.382 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T19:55:59.382 INFO:teuthology.results:subset: '1/14' 2023-10-03T19:55:59.382 INFO:teuthology.results:seed: '9485' 2023-10-03T21:42:03.812 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T21:42:03.846 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-04T08:37:51.620 INFO:teuthology.results:Tests finished! gathering results... 2023-10-04T08:37:59.907 INFO:scrape:Found 97 jobs 2023-10-04T08:38:03.073 INFO:scrape:Found 3 distinct failure reasons 2023-10-04T08:38:03.073 INFO:scrape:Failure: timeout expired in wait_until_healthy 2023-10-04T08:38:03.073 INFO:scrape:13 jobs: ['7409862', '7409933', '7409904', '7409915', '7409932', '7409944', '7409893', '7409879', '7409889', '7409954', '7409891', '7409863', '7409900'] 2023-10-04T08:38:03.073 INFO:scrape:suites intersection: ['agent/on'] 2023-10-04T08:38:03.074 INFO:scrape:suites union: ['0-nvme-loop', 'agent/on', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'start}', 'task/test_host_drain}', 'task/test_monitoring_stack_basic}', 'task/test_orch_cli_mon}', 'task/test_set_mon_crush_locations}'] 2023-10-04T08:38:03.074 INFO:scrape: 2023-10-04T08:38:03.074 INFO:scrape:Failure: Command failed on smithi112 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c1ac69e02eeb116b5c1ae6b4d41d6927767a5101 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cf7c9378-622d-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json' 2023-10-04T08:38:03.074 INFO:scrape:3 jobs: ['7409886', '7409864', '7409907'] 2023-10-04T08:38:03.074 INFO:scrape:suites intersection: [] 2023-10-04T08:38:03.074 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/17.2.0', '1-start', '2-nfs', '2-services/nfs', '3-final}', '3-upgrade-with-workload', '4-final}', 'fixed-2', 'mode/packaged', 'mon_election/classic', 'msgr/async', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8', 'start', 'tasks/rados_api_tests}'] 2023-10-04T08:38:03.074 INFO:scrape: 2023-10-04T08:38:03.075 INFO:scrape:Dead: b'2023-10-04T08:33:05.643 DEBUG:teuthology.exit:Finished running handlers' 2023-10-04T08:38:03.075 INFO:scrape:1 jobs: ['7409878'] 2023-10-04T08:38:03.075 INFO:scrape:suites: ['2-repo_digest/repo_digest', '3-upgrade/simple', '4-wait', '5-upgrade-ls', 'agent/on', 'mon_election/connectivity}', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04'] 2023-10-04T08:38:03.075 INFO:scrape: 2023-10-04T08:38:03.078 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/ failed: 16 dead: 1 running: 0 waiting: 0 queued: 0 passed: 80 Fail ================================================================= [7409862] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:25:57 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409862/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409862/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c7c2acd323e46a88986ffeed7436ce6 timeout expired in wait_until_healthy [7409863] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_host_drain} ----------------------------------------------------------------- time: 00:29:50 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409863/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409863/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7525113571354cf6b2435c2b6d1d84d4 timeout expired in wait_until_healthy [7409864] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:33:53 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409864/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409864/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6083e320cafc4e799782e01b415ab538 Command failed on smithi005 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8ad6c954-6229-11ee-8db5-212e2dc638e7 -e sha1=c1ac69e02eeb116b5c1ae6b4d41d6927767a5101 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7409879] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic} ----------------------------------------------------------------- time: 00:23:40 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409879/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409879/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90bb3cefe39d44219580f777c91cc45c timeout expired in wait_until_healthy [7409886] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:15:59 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409886/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409886/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0dbb54acc7204313af4f2fdfbd2d854c Command failed on smithi112 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:c1ac69e02eeb116b5c1ae6b4d41d6927767a5101 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cf7c9378-622d-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json' [7409889] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:28:58 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409889/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409889/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e30a812f41564208ba35775dc41187ea timeout expired in wait_until_healthy [7409891] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:19:17 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409891/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409891/ sentry: https://sentry.ceph.com/organizations/ceph/?query=49b336404d394e249d0967729684c9db timeout expired in wait_until_healthy [7409893] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:28:47 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409893/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409893/ sentry: https://sentry.ceph.com/organizations/ceph/?query=108676ffe59e4d58b96ad4221f1cce7e timeout expired in wait_until_healthy [7409900] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:26:13 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409900/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409900/ sentry: https://sentry.ceph.com/organizations/ceph/?query=268439bfb8414bbe9a72bece731fdcbc timeout expired in wait_until_healthy [7409904] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:20:46 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409904/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409904/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f73763e92e8546e1a057e7537be0c88c timeout expired in wait_until_healthy [7409907] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:18:37 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409907/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409907/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf8fca12146c4623b4e785ba15fba576 Command failed on smithi089 with status 127: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:c1ac69e02eeb116b5c1ae6b4d41d6927767a5101 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c77dc490-6231-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json' [7409915] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:17:50 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409915/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409915/ sentry: https://sentry.ceph.com/organizations/ceph/?query=811228f90646459ab0b74b7a686e05a8 timeout expired in wait_until_healthy [7409932] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:24:16 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409932/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409932/ sentry: https://sentry.ceph.com/organizations/ceph/?query=66dd96d2c91942e4b8d3b30a25a3b11a timeout expired in wait_until_healthy [7409933] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_host_drain} ----------------------------------------------------------------- time: 00:27:07 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409933/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409933/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61f57cf4dee842d5b1ebe7e1ae7e6c02 timeout expired in wait_until_healthy [7409944] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_monitoring_stack_basic} ----------------------------------------------------------------- time: 00:22:09 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409944/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409944/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2fe668da3c5d465ea09423a037eaf329 timeout expired in wait_until_healthy [7409954] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:35:39 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409954/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409954/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4af1f7a4fc8e4a469386733c7a8cb338 timeout expired in wait_until_healthy Dead ================================================================= [7409878] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409878/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409878/ hit max job timeout Pass ================================================================= [7409860] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:21:05 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409860/ [7409861] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:38 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409861/ [7409865] orch:cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} time: 00:24:53 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409865/ [7409866] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} time: 00:18:23 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409866/ [7409867] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} time: 00:32:44 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409867/ [7409868] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:17:38 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409868/ [7409869] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:00 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409869/ [7409870] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:19:30 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409870/ [7409871] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:27:46 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409871/ [7409872] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:17 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409872/ [7409873] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:22:15 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409873/ [7409874] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:59:49 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409874/ [7409875] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:21 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409875/ [7409876] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:37:58 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409876/ [7409877] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:04 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409877/ [7409880] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:45 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409880/ [7409881] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:29 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409881/ [7409882] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:14:50 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409882/ [7409883] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:33:14 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409883/ [7409884] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:36:36 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409884/ [7409885] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 00:16:08 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409885/ [7409887] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:30 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409887/ [7409888] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:23 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409888/ [7409890] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:24:34 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409890/ [7409892] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:47 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409892/ [7409894] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:18:57 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409894/ [7409895] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:38:40 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409895/ [7409896] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} time: 00:22:14 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409896/ [7409897] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:17:03 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409897/ [7409898] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:50:55 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409898/ [7409899] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:31:54 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409899/ [7409901] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:59 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409901/ [7409902] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:15 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409902/ [7409903] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:42 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409903/ [7409905] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:19:45 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409905/ [7409906] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:43:58 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409906/ [7409908] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:11:01 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409908/ [7409909] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:40 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409909/ [7409910] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:15:52 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409910/ [7409911] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:22 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409911/ [7409912] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:18:44 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409912/ [7409913] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} time: 00:16:59 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409913/ [7409914] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:18:09 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409914/ [7409916] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:49:41 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409916/ [7409917] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm} time: 00:17:30 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409917/ [7409918] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:14:49 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409918/ [7409919] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:37:25 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409919/ [7409920] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:18 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409920/ [7409921] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:48 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409921/ [7409922] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:25:52 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409922/ [7409923] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:23 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409923/ [7409924] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:51 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409924/ [7409925] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:12:12 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409925/ [7409926] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:20:02 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409926/ [7409927] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:41:43 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409927/ [7409928] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:36:28 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409928/ [7409929] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_extra_daemon_features} time: 00:20:35 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409929/ [7409930] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:02 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409930/ [7409931] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:02 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409931/ [7409934] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:21:47 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409934/ [7409935] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:27:43 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409935/ [7409936] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:18 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409936/ [7409937] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:52 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409937/ [7409938] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:06 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409938/ [7409939] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:47:26 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409939/ [7409940] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:27:57 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409940/ [7409941] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:41 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409941/ [7409942] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:29:42 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409942/ [7409943] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:20 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409943/ [7409945] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:10 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409945/ [7409946] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:58 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409946/ [7409947] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:19:45 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409947/ [7409948] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:37:28 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409948/ [7409949] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:39 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409949/ [7409950] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:21:17 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409950/ [7409951] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:46 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409951/ [7409952] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:49 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409952/ [7409953] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:19:11 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409953/ [7409955] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:25:19 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409955/ [7409956] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:56 info: http://pulpito.ceph.com/adking-2023-10-03_19:55:53-orch:cephadm-wip-adk-testing-2023-10-03-1223-distro-default-smithi/7409956/