2024-03-11T12:07:48.003 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-11T12:07:48.003 INFO:teuthology.results:subset: '1/15' 2024-03-11T12:07:48.003 INFO:teuthology.results:seed: '9290' 2024-03-11T12:48:45.896 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-11T12:48:45.899 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-03-11T13:41:50.425 INFO:teuthology.results:Tests finished! gathering results... 2024-03-11T13:41:57.439 INFO:scrape:Found 99 jobs 2024-03-11T13:41:58.573 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590921/teuthology.log 2024-03-11T13:42:00.230 INFO:scrape:Found 5 distinct failure reasons 2024-03-11T13:42:00.231 INFO:scrape:Failure: Command failed on smithi164 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b0c2aac6a095145a28ab2d96914badf5f65354 pull' 2024-03-11T13:42:00.231 INFO:scrape:1 jobs: ['7590855'] 2024-03-11T13:42:00.231 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'task/test_host_drain}'] 2024-03-11T13:42:00.231 INFO:scrape: 2024-03-11T13:42:00.231 INFO:scrape:Failure: reached maximum tries (51) after waiting for 300 seconds 2024-03-11T13:42:00.231 INFO:scrape:4 jobs: ['7590923', '7590902', '7590879', '7590857'] 2024-03-11T13:42:00.232 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}'] 2024-03-11T13:42:00.232 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy', 'tasks/{0-from/reef/{v18.2.0}', 'tasks/{0-from/v16.2.4'] 2024-03-11T13:42:00.232 INFO:scrape: 2024-03-11T13:42:00.232 INFO:scrape:Dead: None 2024-03-11T13:42:00.232 INFO:scrape:2 jobs: ['7590921', '7590920'] 2024-03-11T13:42:00.232 INFO:scrape: 2024-03-11T13:42:00.232 INFO:scrape:Failure: '2024-03-11T13:25:48.120211+00:00 smithi090 kernel: rcu: INFO: rcu_sched detected stalls on CPUs/tasks: ' in syslog 2024-03-11T13:42:00.233 INFO:scrape:1 jobs: ['7590907'] 2024-03-11T13:42:00.233 INFO:scrape:suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2024-03-11T13:42:00.233 INFO:scrape: 2024-03-11T13:42:00.233 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e1b0c2aac6a095145a28ab2d96914badf5f65354 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2024-03-11T13:42:00.233 INFO:scrape:1 jobs: ['7590899'] 2024-03-11T13:42:00.233 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'task/test_cephadm}'] 2024-03-11T13:42:00.233 INFO:scrape: 2024-03-11T13:42:00.237 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/ failed: 7 dead: 2 running: 0 waiting: 0 queued: 0 passed: 90 Fail ================================================================= [7590855] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_host_drain} ----------------------------------------------------------------- time: 00:20:23 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590855/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590855/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0f8cd82d282a4c8699e200aef0d30a47 Command failed on smithi164 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:e1b0c2aac6a095145a28ab2d96914badf5f65354 pull' [7590857] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:42:35 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590857/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590857/ reached maximum tries (51) after waiting for 300 seconds [7590879] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:42:35 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590879/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590879/ reached maximum tries (51) after waiting for 300 seconds [7590899] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:20:55 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590899/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590899/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fbf18c14a7fb45ae9ac26187d311ba73 Command failed (workunit test cephadm/test_cephadm.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e1b0c2aac6a095145a28ab2d96914badf5f65354 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7590902] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:40:40 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590902/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590902/ reached maximum tries (51) after waiting for 300 seconds [7590907] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:45:07 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590907/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590907/ '2024-03-11T13:25:48.120211+00:00 smithi090 kernel: rcu: INFO: rcu_sched detected stalls on CPUs/tasks: ' in syslog [7590923] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:42:36 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590923/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590923/ reached maximum tries (51) after waiting for 300 seconds Dead ================================================================= [7590920] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590920/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590920/ Error reimaging machines: Failed to power on smithi178 [7590921] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590921/ log: http://qa-proxy.ceph.com/teuthology/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590921/ Error reimaging machines: Failed to power on smithi179 Pass ================================================================= [7590833] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:50:30 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590833/ [7590834] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:14 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590834/ [7590835] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:19:25 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590835/ [7590836] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:46:27 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590836/ [7590837] orch:cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} time: 00:29:17 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590837/ [7590838] orch:cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_rhel8 mon_election/classic task/test_adoption} time: 00:21:00 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590838/ [7590839] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli} time: 00:18:13 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590839/ [7590840] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} time: 00:41:22 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590840/ [7590841] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:16:13 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590841/ [7590842] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:05 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590842/ [7590843] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:45:27 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590843/ [7590844] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:49:27 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590844/ [7590845] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:22:33 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590845/ [7590846] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:18:20 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590846/ [7590847] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:22 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590847/ [7590848] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:23:52 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590848/ [7590849] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:38:52 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590849/ [7590850] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:19:13 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590850/ [7590851] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:28:33 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590851/ [7590852] orch:cephadm/no-agent-workunits/{0-distro/ubuntu_20.04 mon_election/connectivity task/test_cephadm_timeout} time: 00:23:12 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590852/ [7590853] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:24:16 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590853/ [7590854] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:03:36 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590854/ [7590856] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:41:06 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590856/ [7590858] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:21:25 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590858/ [7590859] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:36:44 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590859/ [7590860] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:20:54 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590860/ [7590861] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:13 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590861/ [7590862] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:19:18 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590862/ [7590863] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:19:10 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590863/ [7590864] orch:cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:18:48 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590864/ [7590865] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:25 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590865/ [7590866] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:39:18 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590866/ [7590867] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:42:43 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590867/ [7590868] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:21:31 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590868/ [7590869] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:35:56 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590869/ [7590870] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:03 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590870/ [7590871] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} time: 00:21:21 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590871/ [7590872] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:45:10 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590872/ [7590873] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:27:23 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590873/ [7590874] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:21:07 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590874/ [7590875] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:27:18 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590875/ [7590876] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:20:59 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590876/ [7590877] orch:cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools_crun mon_election/connectivity task/test_orch_cli_mon} time: 00:28:36 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590877/ [7590878] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:43:13 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590878/ [7590880] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:21:05 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590880/ [7590881] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:50:11 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590881/ [7590882] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:22:12 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590882/ [7590883] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:37:19 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590883/ [7590884] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:32 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590884/ [7590885] orch:cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:22:55 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590885/ [7590886] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} time: 00:16:19 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590886/ [7590887] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:20:45 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590887/ [7590888] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:31 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590888/ [7590889] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:20:27 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590889/ [7590890] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:16:14 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590890/ [7590891] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:38 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590891/ [7590892] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:47:01 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590892/ [7590893] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:46:14 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590893/ [7590894] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_ca_signed_key} time: 00:14:32 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590894/ [7590895] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:54 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590895/ [7590896] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:02 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590896/ [7590897] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:49 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590897/ [7590898] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:19:23 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590898/ [7590900] orch:cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_rhel8 mon_election/connectivity task/test_cephadm_timeout} time: 00:24:44 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590900/ [7590901] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:57:55 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590901/ [7590903] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:18:10 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590903/ [7590904] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:35:00 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590904/ [7590905] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:39 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590905/ [7590906] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:18 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590906/ [7590908] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:26:40 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590908/ [7590909] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:47 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590909/ [7590910] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} time: 00:14:02 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590910/ [7590911] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:21:25 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590911/ [7590912] orch:cephadm/no-agent-workunits/{0-distro/ubuntu_20.04 mon_election/classic task/test_orch_cli} time: 00:18:36 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590912/ [7590913] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:44 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590913/ [7590914] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:41:45 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590914/ [7590915] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:39:50 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590915/ [7590916] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:36:16 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590916/ [7590917] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:45 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590917/ [7590918] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:18:45 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590918/ [7590919] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:25 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590919/ [7590922] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:30:14 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590922/ [7590924] orch:cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:28:46 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590924/ [7590925] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:20:24 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590925/ [7590926] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:42:29 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590926/ [7590927] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:31:48 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590927/ [7590928] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_host_drain} time: 00:19:59 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590928/ [7590929] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:34:17 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590929/ [7590930] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:12 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590930/ [7590931] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:52 info: https://pulpito.ceph.com/adking-2024-03-11_12:07:34-orch:cephadm-wip-adk3-testing-2024-03-11-0143-reef-distro-default-smithi/7590931/