2024-04-09T06:13:01.615 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-09T06:13:01.615 INFO:teuthology.results:subset: '111/120000'
2024-04-09T06:13:01.615 INFO:teuthology.results:seed: '2064'
2024-04-09T11:26:58.997 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-09T11:26:59.021 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-04-09T22:13:56.242 INFO:teuthology.results:Tests finished! gathering results...
2024-04-09T22:14:09.374 INFO:scrape:Found 168 jobs
2024-04-09T22:14:14.884 INFO:scrape:Found 7 distinct failure reasons
2024-04-09T22:14:14.884 INFO:scrape:Failure: Command failed on smithi029 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"
2024-04-09T22:14:14.884 INFO:scrape:4 jobs: ['7647111', '7647281', '7647198', '7647397']
2024-04-09T22:14:14.884 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_20.04']
2024-04-09T22:14:14.885 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}']
2024-04-09T22:14:14.885 INFO:scrape:
2024-04-09T22:14:14.885 INFO:scrape:Failure: reached maximum tries (51) after waiting for 300 seconds
2024-04-09T22:14:14.885 INFO:scrape:5 jobs: ['7647040', '7647361', '7647120', '7647448', '7647233']
2024-04-09T22:14:14.885 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/yes', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}']
2024-04-09T22:14:14.885 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/yes', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/quincy', 'tasks/{0-from/reef/{v18.2.1}']
2024-04-09T22:14:14.886 INFO:scrape:
2024-04-09T22:14:14.886 INFO:scrape:Failure: '2024-04-09T08:42:24.006972+00:00 smithi019 kernel: rcu: INFO: rcu_sched self-detected stall on CPU
' in syslog
2024-04-09T22:14:14.886 INFO:scrape:1 jobs: ['7647156']
2024-04-09T22:14:14.886 INFO:scrape:suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools']
2024-04-09T22:14:14.886 INFO:scrape:
2024-04-09T22:14:14.886 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'
2024-04-09T22:14:14.886 INFO:scrape:2 jobs: ['7647367', '7647202']
2024-04-09T22:14:14.886 INFO:scrape:suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_cephadm}']
2024-04-09T22:14:14.886 INFO:scrape:suites union: ['agent/on', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_cephadm}']
2024-04-09T22:14:14.886 INFO:scrape:
2024-04-09T22:14:14.887 INFO:scrape:Failure: 
2024-04-09T22:14:14.887 INFO:scrape:1 jobs: ['7647400']
2024-04-09T22:14:14.887 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client/kclient', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/reef/{reef}']
2024-04-09T22:14:14.887 INFO:scrape:
2024-04-09T22:14:14.887 INFO:scrape:Dead: b'2024-04-09T22:09:37.950 DEBUG:teuthology.exit:Finished running handlers'
2024-04-09T22:14:14.887 INFO:scrape:1 jobs: ['7647331']
2024-04-09T22:14:14.887 INFO:scrape:suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools']
2024-04-09T22:14:14.887 INFO:scrape:
2024-04-09T22:14:14.887 INFO:scrape:Failure: Command failed on smithi097 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 pull'
2024-04-09T22:14:14.887 INFO:scrape:1 jobs: ['7647204']
2024-04-09T22:14:14.888 INFO:scrape:suites: ['1-bootstrap/16.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools']
2024-04-09T22:14:14.888 INFO:scrape:
2024-04-09T22:14:14.893 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/
failed:  14
dead:    1
running: 0
waiting: 0
queued:  0
passed:  153


Fail
=================================================================
[7647040]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:55:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647040/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647040/

    reached maximum tries (51) after waiting for 300 seconds

[7647111]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master}
-----------------------------------------------------------------
time:   00:06:19
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647111/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647111/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7f938b289f4841518f065c42fab4bf0d

    Command failed on smithi029 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7647120]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   01:10:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647120/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647120/

    reached maximum tries (51) after waiting for 300 seconds

[7647156]  orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:45:30
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647156/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647156/

    '2024-04-09T08:42:24.006972+00:00 smithi019 kernel: rcu: INFO: rcu_sched
    self-detected stall on CPU ' in syslog

[7647198]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:05:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647198/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647198/
sentry: https://sentry.ceph.com/organizations/ceph/?query=49d562a60c9047d4afe8b2568ae919ae

    Command failed on smithi154 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7647202]  orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:09:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647202/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647202/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fb9df14b145147efb9114248775335a4

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi049 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7647204]  orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:06:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647204/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647204/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a65f51acf6694f43bb1db403ffcf1230

    Command failed on smithi097 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 pull'

[7647233]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:41:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647233/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647233/

    reached maximum tries (51) after waiting for 300 seconds

[7647281]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:05:59
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647281/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647281/
sentry: https://sentry.ceph.com/organizations/ceph/?query=13ffd47e4fab4acda487c40e84e9b9b8

    Command failed on smithi092 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7647361]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   01:11:19
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647361/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647361/

    reached maximum tries (51) after waiting for 300 seconds

[7647367]  orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:20:43
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647367/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647367/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e4fe49d4684e4646a818e28174c2b019

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi148 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d540ebaca6b131a1dd560e7f69e024b133bbaa42
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7647397]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:05:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647397/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647397/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4a648137022c4fadae519a843de6b7dc

    Command failed on smithi117 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7647400]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:28:26
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647400/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647400/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c0c013f8d0fb449997346e772f39079c

[7647448]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:41:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647448/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647448/

    reached maximum tries (51) after waiting for 300 seconds



Dead
=================================================================
[7647331]  orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647331/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647331/

    hit max job timeout



Pass
=================================================================
[7647043] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:18:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647043/

[7647046] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root}
time:   00:46:43
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647046/

[7647048] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:30:07
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647048/

[7647051] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:22:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647051/

[7647055] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos}
time:   00:13:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647055/

[7647057] orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon}
time:   00:28:11
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647057/

[7647060] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:16:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647060/

[7647064] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:18:54
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647064/

[7647067] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:14:02
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647067/

[7647070] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:49:29
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647070/

[7647072] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:20:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647072/

[7647075] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:36:02
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647075/

[7647078] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:17:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647078/

[7647082] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:23:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647082/

[7647084] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:45:10
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647084/

[7647087] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
time:   00:43:34
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647087/

[7647090] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
time:   00:33:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647090/

[7647093] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:22:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647093/

[7647096] orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools_crun mon_election/connectivity task/test_adoption}
time:   00:12:13
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647096/

[7647099] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:17:42
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647099/

[7647102] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:18:26
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647102/

[7647106] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_host_drain}
time:   00:22:55
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647106/

[7647114] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:17:16
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647114/

[7647117] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:18:52
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647117/

[7647123] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli}
time:   00:24:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647123/

[7647126] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:19:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647126/

[7647128] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final}
time:   00:15:36
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647128/

[7647130] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:14:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647130/

[7647132] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
time:   01:01:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647132/

[7647134] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests}
time:   00:43:38
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647134/

[7647136] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:16:19
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647136/

[7647138] orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_3.0 mon_election/classic task/test_cephadm_timeout}
time:   00:25:41
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647138/

[7647140] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:20:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647140/

[7647142] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:17:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647142/

[7647144] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   00:34:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647144/

[7647146] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:17:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647146/

[7647148] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:21:07
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647148/

[7647150] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:35:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647150/

[7647152] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_rgw_multisite}
time:   00:16:19
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647152/

[7647154] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:17:44
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647154/

[7647158] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
time:   00:34:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647158/

[7647160] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
time:   00:24:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647160/

[7647162] orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_rhel8 mon_election/connectivity task/test_orch_cli}
time:   00:22:33
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647162/

[7647164] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:17:52
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647164/

[7647166] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:19:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647166/

[7647168] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:26:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647168/

[7647170] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:16:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647170/

[7647172] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:13:29
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647172/

[7647174] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647174/

[7647176] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:16:03
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647176/

[7647178] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
time:   00:40:12
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647178/

[7647180] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:26:16
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647180/

[7647182] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_ca_signed_key}
time:   00:23:07
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647182/

[7647184] orch/cephadm/no-agent-workunits/{0-distro/ubuntu_20.04 mon_election/classic task/test_orch_cli_mon}
time:   00:36:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647184/

[7647186] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:23:56
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647186/

[7647188] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:22:55
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647188/

[7647190] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic}
time:   00:49:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647190/

[7647192] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:20:07
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647192/

[7647194] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:16:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647194/

[7647196] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:34:44
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647196/

[7647200] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:21:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647200/

[7647206] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{ubuntu_20.04} tasks/nfs}
time:   00:41:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647206/

[7647208] orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption}
time:   00:12:11
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647208/

[7647210] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli}
time:   00:23:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647210/

[7647212] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
time:   00:33:18
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647212/

[7647214] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:37
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647214/

[7647215] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:19:03
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647215/

[7647217] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final}
time:   00:17:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647217/

[7647219] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647219/

[7647221] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
time:   00:46:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647221/

[7647223] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:46:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647223/

[7647225] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:18:16
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647225/

[7647227] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos}
time:   00:07:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647227/

[7647229] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:15:40
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647229/

[7647231] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:20:42
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647231/

[7647235] orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools_crun mon_election/connectivity task/test_cephadm_timeout}
time:   00:16:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647235/

[7647238] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:18:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647238/

[7647240] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:19:45
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647240/

[7647242] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:16:03
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647242/

[7647243] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
time:   00:58:20
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647243/

[7647245] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:28:20
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647245/

[7647248] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:35:32
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647248/

[7647250] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:18:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647250/

[7647251] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:20:41
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647251/

[7647253] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:16:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647253/

[7647256] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647256/

[7647257] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_host_drain}
time:   00:31:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647257/

[7647259] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:36:38
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647259/

[7647261] orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_3.0 mon_election/classic task/test_orch_cli}
time:   00:27:31
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647261/

[7647263] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:21:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647263/

[7647265] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:19:47
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647265/

[7647267] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:44:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647267/

[7647269] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
time:   00:43:53
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647269/

[7647271] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
time:   00:37:48
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647271/

[7647273] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:22:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647273/

[7647275] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:17:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647275/

[7647277] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:20:38
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647277/

[7647279] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:18:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647279/

[7647283] orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_rhel8 mon_election/connectivity task/test_orch_cli_mon}
time:   00:33:09
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647283/

[7647285] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:19:05
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647285/

[7647287] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:18:57
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647287/

[7647289] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite}
time:   00:18:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647289/

[7647291] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli}
time:   00:25:18
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647291/

[7647293] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:16:47
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647293/

[7647295] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final}
time:   00:16:43
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647295/

[7647297] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:14:15
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647297/

[7647299] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root}
time:   00:39:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647299/

[7647302] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:30:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647302/

[7647305] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:40:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647305/

[7647308] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:16:54
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647308/

[7647310] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647310/

[7647314] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:20:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647314/

[7647317] orch/cephadm/no-agent-workunits/{0-distro/ubuntu_20.04 mon_election/classic task/test_adoption}
time:   00:10:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647317/

[7647319] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:24:08
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647319/

[7647322] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:21:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647322/

[7647325] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:37:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647325/

[7647328] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:19:50
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647328/

[7647334] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root}
time:   00:37:57
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647334/

[7647337] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
time:   00:24:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647337/

[7647340] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_ca_signed_key}
time:   00:14:36
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647340/

[7647343] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:21:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647343/

[7647346] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:18:29
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647346/

[7647349] orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_timeout}
time:   00:16:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647349/

[7647352] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:17:39
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647352/

[7647355] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:17:25
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647355/

[7647358] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:13:10
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647358/

[7647364] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:18:10
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647364/

[7647370] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   00:53:23
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647370/

[7647373] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root}
time:   01:00:41
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647373/

[7647376] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys}
time:   00:36:28
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647376/

[7647379] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:22:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647379/

[7647382] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:15:00
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647382/

[7647385] orch/cephadm/no-agent-workunits/{0-distro/centos_8.stream_container_tools_crun mon_election/classic task/test_orch_cli}
time:   00:16:18
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647385/

[7647388] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647388/

[7647391] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:17:59
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647391/

[7647394] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos}
time:   00:13:34
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647394/

[7647403] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:20:24
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647403/

[7647406] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:44:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647406/

[7647409] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs}
time:   00:29:47
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647409/

[7647412] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli}
time:   00:24:49
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647412/

[7647415] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
time:   00:37:55
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647415/

[7647418] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:16:17
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647418/

[7647421] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final}
time:   00:17:51
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647421/

[7647424] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:12:58
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647424/

[7647427] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root}
time:   00:38:14
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647427/

[7647430] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:44:07
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647430/

[7647433] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:18:03
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647433/

[7647436] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:16:52
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647436/

[7647439] orch/cephadm/no-agent-workunits/{0-distro/rhel_8.6_container_tools_3.0 mon_election/connectivity task/test_orch_cli_mon}
time:   00:34:54
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647439/

[7647442] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:21:53
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647442/

[7647445] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:15:35
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647445/

[7647451] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:23:07
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647451/

[7647454] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_host_drain}
time:   00:20:06
info:   https://pulpito.ceph.com/yuriw-2024-04-09_01:15:03-orch-reef-release-distro-default-smithi/7647454/