2024-02-02T19:46:41.586 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-02-02T19:46:41.587 INFO:teuthology.results:subset: '111/120000'
2024-02-02T19:46:41.587 INFO:teuthology.results:seed: '2279'
2024-02-03T01:44:47.819 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-02-03T01:44:47.850 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-02-03T12:05:40.089 INFO:teuthology.results:Tests finished! gathering results...
2024-02-03T12:05:53.177 INFO:scrape:Found 160 jobs
2024-02-03T12:06:01.941 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543929/teuthology.log
2024-02-03T12:06:01.942 INFO:scrape:Found 9 distinct failure reasons
2024-02-03T12:06:01.942 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi049 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=742e4ab9212fcc3e520b729693dcac293c946fc0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm_timeout.py'
2024-02-03T12:06:01.942 INFO:scrape:1 jobs: ['7543763']
2024-02-03T12:06:01.942 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_cephadm_timeout}']
2024-02-03T12:06:01.942 INFO:scrape:
2024-02-03T12:06:01.942 INFO:scrape:Failure: Command failed on smithi106 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c28ceb90-c236-11ee-95b6-87774f69a715 -e sha1=742e4ab9212fcc3e520b729693dcac293c946fc0 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''
2024-02-03T12:06:01.942 INFO:scrape:4 jobs: ['7544136', '7543742', '7543926', '7543817']
2024-02-03T12:06:01.943 INFO:scrape:suites intersection: []
2024-02-03T12:06:01.943 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-repo_digest/defaut', '3-inline/yes', '3-upgrade-mgr-staggered', '3-upgrade/staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '4-wait', '5-upgrade-ls', '5-upgrade-with-workload', '6-verify}}', 'agent/on', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon_election/classic}', 'mon_election/connectivity}', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy']
2024-02-03T12:06:01.943 INFO:scrape:
2024-02-03T12:06:01.943 INFO:scrape:Failure: Command failed on smithi094 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull'
2024-02-03T12:06:01.943 INFO:scrape:2 jobs: ['7543950', '7543707']
2024-02-03T12:06:01.943 INFO:scrape:suites intersection: []
2024-02-03T12:06:01.943 INFO:scrape:suites union: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'agent/off', 'mon_election/classic', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_ca_signed_key}']
2024-02-03T12:06:01.943 INFO:scrape:
2024-02-03T12:06:01.944 INFO:scrape:Failure: Command failed on smithi012 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"
2024-02-03T12:06:01.944 INFO:scrape:4 jobs: ['7543701', '7544060', '7543820', '7543938']
2024-02-03T12:06:01.944 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_22.04']
2024-02-03T12:06:01.944 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_22.04', 'rook/1.7.2}', 'rook/master}']
2024-02-03T12:06:01.944 INFO:scrape:
2024-02-03T12:06:01.944 INFO:scrape:Dead: b'2024-02-03T12:02:34.280 DEBUG:teuthology.exit:Finished running handlers'
2024-02-03T12:06:01.944 INFO:scrape:1 jobs: ['7544003']
2024-02-03T12:06:01.944 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/yes', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy']
2024-02-03T12:06:01.944 INFO:scrape:
2024-02-03T12:06:01.945 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi077 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=742e4ab9212fcc3e520b729693dcac293c946fc0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'
2024-02-03T12:06:01.945 INFO:scrape:1 jobs: ['7543977']
2024-02-03T12:06:01.945 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_cephadm_repos}']
2024-02-03T12:06:01.945 INFO:scrape:
2024-02-03T12:06:01.945 INFO:scrape:Failure: Command failed (workunit test suites/fsstress.sh) on smithi183 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=742e4ab9212fcc3e520b729693dcac293c946fc0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'
2024-02-03T12:06:01.945 INFO:scrape:2 jobs: ['7544099', '7543908']
2024-02-03T12:06:01.945 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy']
2024-02-03T12:06:01.945 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'fail_fs/yes', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy']
2024-02-03T12:06:01.945 INFO:scrape:
2024-02-03T12:06:01.945 INFO:scrape:Failure: Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2dd9e56-c237-11ee-95b6-87774f69a715 -e sha1=742e4ab9212fcc3e520b729693dcac293c946fc0 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''
2024-02-03T12:06:01.946 INFO:scrape:1 jobs: ['7544150']
2024-02-03T12:06:01.946 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/yes', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy']
2024-02-03T12:06:01.946 INFO:scrape:
2024-02-03T12:06:01.946 INFO:scrape:Dead: None
2024-02-03T12:06:01.946 INFO:scrape:1 jobs: ['7543929']
2024-02-03T12:06:01.946 INFO:scrape:
2024-02-03T12:06:01.951 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/
failed:  15
dead:    2
running: 0
waiting: 0
queued:  0
passed:  143


Fail
=================================================================
[7543701]  orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/1.7.2}
-----------------------------------------------------------------
time:   00:07:25
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543701/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543701/
sentry: https://sentry.ceph.com/organizations/ceph/?query=55327058c48f4fb69a9fad4159f2fd2e

    Command failed on smithi012 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7543707]  orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_ca_signed_key}
-----------------------------------------------------------------
time:   00:12:43
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543707/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543707/
sentry: https://sentry.ceph.com/organizations/ceph/?query=488daad153414dad920e16c697482f33

    Command failed on smithi046 with status 5: 'sudo systemctl stop
    ceph-528b4086-c208-11ee-95b6-87774f69a715@mon.a'

[7543742]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:51:53
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543742/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543742/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0079230e6f2f47d39497a8453684c02d

    Command failed on smithi105 with status 1: "sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy
    shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    c1223a3c-c20c-11ee-95b6-87774f69a715 -e
    sha1=742e4ab9212fcc3e520b729693dcac293c946fc0 -- bash -c 'ceph orch ps'"

[7543763]  orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_timeout}
-----------------------------------------------------------------
time:   00:19:43
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543763/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543763/
sentry: https://sentry.ceph.com/organizations/ceph/?query=36e7f4dfd2414f2cb982b88d514b6ff5

    Command failed (workunit test cephadm/test_cephadm_timeout.py) on smithi049
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=742e4ab9212fcc3e520b729693dcac293c946fc0
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_cephadm_timeout.py'

[7543817]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   01:16:22
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543817/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543817/
sentry: https://sentry.ceph.com/organizations/ceph/?query=79e8b032b89f44e5887e989fa7a29453

    Command failed on smithi094 with status 1: "sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy
    shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    a25efeba-c215-11ee-95b6-87774f69a715 -e
    sha1=742e4ab9212fcc3e520b729693dcac293c946fc0 -- bash -c 'ceph orch ps'"

[7543820]  orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master}
-----------------------------------------------------------------
time:   00:07:10
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543820/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543820/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aba21859e4e04a1da3aaadf88db93c74

    Command failed on smithi078 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7543908]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   03:37:26
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543908/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543908/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1b8bdff11268441499dd25e06867d550

    Command failed (workunit test suites/fsstress.sh) on smithi139 with status
    124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=742e4ab9212fcc3e520b729693dcac293c946fc0
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1
    CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

[7543926]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic}
-----------------------------------------------------------------
time:   00:43:50
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543926/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543926/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7a098ae2193d4bac928c9893917a850d

    Command failed on smithi023 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    699a5c30-c221-11ee-95b6-87774f69a715 -e
    sha1=742e4ab9212fcc3e520b729693dcac293c946fc0 -- bash -c \'ceph orch
    upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date |
    length == 7\'"\'"\'\''

[7543938]  orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:07:13
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543938/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543938/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fd317afa9ef74cbeba0e77ab9f6f27a2

    Command failed on smithi132 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7543950]  orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:04:21
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543950/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543950/
sentry: https://sentry.ceph.com/organizations/ceph/?query=084d2d385ca34e37b902b05bfa2f099a

    Command failed on smithi094 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull'

[7543977]  orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_repos}
-----------------------------------------------------------------
time:   00:08:06
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543977/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543977/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9bb4b9fba20640ffb963524460903d81

    Command failed (workunit test cephadm/test_repos.sh) on smithi077 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=742e4ab9212fcc3e520b729693dcac293c946fc0
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

[7544060]  orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:07:27
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544060/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544060/
sentry: https://sentry.ceph.com/organizations/ceph/?query=64bc2aae5892422293200fc6d8fe36cd

    Command failed on smithi064 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7544099]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:19:00
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544099/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544099/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b6211b12464747a6940d92d5e40ed31b

    Command failed (workunit test suites/fsstress.sh) on smithi183 with status
    126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=742e4ab9212fcc3e520b729693dcac293c946fc0
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1
    CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

[7544136]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
-----------------------------------------------------------------
time:   00:51:12
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544136/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544136/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d6bc6ef452f9446d8756ee5e264e57c5

    Command failed on smithi106 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    c28ceb90-c236-11ee-95b6-87774f69a715 -e
    sha1=742e4ab9212fcc3e520b729693dcac293c946fc0 -- bash -c \'ceph orch
    upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date |
    length == 7\'"\'"\'\''

[7544150]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:56:23
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544150/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544150/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c85d0131f284d3b809cb0ece2ae0320

    Command failed on smithi016 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy
    shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    f2dd9e56-c237-11ee-95b6-87774f69a715 -e
    sha1=742e4ab9212fcc3e520b729693dcac293c946fc0 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.mgr | keys\'"\'"\' | grep $sha1\''



Dead
=================================================================
[7543929]  orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543929/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543929/

    Error reimaging machines: Failed to power on smithi174

[7544003]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544003/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544003/

    hit max job timeout



Pass
=================================================================
[7543704] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:21:58
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543704/

[7543710] orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys}
time:   00:24:10
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543710/

[7543713] orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:34:40
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543713/

[7543716] orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs}
time:   00:44:30
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543716/

[7543719] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli}
time:   00:13:52
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543719/

[7543722] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
time:   00:22:46
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543722/

[7543725] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:25:32
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543725/

[7543727] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:16:41
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543727/

[7543730] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final}
time:   00:18:21
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543730/

[7543733] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:11:04
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543733/

[7543736] orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_cephadm}
time:   00:14:03
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543736/

[7543739] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:16:05
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543739/

[7543745] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:19:38
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543745/

[7543748] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
time:   01:05:23
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543748/

[7543751] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:20:53
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543751/

[7543754] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm_repos}
time:   00:05:41
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543754/

[7543757] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:15:02
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543757/

[7543760] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:13:53
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543760/

[7543766] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:14:36
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543766/

[7543769] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:20:01
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543769/

[7543772] orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests}
time:   00:51:54
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543772/

[7543775] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:33
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543775/

[7543778] orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:14:13
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543778/

[7543780] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:17:34
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543780/

[7543783] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:11:23
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543783/

[7543786] orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:47:23
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543786/

[7543789] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_extra_daemon_features}
time:   00:13:08
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543789/

[7543793] orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
time:   00:30:25
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543793/

[7543796] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:15:59
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543796/

[7543799] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_host_drain}
time:   00:15:14
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543799/

[7543802] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:12:58
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543802/

[7543804] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:19:30
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543804/

[7543808] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:13:29
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543808/

[7543811] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}}
time:   00:12:57
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543811/

[7543814] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:14:26
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543814/

[7543823] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:21:30
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543823/

[7543825] orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_monitoring_stack_basic}
time:   00:18:55
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543825/

[7543828] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:19:54
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543828/

[7543831] orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
time:   00:35:43
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543831/

[7543834] orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
time:   00:31:52
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543834/

[7543837] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli}
time:   00:11:58
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543837/

[7543840] orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:15:34
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543840/

[7543843] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:14:27
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543843/

[7543846] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final}
time:   00:20:05
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543846/

[7543849] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:11:56
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543849/

[7543852] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_orch_cli}
time:   00:13:10
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543852/

[7543855] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:15:10
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543855/

[7543858] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   00:40:32
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543858/

[7543860] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:21:42
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543860/

[7543864] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:13:23
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543864/

[7543867] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:38:20
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543867/

[7543870] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:33
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543870/

[7543873] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:14:30
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543873/

[7543876] orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
time:   00:52:02
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543876/

[7543879] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:16:16
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543879/

[7543882] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite}
time:   00:13:12
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543882/

[7543884] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:23:49
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543884/

[7543888] orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:22:46
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543888/

[7543891] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:12:44
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543891/

[7543894] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations}
time:   00:15:32
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543894/

[7543897] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:24:23
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543897/

[7543900] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:15:01
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543900/

[7543903] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:11:10
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543903/

[7543905] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:14:32
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543905/

[7543911] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_adoption}
time:   00:11:39
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543911/

[7543914] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:19:41
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543914/

[7543917] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
time:   01:15:06
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543917/

[7543920] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:20:44
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543920/

[7543923] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:13:18
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543923/

[7543932] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:17:56
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543932/

[7543935] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm}
time:   00:14:25
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543935/

[7543941] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:21:52
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543941/

[7543944] orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:52:19
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543944/

[7543947] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:36
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543947/

[7543953] orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs}
time:   00:45:00
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543953/

[7543956] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli}
time:   00:11:21
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543956/

[7543959] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:12:38
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543959/

[7543962] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
time:   00:22:28
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543962/

[7543965] orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:14:42
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543965/

[7543968] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:13:27
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543968/

[7543971] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final}
time:   00:18:22
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543971/

[7543974] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:11:11
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543974/

[7543979] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:13:54
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543979/

[7543982] orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
time:   00:31:54
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543982/

[7543985] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:19:58
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543985/

[7543988] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_timeout}
time:   00:13:17
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543988/

[7543991] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:14:18
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543991/

[7543994] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:13:04
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543994/

[7543997] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:14:14
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7543997/

[7544000] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:13:00
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544000/

[7544006] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:37:43
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544006/

[7544009] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:21:43
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544009/

[7544012] orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:32:01
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544012/

[7544015] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain}
time:   00:22:51
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544015/

[7544018] orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root}
time:   00:35:31
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544018/

[7544021] orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:15:02
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544021/

[7544024] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:15:20
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544024/

[7544027] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:11:48
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544027/

[7544030] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:19:08
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544030/

[7544033] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:15:08
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544033/

[7544036] orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}}
time:   00:13:13
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544036/

[7544039] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:23:34
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544039/

[7544042] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:44
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544042/

[7544045] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:16:57
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544045/

[7544048] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic}
time:   00:18:07
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544048/

[7544051] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:13:18
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544051/

[7544054] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:14:03
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544054/

[7544057] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root}
time:   00:47:38
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544057/

[7544063] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli}
time:   00:20:35
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544063/

[7544066] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:21:06
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544066/

[7544069] orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
time:   00:23:12
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544069/

[7544072] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli}
time:   00:11:38
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544072/

[7544075] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:24:56
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544075/

[7544078] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:13:46
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544078/

[7544081] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final}
time:   00:13:01
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544081/

[7544084] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:11:32
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544084/

[7544087] orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:28:13
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544087/

[7544090] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_orch_cli_mon}
time:   00:23:46
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544090/

[7544093] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:14:22
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544093/

[7544096] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:14:13
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544096/

[7544102] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:25:42
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544102/

[7544104] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_rgw_multisite}
time:   00:13:25
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544104/

[7544106] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:15:51
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544106/

[7544108] orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root}
time:   00:51:21
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544108/

[7544110] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_set_mon_crush_locations}
time:   00:22:41
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544110/

[7544112] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:18:31
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544112/

[7544114] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:13:40
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544114/

[7544116] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:20:10
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544116/

[7544118] orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests}
time:   00:50:55
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544118/

[7544120] orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_adoption}
time:   00:09:38
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544120/

[7544122] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:55
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544122/

[7544124] orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:14:58
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544124/

[7544126] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:14:16
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544126/

[7544128] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:11:19
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544128/

[7544130] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:14:19
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544130/

[7544132] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:13:15
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544132/

[7544134] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key}
time:   00:11:56
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544134/

[7544138] orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root}
time:   00:30:18
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544138/

[7544140] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:20:22
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544140/

[7544142] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm}
time:   00:20:05
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544142/

[7544144] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:15:26
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544144/

[7544146] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:14:55
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544146/

[7544148] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:13:23
info:   https://pulpito.ceph.com/yuriw-2024-02-02_17:01:15-orch-main-distro-default-smithi/7544148/