2023-11-11T06:09:24.427 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-11T06:09:24.429 INFO:teuthology.results:subset: '111/120000'
2023-11-11T06:09:24.429 INFO:teuthology.results:seed: '6496'
2023-11-11T07:24:05.841 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-11T07:24:05.874 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-11-11T08:13:09.709 INFO:teuthology.results:Tests finished! gathering results...
2023-11-11T08:13:20.410 INFO:scrape:Found 156 jobs
2023-11-11T08:13:28.726 INFO:scrape:Found 5 distinct failure reasons
2023-11-11T08:13:28.726 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI)
2023-11-11T08:13:28.727 INFO:scrape:1 jobs: ['7455472']
2023-11-11T08:13:28.727 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_orch_cli}']
2023-11-11T08:13:28.727 INFO:scrape:
2023-11-11T08:13:28.728 INFO:scrape:Failure: Command failed on smithi091 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'
2023-11-11T08:13:28.728 INFO:scrape:104 jobs
2023-11-11T08:13:28.729 INFO:scrape:suites intersection: []
2023-11-11T08:13:28.730 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/17.2.0', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '2-node-mgr', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/jaeger', '2-services/mirror', '2-services/nfs', '2-services/nfs-haproxy-proto', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs-keepalive-only', '2-services/nfs2', '2-services/nvmeof', '2-services/rgw', '2-services/rgw-ingress', '2-thrash', '3-final}', '3-inline/no', '3-inline/yes', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', '3-upgrade-mgr-staggered', '3-upgrade-with-workload', '3-upgrade/simple', '3-upgrade/staggered', '4-config-upgrade/{fail_fs}', '4-final}', '4-verify}', '4-wait', '5-upgrade-ls', '5-upgrade-with-workload', '6-verify}}', 'agent/off', 'agent/on', 'base/install', 'centos_9.stream_container_tools', 'cluster/{fixed-3', 'conf/{client', 'conf/{disable-pool-app}', 'fail_fs/no', 'fail_fs/yes', 'fixed-2', 'ignorelist_wrongly_marked_down', 'mds', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream_container_tools', 'orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_container_tools}', 'orch/cephadm/osds/{0-distro/centos_9.stream_container_tools', 'orch/cephadm/osds/{0-distro/centos_9.stream_container_tools_crun', 'orch/cephadm/rbd_iscsi/{0-single-container-host', 'orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools', 'orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun', 'orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_container_tools}', 'orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun', 'orch/cephadm/smoke/{0-distro/centos_9.stream_container_tools', 'orch/cephadm/smoke/{0-distro/centos_9.stream_container_tools_crun', 'orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools', 'orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools_crun', 'orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream_container-tools', 'orch/cephadm/with-work/{0-distro/centos_9.stream_container_tools', 'orch/cephadm/with-work/{0-distro/centos_9.stream_container_tools_crun', 'orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools', 'orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'orchestrator_cli}', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'root}', 'start', 'start}', 'syntax}', 'task/test_adoption}', 'task/test_ca_signed_key}', 'task/test_cephadm_repos}', 'task/test_cephadm}', 'task/test_extra_daemon_features}', 'task/test_host_drain}', 'task/test_iscsi_container/{centos_9.stream_container_tools', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'task/test_rgw_multisite}', 'task/test_set_mon_crush_locations}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/rotate-keys}', 'tasks/{0-from/quincy', 'test_iscsi_container}}', 'workloads/cephadm_iscsi}']
2023-11-11T08:13:28.730 INFO:scrape:
2023-11-11T08:13:28.730 INFO:scrape:Failure: Command failed on smithi121 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"
2023-11-11T08:13:28.731 INFO:scrape:4 jobs: ['7455514', '7455475', '7455436', '7455397']
2023-11-11T08:13:28.731 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_22.04']
2023-11-11T08:13:28.732 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_22.04', 'rook/1.7.2}', 'rook/master}']
2023-11-11T08:13:28.732 INFO:scrape:
2023-11-11T08:13:28.732 INFO:scrape:Failure: Command failed on smithi080 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:298abd03623204cc79b0c92c1ba318ccde53812a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8fcfb34-805c-11ee-8dbd-212e2dc638e7 -- ceph rgw realm bootstrap -i -'
2023-11-11T08:13:28.733 INFO:scrape:1 jobs: ['7455415']
2023-11-11T08:13:28.733 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_rgw_multisite}']
2023-11-11T08:13:28.734 INFO:scrape:
2023-11-11T08:13:28.734 INFO:scrape:Failure: Command failed on smithi144 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9073f5ec-8062-11ee-8dbd-212e2dc638e7 -e sha1=298abd03623204cc79b0c92c1ba318ccde53812a -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\''
2023-11-11T08:13:28.735 INFO:scrape:1 jobs: ['7455505']
2023-11-11T08:13:28.735 INFO:scrape:suites: ['2-repo_digest/defaut', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/on', 'mon_election/connectivity}', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04']
2023-11-11T08:13:28.735 INFO:scrape:
2023-11-11T08:13:28.740 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi
=================================================================
info:    https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/
failed:  111
dead:    0
running: 0
waiting: 0
queued:  0
passed:  45


Fail
=================================================================
[7455396]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:36
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455396/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455396/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4f0ac397daf947278ed19cc3cdf13a92

    Command failed on smithi186 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455397]  orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master}
-----------------------------------------------------------------
time:   00:08:21
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455397/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455397/
sentry: https://sentry.ceph.com/organizations/ceph/?query=856fc61efd1a4ad984f3c163b06eca8c

    Command failed on smithi062 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7455400]  orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:05:38
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455400/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455400/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e267d4a514f44ee883aecd74bcf362de

    Command failed on smithi170 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455402]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools agent/off mon_election/classic task/test_orch_cli}
-----------------------------------------------------------------
time:   00:05:26
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455402/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455402/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5b54207460c94662bc1ca85321d6ebfc

    Command failed on smithi187 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455404]  orch/cephadm/smoke/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:32
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455404/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455404/
sentry: https://sentry.ceph.com/organizations/ceph/?query=10d9989fec984e649790b658d7b763ac

    Command failed on smithi103 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455405]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final}
-----------------------------------------------------------------
time:   00:05:31
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455405/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455405/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3380dc46a455477d92e435e894799bdd

    Command failed on smithi116 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455407]  orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:43
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455407/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455407/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2c033837a4ca4a93b47e73b0d3e112d4

    Command failed on smithi090 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455408]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
-----------------------------------------------------------------
time:   00:05:32
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455408/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455408/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1d9a27fce2ae44828db7bf65fe6d2bcd

    Command failed on smithi167 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455410]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:05:50
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455410/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455410/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b96144d548c04881913ffae75787e59e

    Command failed on smithi079 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455412]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:05:41
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455412/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455412/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af13bf39450a4402a5c724296528ab6f

    Command failed on smithi113 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455413]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:36
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455413/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455413/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b61d749dbdbd4c51bcbb043d0cd0c75d

    Command failed on smithi134 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455414]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
-----------------------------------------------------------------
time:   00:05:43
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455414/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455414/
sentry: https://sentry.ceph.com/organizations/ceph/?query=881713b73bd547a3bfa7dcbae0f5bf6e

    Command failed on smithi121 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455415]  orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_rgw_multisite}
-----------------------------------------------------------------
time:   00:19:34
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455415/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455415/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6652a5377e1845d18442784f25ba07a8

    Command failed on smithi080 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay-quay-
    quay.apps.os.sepia.ceph.com/ceph-
    ci/ceph:298abd03623204cc79b0c92c1ba318ccde53812a shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    d8fcfb34-805c-11ee-8dbd-212e2dc638e7 -- ceph rgw realm bootstrap -i -'

[7455416]  orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:05:42
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455416/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455416/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b50c22d8c15449e6b73b4281a0bfb5b4

    Command failed on smithi138 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455417]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
-----------------------------------------------------------------
time:   00:05:35
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455417/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455417/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0965394daa594f65b2ce8c107a86086b

    Command failed on smithi119 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455419]  orch/cephadm/with-work/{0-distro/centos_9.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:05:34
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455419/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455419/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7375fdfe931847b5b658fa566964e76d

    Command failed on smithi096 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455420]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations}
-----------------------------------------------------------------
time:   00:05:44
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455420/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455420/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3ae89b9b8c44426a8d8820738f406374

    Command failed on smithi087 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455421]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
-----------------------------------------------------------------
time:   00:05:33
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455421/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455421/
sentry: https://sentry.ceph.com/organizations/ceph/?query=caea89ffec6149638e33beeef50603f6

    Command failed on smithi072 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455423]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
-----------------------------------------------------------------
time:   00:05:31
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455423/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455423/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8d602120362144469dd9eed09de79341

    Command failed on smithi088 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455424]  orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455424/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455424/
sentry: https://sentry.ceph.com/organizations/ceph/?query=89b587c35910408e8fd9a50232fe5387

    Command failed on smithi164 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455425]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs 3-final}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455425/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455425/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e9c3d2a015f1423ebef11e6fe2e4214b

    Command failed on smithi183 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455426]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455426/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455426/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3e57b01c3104c70962a64bd50049807

    Command failed on smithi135 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455427]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun agent/off mon_election/classic task/test_adoption}
-----------------------------------------------------------------
time:   00:05:29
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455427/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455427/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3d4c1b4c0ff4fefb92e27dd2a3715e0

    Command failed on smithi186 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455431]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nvmeof 3-final}
-----------------------------------------------------------------
time:   00:05:31
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455431/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455431/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7e993e196f624a6f9b57303d7c3b6c97

    Command failed on smithi094 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455432]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic}
-----------------------------------------------------------------
time:   00:05:34
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455432/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455432/
sentry: https://sentry.ceph.com/organizations/ceph/?query=32ccee403efe4c3ca0c45741e0ae79ff

    Command failed on smithi157 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455433]  orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key}
-----------------------------------------------------------------
time:   00:12:12
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455433/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455433/
sentry: https://sentry.ceph.com/organizations/ceph/?query=067831c9a876410183c0bbc0e3d8c73a

    Command failed on smithi062 with status 5: 'sudo systemctl stop
    ceph-18b4672a-805e-11ee-8dbd-212e2dc638e7@mon.a'

[7455434]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
-----------------------------------------------------------------
time:   00:05:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455434/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455434/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5cb51ba8135c453ca10ed761b78a9866

    Command failed on smithi116 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455436]  orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:08:21
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455436/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455436/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0f733d26fd324db596e329df34ba2497

    Command failed on smithi039 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7455437]  orch/cephadm/with-work/{0-distro/centos_9.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:05:35
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455437/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455437/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6b2ed835edf1489f8094a71fe4b95819

    Command failed on smithi167 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455438]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools agent/off mon_election/classic task/test_cephadm}
-----------------------------------------------------------------
time:   00:05:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455438/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455438/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3af2da4766da43f3b835216208a44e9b

    Command failed on smithi170 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455439]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:35
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455439/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455439/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1a80f2f2a6fc44de9fd88048eaa4db57

    Command failed on smithi090 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455440]  orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:05:40
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455440/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455440/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9da2230605e84a8ea5286fd20f127728

    Command failed on smithi148 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455443]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:05:35
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455443/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455443/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4299904863354798aeb1d14e58bbe30e

    Command failed on smithi111 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455444]  orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
-----------------------------------------------------------------
time:   00:05:42
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455444/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455444/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c976e0838ab648ecb7ef6f5852f4b4df

    Command failed on smithi079 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455445]  orch/cephadm/smoke/{0-distro/centos_9.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:34
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455445/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455445/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3eb88cb38d1c454993240e0633339597

    Command failed on smithi134 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455446]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:05:40
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455446/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455446/
sentry: https://sentry.ceph.com/organizations/ceph/?query=684c9fa8ac8e4001a5bdfac4f474973a

    Command failed on smithi113 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455447]  orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_container_tools} 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:05:44
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455447/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455447/
sentry: https://sentry.ceph.com/organizations/ceph/?query=724541b0af11485ead329bf3283fec92

    Command failed on smithi059 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455448]  orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:36
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455448/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455448/
sentry: https://sentry.ceph.com/organizations/ceph/?query=34d4f7d94b044f4f9c18e6520dda8ebf

    Command failed on smithi119 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455449]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/client-keyring 3-final}
-----------------------------------------------------------------
time:   00:05:33
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455449/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455449/
sentry: https://sentry.ceph.com/organizations/ceph/?query=25ceb3ea359a4929a83f43f99c4a2c40

    Command failed on smithi096 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455450]  orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:05:45
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455450/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455450/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b1003f8795e24d77a578874dd8e17440

    Command failed on smithi003 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455451]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun agent/on mon_election/connectivity task/test_cephadm_repos}
-----------------------------------------------------------------
time:   00:05:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455451/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455451/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dee2fdb9e43344af8c146e8573be9e99

    Command failed on smithi087 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455453]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final}
-----------------------------------------------------------------
time:   00:05:33
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455453/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455453/
sentry: https://sentry.ceph.com/organizations/ceph/?query=68e3d3a8e805451784759442ed194710

    Command failed on smithi091 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455454]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:05:32
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455454/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455454/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af4e6ae8020e404cab956691a10fead6

    Command failed on smithi072 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455456]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final}
-----------------------------------------------------------------
time:   00:05:31
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455456/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455456/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cee69c17cf7c4ba6b7f19a9d8505bcda

    Command failed on smithi081 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455457]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:37
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455457/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455457/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aac474224b3548c5a83a1939f1cea212

    Command failed on smithi135 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455461]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools agent/on mon_election/connectivity task/test_host_drain}
-----------------------------------------------------------------
time:   00:05:32
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455461/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455461/
sentry: https://sentry.ceph.com/organizations/ceph/?query=584d8e705c1143388768f69bf202c5eb

    Command failed on smithi094 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455462]  orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:05:37
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455462/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455462/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a78fce20c8174008bc7ba2cdb701fa63

    Command failed on smithi156 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455463]  orch/cephadm/smoke/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455463/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455463/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6af1fd1a7ac44a3f817f79ccc27e7faf

    Command failed on smithi084 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455464]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
-----------------------------------------------------------------
time:   00:05:36
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455464/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455464/
sentry: https://sentry.ceph.com/organizations/ceph/?query=34142fb3a0714ddfb88b71df94087d3e

    Command failed on smithi173 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455465]  orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455465/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455465/
sentry: https://sentry.ceph.com/organizations/ceph/?query=afd87daf9bf0462dade6d81a7027936c

    Command failed on smithi100 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455467]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
-----------------------------------------------------------------
time:   00:05:28
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455467/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455467/
sentry: https://sentry.ceph.com/organizations/ceph/?query=589887e5d0224ca287e4095db15782a4

    Command failed on smithi115 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455468]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream_container_tools test_iscsi_container}}
-----------------------------------------------------------------
time:   00:05:29
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455468/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455468/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2530a31b23d7422ea5f42cb1e2e1f9d2

    Command failed on smithi190 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455470]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455470/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455470/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d5f2af3b7bc944808d479216a89531d4

    Command failed on smithi167 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455471]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
-----------------------------------------------------------------
time:   00:05:42
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455471/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455471/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c6ca92286c1645f5a9092b6862b69eca

    Command failed on smithi090 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455472]  orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:20:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455472/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455472/
sentry: https://sentry.ceph.com/organizations/ceph/?query=93dd308df8604bdb92add1548657a566

    Test failure: test_cephfs_mirror
    (tasks.cephadm_cases.test_cli.TestCephadmCLI)

[7455473]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
-----------------------------------------------------------------
time:   00:05:42
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455473/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455473/
sentry: https://sentry.ceph.com/organizations/ceph/?query=52774c38aa634c9ca04198bfa45d4518

    Command failed on smithi144 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455474]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
-----------------------------------------------------------------
time:   00:05:33
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455474/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455474/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9444508ea17a4b6588ed9d72f1861315

    Command failed on smithi080 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455475]  orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:08:21
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455475/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455475/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c3414b9032b4c8f903262e8afbc0a4b

    Command failed on smithi019 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7455478]  orch/cephadm/with-work/{0-distro/centos_9.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:05:34
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455478/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455478/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5b50301ba3074ab09548ef5096e51c3a

    Command failed on smithi113 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455479]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:05:45
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455479/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455479/
sentry: https://sentry.ceph.com/organizations/ceph/?query=894ac3a7b3ea473892496bb965b492a9

    Command failed on smithi138 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455480]  orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_container_tools} 2-node-mgr agent/on orchestrator_cli}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455480/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455480/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eaf9332f1a684720894a1037c24f5a8a

    Command failed on smithi150 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455482]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final}
-----------------------------------------------------------------
time:   00:05:45
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455482/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455482/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ba1f93db410047fa96f9ea37ea473037

    Command failed on smithi003 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455484]  orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:49
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455484/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455484/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5de5c10d894a4043a238cf2bfd47f35d

    Command failed on smithi091 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455485]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic}
-----------------------------------------------------------------
time:   00:05:37
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455485/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455485/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5d0a76ebcbc2480eb11b504946affd72

    Command failed on smithi143 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455486]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
-----------------------------------------------------------------
time:   00:05:38
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455486/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455486/
sentry: https://sentry.ceph.com/organizations/ceph/?query=72a23e63b2e8402d86fdaa1b9cf6cb57

    Command failed on smithi135 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455487]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nvmeof 3-final}
-----------------------------------------------------------------
time:   00:05:32
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455487/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455487/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a4b5652784734f728c1703b411440cf3

    Command failed on smithi081 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455488]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:40
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455488/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455488/
sentry: https://sentry.ceph.com/organizations/ceph/?query=401bb2f5492844c28394891c6c2ec48c

    Command failed on smithi072 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455489]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun agent/on mon_election/connectivity task/test_rgw_multisite}
-----------------------------------------------------------------
time:   00:05:33
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455489/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455489/
sentry: https://sentry.ceph.com/organizations/ceph/?query=474ccb89be6e4df0956267f16cf5e941

    Command failed on smithi073 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455491]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:05:29
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455491/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455491/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e71f55aef22549daad66ffd94bf3b128

    Command failed on smithi094 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455492]  orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:05:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455492/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455492/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8ea23c456e8c44df803e39a826844625

    Command failed on smithi084 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455495]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:05:37
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455495/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455495/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6ff3f0ec2775485c99bed884128a59a5

    Command failed on smithi077 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455497]  orch/cephadm/with-work/{0-distro/centos_9.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:05:33
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455497/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455497/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4590d9e4ebef41fab83d97f35de57192

    Command failed on smithi190 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455498]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools agent/on mon_election/connectivity task/test_adoption}
-----------------------------------------------------------------
time:   00:05:25
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455498/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455498/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2ea07efe24f04ba6bd5ba49d3ec5712d

    Command failed on smithi115 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455499]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:40
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455499/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455499/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e502737445244ac098e6bb52f01c6f56

    Command failed on smithi169 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455500]  orch/cephadm/smoke/{0-distro/centos_9.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:53
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455500/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455500/
sentry: https://sentry.ceph.com/organizations/ceph/?query=54f04093a59e445984813431feb0e021

    Command failed on smithi100 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455501]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final}
-----------------------------------------------------------------
time:   00:05:40
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455501/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455501/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e7c50be50e9e40f49bf3b4ca32e7b228

    Command failed on smithi167 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455502]  orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:41
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455502/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455502/
sentry: https://sentry.ceph.com/organizations/ceph/?query=79296d82a7f64ce0b13b966411aac2f8

    Command failed on smithi124 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455503]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final}
-----------------------------------------------------------------
time:   00:05:37
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455503/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455503/
sentry: https://sentry.ceph.com/organizations/ceph/?query=330a37367d614f2dbb8ef756d9195787

    Command failed on smithi090 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455504]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:05:36
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455504/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455504/
sentry: https://sentry.ceph.com/organizations/ceph/?query=044e5f4568a84a6e920d38d6e4b7e9d3

    Command failed on smithi080 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455505]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
-----------------------------------------------------------------
time:   00:49:51
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455505/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455505/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eaedb4e1c89448dbb025ff6413140def

    Command failed on smithi144 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    9073f5ec-8062-11ee-8dbd-212e2dc638e7 -e
    sha1=298abd03623204cc79b0c92c1ba318ccde53812a -- bash -c \'ceph orch
    upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date |
    length == 7\'"\'"\'\''

[7455506]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun agent/off mon_election/classic task/test_ca_signed_key}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455506/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455506/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e80015868b634760af0168f7acf6cd7f

    Command failed on smithi113 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455507]  orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:05:46
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455507/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455507/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4572e637f1744343bb647c28ef659bd3

    Command failed on smithi130 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455509]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
-----------------------------------------------------------------
time:   00:05:50
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455509/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455509/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0e919c49bf6847e6882a9f88c7eaf75c

    Command failed on smithi003 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455511]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
-----------------------------------------------------------------
time:   00:05:37
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455511/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455511/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bee74f5adb604bac948be013c79605b7

    Command failed on smithi069 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455512]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:05:32
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455512/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455512/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eee4c50c64214ccb885581d8ca25fffe

    Command failed on smithi111 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455513]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:46
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455513/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455513/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7394383aea604dc89a7ba10579f57246

    Command failed on smithi001 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455514]  orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:08:14
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455514/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455514/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c8289d7c79884941a93d32af9ab6c07e

    Command failed on smithi121 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7455516]  orch/cephadm/with-work/{0-distro/centos_9.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:05:49
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455516/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455516/
sentry: https://sentry.ceph.com/organizations/ceph/?query=719bc265e6ee43ffa96d56a6e1e93296

    Command failed on smithi099 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455517]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos}
-----------------------------------------------------------------
time:   00:05:29
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455517/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455517/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a405c5bcf5034694bd901753c123eb1e

    Command failed on smithi088 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455518]  orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455518/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455518/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c9f1107edd0d46beb3ae8de5aac8214e

    Command failed on smithi135 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455521]  orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
-----------------------------------------------------------------
time:   00:05:35
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455521/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455521/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c82aee2e07dd4d9cbabfa8da634b8544

    Command failed on smithi072 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455522]  orch/cephadm/smoke/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:36
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455522/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455522/
sentry: https://sentry.ceph.com/organizations/ceph/?query=60a3f56286c440f4986563a30dc8d235

    Command failed on smithi073 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455523]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
-----------------------------------------------------------------
time:   00:05:35
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455523/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455523/
sentry: https://sentry.ceph.com/organizations/ceph/?query=41897c339e7043f9b39d225ab4bbc82f

    Command failed on smithi132 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455525]  orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:41
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455525/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455525/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8edc01871f12432fafea7c5981b3d5d6

    Command failed on smithi094 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455527]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455527/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455527/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9d0eb8f8f9f84c68aae1a3fca2b88acf

    Command failed on smithi077 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455528]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun agent/on mon_election/connectivity task/test_extra_daemon_features}
-----------------------------------------------------------------
time:   00:05:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455528/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455528/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fd89eaedfa0e4d99bcc2b8cd01c71d6c

    Command failed on smithi084 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455531]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:53
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455531/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455531/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9a355420d16248e4a528494116c8b735

    Command failed on smithi012 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455532]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final}
-----------------------------------------------------------------
time:   00:05:38
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455532/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455532/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9c81e0c22b7c4fe7a2b0009a82a6732f

    Command failed on smithi158 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455533]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
-----------------------------------------------------------------
time:   00:05:53
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455533/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455533/
sentry: https://sentry.ceph.com/organizations/ceph/?query=657c920ef63242d8a4226ccfb19738fc

    Command failed on smithi005 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455535]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final}
-----------------------------------------------------------------
time:   00:05:38
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455535/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455535/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7b7bb958989d4acca9eff7d0bba24875

    Command failed on smithi154 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455536]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
-----------------------------------------------------------------
time:   00:05:40
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455536/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455536/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3de72258d749495e8bfdbfa4c940921e

    Command failed on smithi090 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455538]  orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:05:46
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455538/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455538/
sentry: https://sentry.ceph.com/organizations/ceph/?query=19c4c0aab85749808c2640e564be3fcb

    Command failed on smithi100 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455540]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream_container_tools test_iscsi_container}}
-----------------------------------------------------------------
time:   00:06:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455540/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455540/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5dc0d032706949bbb05de6d80cfb56bd

    Command failed on smithi037 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455542]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
-----------------------------------------------------------------
time:   00:05:50
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455542/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455542/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4deeb92d5eea4ec89807bd719088e423

    Command failed on smithi130 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455543]  orch/cephadm/smoke-small/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:41
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455543/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455543/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e952fbd46013429b87cde459c4314483

    Command failed on smithi116 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455544]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:05:54
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455544/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455544/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4376e4a0bc5f4ca7a65f99913c097d55

    Command failed on smithi003 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455545]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:05:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455545/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455545/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f63c862a46d04d33a65be8841a1e9fbd

    Command failed on smithi069 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455546]  orch/cephadm/workunits/{0-distro/centos_9.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli}
-----------------------------------------------------------------
time:   00:05:37
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455546/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455546/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c71e89c5fb4477380d8a0c4330d9037

    Command failed on smithi087 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455547]  orch/cephadm/osds/{0-distro/centos_9.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:05:52
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455547/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455547/
sentry: https://sentry.ceph.com/organizations/ceph/?query=89195d257f484658afc01fcb55835d81

    Command failed on smithi044 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455549]  orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final}
-----------------------------------------------------------------
time:   00:05:44
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455549/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455549/
sentry: https://sentry.ceph.com/organizations/ceph/?query=72c400dde28140879501bca3d1413c3f

    Command failed on smithi001 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7455551]  orch/cephadm/thrash/{0-distro/centos_9.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:05:37
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455551/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455551/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b39b56949c3c4c1bbeb6d2756dc98fe3

    Command failed on smithi135 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'



Pass
=================================================================
[7455398] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:22:08
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455398/

[7455399] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:20:36
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455399/

[7455401] orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
time:   00:32:17
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455401/

[7455403] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli}
time:   00:16:20
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455403/

[7455406] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final}
time:   00:20:27
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455406/

[7455409] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   00:40:49
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455409/

[7455411] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:22:53
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455411/

[7455418] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:24:22
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455418/

[7455422] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:25:24
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455422/

[7455428] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:20:58
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455428/

[7455429] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
time:   01:05:51
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455429/

[7455430] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:21:53
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455430/

[7455435] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:22:36
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455435/

[7455441] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs}
time:   00:41:45
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455441/

[7455442] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli}
time:   00:16:10
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455442/

[7455452] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:21:13
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455452/

[7455455] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features}
time:   00:19:15
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455455/

[7455458] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:37:13
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455458/

[7455459] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:22:21
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455459/

[7455460] orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:33:03
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455460/

[7455466] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:22:18
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455466/

[7455469] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:24:34
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455469/

[7455476] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root}
time:   00:52:48
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455476/

[7455477] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:22:14
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455477/

[7455481] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:25:22
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455481/

[7455483] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final}
time:   00:20:51
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455483/

[7455490] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:25:55
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455490/

[7455493] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_set_mon_crush_locations}
time:   00:22:42
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455493/

[7455494] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:19:00
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455494/

[7455496] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:21:19
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455496/

[7455508] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:21:58
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455508/

[7455510] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm}
time:   00:20:25
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455510/

[7455515] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:22:35
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455515/

[7455519] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs}
time:   00:41:57
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455519/

[7455520] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli}
time:   00:16:43
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455520/

[7455524] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/basic 3-final}
time:   00:19:25
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455524/

[7455526] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root}
time:   00:49:29
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455526/

[7455529] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:20:26
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455529/

[7455530] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:22:03
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455530/

[7455534] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain}
time:   00:23:22
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455534/

[7455537] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:20:51
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455537/

[7455539] orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rotate-keys}
time:   00:40:00
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455539/

[7455541] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:26:39
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455541/

[7455548] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:19:54
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455548/

[7455550] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli_mon}
time:   00:39:30
info:   https://pulpito.ceph.com/yuriw-2023-11-10_20:00:12-orch-wip-yuri5-testing-2023-11-10-0828-distro-default-smithi/7455550/