2023-10-07T21:57:51.321 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-07T21:57:51.322 INFO:teuthology.results:subset: '111/120000'
2023-10-07T21:57:51.322 INFO:teuthology.results:seed: '9235'
2023-10-08T04:15:29.715 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-08T04:15:29.749 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-10-08T16:15:30.720 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-10-08T16:15:42.456 INFO:scrape:Found 155 jobs
2023-10-08T16:15:46.645 INFO:scrape:Found 5 distinct failure reasons
2023-10-08T16:15:46.645 INFO:scrape:Dead: b'2023-10-08T16:15:41.708 INFO:journalctl@ceph.mon.smithi194.smithi194.stdout:Oct 08 16:15:41 smithi194 ceph-mon[104785]: from=\'mgr.14213 172.21.15.135:0/45772831\' entity=\'mgr.smithi135.vegapu\' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch'
2023-10-08T16:15:46.645 INFO:scrape:1 jobs: ['7417256']
2023-10-08T16:15:46.645 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress2', '3-final}', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8']
2023-10-08T16:15:46.646 INFO:scrape:
2023-10-08T16:15:46.646 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds
2023-10-08T16:15:46.646 INFO:scrape:3 jobs: ['7416982', '7417109', '7417213']
2023-10-08T16:15:46.646 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}']
2023-10-08T16:15:46.646 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0']
2023-10-08T16:15:46.646 INFO:scrape:
2023-10-08T16:15:46.646 INFO:scrape:Failure: Command failed on smithi163 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"
2023-10-08T16:15:46.646 INFO:scrape:4 jobs: ['7417009', '7417222', '7417145', '7417087']
2023-10-08T16:15:46.647 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_20.04']
2023-10-08T16:15:46.647 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}']
2023-10-08T16:15:46.647 INFO:scrape:
2023-10-08T16:15:46.647 INFO:scrape:Failure: Command failed on smithi082 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d44655b4-657b-11ee-8db5-212e2dc638e7 -e sha1=9725b08fd801c82987c737f7e6d354878f036ee8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''
2023-10-08T16:15:46.647 INFO:scrape:2 jobs: ['7417015', '7417149']
2023-10-08T16:15:46.647 INFO:scrape:suites intersection: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools']
2023-10-08T16:15:46.647 INFO:scrape:suites union: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools']
2023-10-08T16:15:46.648 INFO:scrape:
2023-10-08T16:15:46.648 INFO:scrape:Dead: b'2023-10-08T14:44:49.269 DEBUG:teuthology.exit:Finished running handlers'
2023-10-08T16:15:46.648 INFO:scrape:1 jobs: ['7417134']
2023-10-08T16:15:46.648 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress2', '3-final}', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0']
2023-10-08T16:15:46.648 INFO:scrape:
2023-10-08T16:15:46.653 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/
failed:  9
dead:    1
running: 1
waiting: 0
queued:  0
passed:  144


Fail
=================================================================
[7416982]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final}
-----------------------------------------------------------------
time:   00:30:18
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416982/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416982/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8d3a4911f8f543ea8a4d9462633325e5

    reached maximum tries (301) after waiting for 300 seconds

[7417009]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:06
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417009/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417009/
sentry: https://sentry.ceph.com/organizations/ceph/?query=215f79854126426ea8d4dcf4d4a230a0

    Command failed on smithi163 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7417015]  orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:31:13
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417015/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417015/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c9ecf5b5672541818d79b428ee7a4436

    Command failed on smithi082 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    d44655b4-657b-11ee-8db5-212e2dc638e7 -e
    sha1=9725b08fd801c82987c737f7e6d354878f036ee8 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7417087]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:06:17
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417087/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417087/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1b5a0b9225db4d09ae07224374ac8dfe

    Command failed on smithi125 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7417109]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final}
-----------------------------------------------------------------
time:   00:28:47
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417109/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417109/
sentry: https://sentry.ceph.com/organizations/ceph/?query=97ad67c1bb384b52843f5c4a6244929d

    reached maximum tries (301) after waiting for 300 seconds

[7417145]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:05
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417145/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417145/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d68995dc6acf431e8b602d0981c09e1c

    Command failed on smithi089 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7417149]  orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:32:46
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417149/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417149/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6f63ff9c2441492a96ac6437f303090c

    Command failed on smithi019 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    988f33ae-6587-11ee-8db5-212e2dc638e7 -e
    sha1=9725b08fd801c82987c737f7e6d354878f036ee8 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7417213]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final}
-----------------------------------------------------------------
time:   00:37:51
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417213/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417213/
sentry: https://sentry.ceph.com/organizations/ceph/?query=216b4bb8f89b4dab9a129a58ca283127

    reached maximum tries (301) after waiting for 300 seconds

[7417222]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master}
-----------------------------------------------------------------
time:   00:06:22
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417222/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417222/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6ddd460832f140dab312212439f2e25e

    Command failed on smithi006 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"



Dead
=================================================================
[7417134]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417134/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417134/

    hit max job timeout



Running
=================================================================
[7417256] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417256/



Pass
=================================================================
[7416984] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:13:58
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416984/

[7416985] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:51
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416985/

[7416988] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:14:18
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416988/

[7416990] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:29:46
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416990/

[7416991] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
time:   00:36:19
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416991/

[7416993] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:25:50
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416993/

[7416995] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:16:30
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416995/

[7416998] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:24:00
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7416998/

[7417000] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:19:46
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417000/

[7417001] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic}
time:   00:47:21
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417001/

[7417003] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:19:17
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417003/

[7417005] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:14:36
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417005/

[7417007] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli}
time:   00:16:36
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417007/

[7417011] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:21:32
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417011/

[7417013] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:07
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417013/

[7417017] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs}
time:   00:36:46
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417017/

[7417019] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli}
time:   00:18:30
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417019/

[7417021] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
time:   00:36:34
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417021/

[7417023] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:17
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417023/

[7417025] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:17:32
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417025/

[7417027] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final}
time:   00:12:38
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417027/

[7417029] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:53
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417029/

[7417031] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
time:   00:42:12
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417031/

[7417033] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:43:36
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417033/

[7417035] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon}
time:   00:25:32
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417035/

[7417037] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:16:16
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417037/

[7417039] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:15:17
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417039/

[7417041] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:20:39
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417041/

[7417043] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite}
time:   00:24:44
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417043/

[7417045] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:16:09
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417045/

[7417047] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:19:46
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417047/

[7417049] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
time:   00:55:03
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417049/

[7417051] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:28:38
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417051/

[7417053] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:38
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417053/

[7417055] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:37:47
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417055/

[7417057] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations}
time:   00:26:09
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417057/

[7417059] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:18:40
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417059/

[7417061] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:20:36
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417061/

[7417063] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:15:25
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417063/

[7417065] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:32
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417065/

[7417067] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_adoption}
time:   00:19:11
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417067/

[7417069] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:21:06
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417069/

[7417071] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:17:49
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417071/

[7417073] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
time:   00:42:45
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417073/

[7417075] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
time:   00:37:51
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417075/

[7417077] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:22:30
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417077/

[7417079] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:03
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417079/

[7417081] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_ca_signed_key}
time:   00:16:40
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417081/

[7417083] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:19:59
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417083/

[7417085] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:17:47
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417085/

[7417089] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:19:48
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417089/

[7417091] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:19:27
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417091/

[7417093] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_cephadm}
time:   00:16:40
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417093/

[7417095] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli}
time:   00:20:54
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417095/

[7417097] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:15:50
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417097/

[7417099] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final}
time:   00:18:27
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417099/

[7417101] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:14:03
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417101/

[7417103] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root}
time:   00:39:02
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417103/

[7417105] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:29:35
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417105/

[7417107] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:36:38
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417107/

[7417111] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_cephadm_repos}
time:   00:09:33
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417111/

[7417113] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:17:29
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417113/

[7417115] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:32
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417115/

[7417116] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:24:03
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417116/

[7417117] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:19:09
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417117/

[7417118] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_extra_daemon_features}
time:   00:20:31
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417118/

[7417119] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:17:50
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417119/

[7417120] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root}
time:   00:37:06
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417120/

[7417121] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
time:   00:24:11
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417121/

[7417122] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:21:38
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417122/

[7417123] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:18:49
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417123/

[7417124] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:16:12
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417124/

[7417125] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:13
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417125/

[7417126] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:15:19
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417126/

[7417127] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:15:57
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417127/

[7417128] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:13:06
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417128/

[7417129] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:17:24
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417129/

[7417130] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   01:01:30
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417130/

[7417131] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_orch_cli}
time:   00:18:54
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417131/

[7417132] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root}
time:   00:49:38
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417132/

[7417133] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys}
time:   00:30:45
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417133/

[7417135] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:14:07
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417135/

[7417137] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:12
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417137/

[7417139] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:18:43
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417139/

[7417141] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_orch_cli_mon}
time:   00:25:54
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417141/

[7417143] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:05
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417143/

[7417147] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:20:06
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417147/

[7417151] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs}
time:   00:24:34
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417151/

[7417153] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli}
time:   00:18:28
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417153/

[7417155] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
time:   00:33:30
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417155/

[7417157] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:14:24
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417157/

[7417159] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final}
time:   00:13:33
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417159/

[7417161] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:12:45
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417161/

[7417163] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root}
time:   00:37:08
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417163/

[7417165] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:43:16
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417165/

[7417167] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_rgw_multisite}
time:   00:17:22
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417167/

[7417169] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:16:10
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417169/

[7417171] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:21:34
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417171/

[7417173] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:14:13
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417173/

[7417175] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_set_mon_crush_locations}
time:   00:26:52
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417175/

[7417177] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:23:32
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417177/

[7417179] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:09
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417179/

[7417181] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
time:   00:29:32
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417181/

[7417183] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:20:18
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417183/

[7417185] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root}
time:   00:48:03
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417185/

[7417187] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:31:07
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417187/

[7417189] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption}
time:   00:18:13
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417189/

[7417191] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:13:52
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417191/

[7417193] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:19:17
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417193/

[7417195] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:18:24
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417195/

[7417197] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:14:09
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417197/

[7417199] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:14:05
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417199/

[7417201] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_ca_signed_key}
time:   00:18:28
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417201/

[7417203] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:14:22
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417203/

[7417205] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:18
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417205/

[7417207] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
time:   00:35:30
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417207/

[7417209] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
time:   00:26:11
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417209/

[7417211] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:25:33
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417211/

[7417215] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:27
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417215/

[7417216] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm}
time:   00:18:31
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417216/

[7417218] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:18:09
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417218/

[7417220] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:57:31
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417220/

[7417224] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:20:42
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417224/

[7417226] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm_repos}
time:   00:09:10
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417226/

[7417228] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:51
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417228/

[7417230] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli}
time:   00:19:35
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417230/

[7417232] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:15:18
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417232/

[7417234] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:16:50
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417234/

[7417236] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final}
time:   00:15:25
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417236/

[7417238] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:13:13
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417238/

[7417240] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
time:   00:45:01
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417240/

[7417242] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:36:06
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417242/

[7417244] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:16:51
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417244/

[7417246] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_extra_daemon_features}
time:   00:17:17
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417246/

[7417248] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:16:11
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417248/

[7417250] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:21:05
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417250/

[7417252] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:17:50
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417252/

[7417254] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:16:09
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417254/

[7417258] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
time:   00:39:15
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417258/

[7417260] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
time:   00:27:51
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417260/

[7417262] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:18:40
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417262/

[7417264] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:46
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417264/

[7417266] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:20:14
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417266/

[7417268] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_orch_cli}
time:   00:21:00
info:   http://pulpito.ceph.com/yuriw-2023-10-07_14:03:45-orch-main-distro-default-smithi/7417268/