2023-10-15T21:26:09.572 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07
2023-10-15T21:26:09.573 INFO:teuthology.results:subset: '111/120000'
2023-10-15T21:26:09.573 INFO:teuthology.results:seed: '3520'
2023-10-16T00:48:25.741 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07
2023-10-16T00:48:25.765 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-10-16T12:49:25.375 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-10-16T12:49:37.007 INFO:scrape:Found 155 jobs
2023-10-16T12:49:39.962 INFO:scrape:Found 4 distinct failure reasons
2023-10-16T12:49:39.963 INFO:scrape:Failure: Command failed on smithi081 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils"
2023-10-16T12:49:39.963 INFO:scrape:4 jobs: ['7427110', '7427149', '7427188', '7427227']
2023-10-16T12:49:39.964 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_20.04']
2023-10-16T12:49:39.964 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}']
2023-10-16T12:49:39.965 INFO:scrape:
2023-10-16T12:49:39.965 INFO:scrape:Dead: b'2023-10-16T10:01:06.151 DEBUG:teuthology.exit:Finished running handlers'
2023-10-16T12:49:39.965 INFO:scrape:2 jobs: ['7427113', '7427182']
2023-10-16T12:49:39.966 INFO:scrape:suites intersection: ['1-start']
2023-10-16T12:49:39.966 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/17.2.0', '1-start', '2-nfs', '2-services/nfs-ingress2', '3-final}', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0']
2023-10-16T12:49:39.967 INFO:scrape:
2023-10-16T12:49:39.967 INFO:scrape:Failure: Command failed on smithi118 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5af66fda-6bb8-11ee-8db6-212e2dc638e7 -e sha1=bcf5b23faa7fe51d364c0e949f01773ae6822e01 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''
2023-10-16T12:49:39.967 INFO:scrape:2 jobs: ['7427190', '7427178']
2023-10-16T12:49:39.968 INFO:scrape:suites intersection: []
2023-10-16T12:49:39.969 INFO:scrape:suites union: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '2-repo_digest/defaut', '3-upgrade-with-workload', '3-upgrade/staggered', '4-final}', '4-wait', '5-upgrade-ls', 'agent/on', 'mon_election/connectivity}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04']
2023-10-16T12:49:39.969 INFO:scrape:
2023-10-16T12:49:39.970 INFO:scrape:Dead: b'2023-10-16T12:49:38.194 INFO:teuthology.orchestra.run.smithi005.stderr:+ timeout 1 cat /mnt/foo/testfile'
2023-10-16T12:49:39.970 INFO:scrape:1 jobs: ['7427244']
2023-10-16T12:49:39.971 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress2', '3-final}', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8']
2023-10-16T12:49:39.971 INFO:scrape:
2023-10-16T12:49:39.976 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/
failed:  6
dead:    2
running: 1
waiting: 0
queued:  0
passed:  146


Fail
=================================================================
[7427110]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:05:55
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427110/
log:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427110/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5c62957461e14ea5b77dfdb6c3e9edb4

    Command failed on smithi081 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7427149]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:06:11
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427149/
log:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427149/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e7c2ba2b80934ac9a4429d813b49d2af

    Command failed on smithi049 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7427178]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
-----------------------------------------------------------------
time:   00:49:34
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427178/
log:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427178/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f916646c46b841d2ad9aad27b0066b97

    Command failed on smithi183 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    899e6344-6bb6-11ee-8db6-212e2dc638e7 -e
    sha1=bcf5b23faa7fe51d364c0e949f01773ae6822e01 -- bash -c \'ceph orch
    upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date |
    length == 7\'"\'"\'\''

[7427188]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:12
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427188/
log:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427188/
sentry: https://sentry.ceph.com/organizations/ceph/?query=457dc53171a74ebcb013036b29afdab2

    Command failed on smithi173 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"

[7427190]  orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:31:31
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427190/
log:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427190/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ef7b1f255824d6983f6c8fbffd2dec4

    Command failed on smithi118 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    5af66fda-6bb8-11ee-8db6-212e2dc638e7 -e
    sha1=bcf5b23faa7fe51d364c0e949f01773ae6822e01 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7427227]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master}
-----------------------------------------------------------------
time:   00:06:18
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427227/
log:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427227/
sentry: https://sentry.ceph.com/organizations/ceph/?query=680e1b2526a64e90bdd9f43ac953d6d3

    Command failed on smithi072 with status 100: "sudo apt update && sudo apt
    install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo
    /usr/share/keyrings/kubernetes-archive-keyring.gpg
    https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-
    by=/usr/share/keyrings/kubernetes-archive-keyring.gpg]
    https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee
    /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt
    install -y kubelet kubeadm kubectl bridge-utils"



Dead
=================================================================
[7427113]  orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427113/
log:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427113/

    hit max job timeout

[7427182]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427182/
log:    http://qa-proxy.ceph.com/teuthology/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427182/

    hit max job timeout



Running
=================================================================
[7427244] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427244/



Pass
=================================================================
[7427096] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:14:34
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427096/

[7427097] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:13:46
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427097/

[7427098] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:19:18
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427098/

[7427099] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:15:04
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427099/

[7427100] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:42
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427100/

[7427101] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
time:   00:38:05
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427101/

[7427102] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:27:31
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427102/

[7427103] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:16:13
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427103/

[7427104] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:23:51
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427104/

[7427105] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:19:41
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427105/

[7427106] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic}
time:   00:47:32
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427106/

[7427107] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:18:19
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427107/

[7427108] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:14:11
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427108/

[7427109] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli}
time:   00:15:57
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427109/

[7427111] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:21:06
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427111/

[7427112] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:00
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427112/

[7427114] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs}
time:   00:24:38
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427114/

[7427115] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli}
time:   00:14:21
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427115/

[7427116] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
time:   00:43:14
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427116/

[7427117] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:15:10
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427117/

[7427118] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:16:05
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427118/

[7427119] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final}
time:   00:18:02
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427119/

[7427120] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:12
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427120/

[7427121] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
time:   00:42:56
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427121/

[7427122] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:42:05
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427122/

[7427123] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon}
time:   00:33:40
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427123/

[7427124] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:15:53
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427124/

[7427125] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:13:43
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427125/

[7427126] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:19:20
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427126/

[7427127] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite}
time:   00:20:10
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427127/

[7427128] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:14:53
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427128/

[7427129] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:17:57
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427129/

[7427130] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
time:   00:54:08
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427130/

[7427131] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:26:20
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427131/

[7427132] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:42:08
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427132/

[7427133] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:37:44
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427133/

[7427134] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations}
time:   00:23:25
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427134/

[7427135] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:18:51
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427135/

[7427136] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:19:44
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427136/

[7427137] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:15:18
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427137/

[7427138] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:14
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427138/

[7427139] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_adoption}
time:   00:15:06
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427139/

[7427140] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:18:38
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427140/

[7427141] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:16:50
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427141/

[7427142] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
time:   00:45:01
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427142/

[7427143] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
time:   00:38:07
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427143/

[7427144] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:20:14
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427144/

[7427145] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:38:34
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427145/

[7427146] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_ca_signed_key}
time:   00:16:58
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427146/

[7427147] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:18:04
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427147/

[7427148] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:16:24
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427148/

[7427150] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:18:27
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427150/

[7427151] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:20:12
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427151/

[7427152] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_cephadm}
time:   00:17:26
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427152/

[7427153] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli}
time:   00:18:40
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427153/

[7427154] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:14:53
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427154/

[7427155] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final}
time:   00:17:16
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427155/

[7427156] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:14:15
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427156/

[7427157] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root}
time:   00:35:55
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427157/

[7427158] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:29:18
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427158/

[7427159] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:38:16
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427159/

[7427160] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:15:39
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427160/

[7427161] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_cephadm_repos}
time:   00:09:17
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427161/

[7427162] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:17:06
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427162/

[7427163] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:05
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427163/

[7427164] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:23:56
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427164/

[7427165] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:18:37
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427165/

[7427166] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_extra_daemon_features}
time:   00:20:53
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427166/

[7427167] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:18:28
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427167/

[7427168] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root}
time:   00:35:20
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427168/

[7427169] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
time:   00:23:02
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427169/

[7427170] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:23:49
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427170/

[7427171] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:19:05
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427171/

[7427172] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:16:12
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427172/

[7427173] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:50
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427173/

[7427174] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:16:22
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427174/

[7427175] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:15:36
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427175/

[7427176] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:14:00
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427176/

[7427177] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:17:22
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427177/

[7427179] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_orch_cli}
time:   00:18:20
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427179/

[7427180] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root}
time:   00:52:06
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427180/

[7427181] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys}
time:   00:30:56
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427181/

[7427183] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:14:22
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427183/

[7427184] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:15:06
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427184/

[7427185] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:18:46
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427185/

[7427186] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_orch_cli_mon}
time:   00:25:58
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427186/

[7427187] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:03
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427187/

[7427189] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:19:56
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427189/

[7427191] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs}
time:   00:24:54
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427191/

[7427192] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli}
time:   00:18:55
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427192/

[7427193] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi}
time:   00:37:17
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427193/

[7427194] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:15:25
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427194/

[7427195] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final}
time:   00:14:46
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427195/

[7427196] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:38
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427196/

[7427197] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root}
time:   00:37:31
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427197/

[7427198] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:41:38
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427198/

[7427199] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_rgw_multisite}
time:   00:18:21
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427199/

[7427200] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:14:44
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427200/

[7427201] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:19:51
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427201/

[7427202] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:14:22
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427202/

[7427203] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_set_mon_crush_locations}
time:   00:25:44
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427203/

[7427204] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:24:14
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427204/

[7427205] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:37
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427205/

[7427206] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
time:   00:31:00
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427206/

[7427207] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:20:26
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427207/

[7427208] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root}
time:   00:49:16
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427208/

[7427209] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:30:35
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427209/

[7427210] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption}
time:   00:17:30
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427210/

[7427211] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:14:02
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427211/

[7427212] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:18:44
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427212/

[7427213] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:18:19
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427213/

[7427214] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:14:12
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427214/

[7427215] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:50
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427215/

[7427216] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_ca_signed_key}
time:   00:18:59
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427216/

[7427217] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:15:17
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427217/

[7427218] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:59
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427218/

[7427219] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
time:   00:35:53
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427219/

[7427220] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
time:   00:25:52
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427220/

[7427221] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:25:09
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427221/

[7427222] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:20:33
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427222/

[7427223] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:19:01
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427223/

[7427224] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm}
time:   00:18:39
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427224/

[7427225] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:18:52
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427225/

[7427226] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:56:30
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427226/

[7427228] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:20:18
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427228/

[7427229] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm_repos}
time:   00:09:07
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427229/

[7427230] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:59
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427230/

[7427231] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli}
time:   00:19:09
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427231/

[7427232] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:15:20
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427232/

[7427233] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:15:28
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427233/

[7427234] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final}
time:   00:13:38
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427234/

[7427235] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:14:03
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427235/

[7427236] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
time:   00:59:15
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427236/

[7427237] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:36:22
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427237/

[7427238] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:16:21
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427238/

[7427239] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_extra_daemon_features}
time:   00:16:31
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427239/

[7427240] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:16:41
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427240/

[7427241] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:21:50
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427241/

[7427242] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}}
time:   00:18:04
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427242/

[7427243] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:16:00
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427243/

[7427245] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
time:   00:38:34
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427245/

[7427246] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
time:   00:27:34
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427246/

[7427247] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:18:41
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427247/

[7427248] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:15
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427248/

[7427249] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:19:56
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427249/

[7427250] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_orch_cli}
time:   00:19:59
info:   http://pulpito.ceph.com/lflores-2023-10-13_22:47:36-orch-main-distro-default-smithi/7427250/