2023-03-11T11:09:13.563 INFO:root:teuthology version: 0.0.1.dev57+g5c9057f
2023-03-11T11:09:13.564 INFO:teuthology.results:subset: '111/120000'
2023-03-11T11:09:13.564 INFO:teuthology.results:seed: '7436'
2023-03-11T14:52:01.213 INFO:root:teuthology version: 0.0.1.dev57+g5c9057f
2023-03-11T14:52:01.242 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-03-11T15:35:05.120 INFO:teuthology.results:Tests finished! gathering results...
2023-03-11T15:35:14.703 INFO:scrape:Found 139 jobs
2023-03-11T15:35:16.903 INFO:scrape:Found 3 distinct failure reasons
2023-03-11T15:35:16.904 INFO:scrape:Failure: Command failed on smithi061 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2f50c44-c014-11ed-9af2-001a4aab830c -e sha1=63c2dce869c8f63c396d3b6505a21c44088ff500 -- bash -c \'ceph versions | jq -e \'"\'"\'.osd | length == 2\'"\'"\'\''
2023-03-11T15:35:16.904 INFO:scrape:6 jobs: ['7203677', '7203532', '7203542', '7203687', '7203593', '7203500']
2023-03-11T15:35:16.904 INFO:scrape:suites intersection: []
2023-03-11T15:35:16.905 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '2-services/nfs-ingress-rgw-user', '2-services/nfs2', '2-thrash', '3-final}', '3-tasks/radosbench', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'msgr/async', 'orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'root}']
2023-03-11T15:35:16.905 INFO:scrape:
2023-03-11T15:35:16.905 INFO:scrape:Failure: Command failed on smithi061 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull'
2023-03-11T15:35:16.906 INFO:scrape:4 jobs: ['7203544', '7203613', '7203683', '7203752']
2023-03-11T15:35:16.906 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_20.04']
2023-03-11T15:35:16.906 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}']
2023-03-11T15:35:16.907 INFO:scrape:
2023-03-11T15:35:16.907 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi202.front.sepia.ceph.com: ['type=AVC msg=audit(1678538709.822:19528): avc:  denied  { ioctl } for  pid=121725 comm="iptables" path="/var/lib/containers/storage/overlay/29f7bd84e741f33238ce27618e040f20785746c775a58509b2ca39776f8cdb39/merged" dev="overlay" ino=3540990 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1']
2023-03-11T15:35:16.907 INFO:scrape:2 jobs: ['7203575', '7203685']
2023-03-11T15:35:16.907 INFO:scrape:suites intersection: ['task/test_cephadm}']
2023-03-11T15:35:16.908 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_cephadm}']
2023-03-11T15:35:16.908 INFO:scrape:
2023-03-11T15:35:16.914 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/
failed:  12
dead:    0
running: 0
waiting: 0
queued:  0
passed:  127


Fail
=================================================================
[7203500]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final}
-----------------------------------------------------------------
time:   00:12:01
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203500/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203500/
sentry: https://sentry.ceph.com/organizations/ceph/?query=54296bc9950c4bfdb2a2ad14b14c2594

    Command failed on smithi008 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay-quay-
    quay.apps.os.sepia.ceph.com/ceph-
    ci/ceph:63c2dce869c8f63c396d3b6505a21c44088ff500 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fa42cef4-bfff-11ed-9af2-001a4aab830c -- ceph osd stat -f json'

[7203532]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:12:30
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203532/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203532/
sentry: https://sentry.ceph.com/organizations/ceph/?query=184ba3bdc016459cb1bb2c7091d48d02

    Command failed on smithi161 with status 127: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay-quay-
    quay.apps.os.sepia.ceph.com/ceph-
    ci/ceph:63c2dce869c8f63c396d3b6505a21c44088ff500 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    57732e70-c005-11ed-9af2-001a4aab830c -- ceph mon dump -f json'

[7203542]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
-----------------------------------------------------------------
time:   01:00:51
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203542/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203542/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dd80560bb3cb42e8bc8d29463ac7483d

    Command failed on smithi102 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    b1b0b622-c006-11ed-9af2-001a4aab830c -e
    sha1=63c2dce869c8f63c396d3b6505a21c44088ff500 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.osd | length == 2\'"\'"\'\''

[7203544]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:28
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203544/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203544/
sentry: https://sentry.ceph.com/organizations/ceph/?query=79cd646f7ad34eebb9ca9e50201f2296

    Command failed on smithi061 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7203575]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:16:54
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203575/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203575/

    SELinux denials found on ubuntu@smithi202.front.sepia.ceph.com: ['type=AVC
    msg=audit(1678538709.822:19528): avc:  denied  { ioctl } for  pid=121725
    comm="iptables" path="/var/lib/containers/storage/overlay/29f7bd84e741f3323
    8ce27618e040f20785746c775a58509b2ca39776f8cdb39/merged" dev="overlay"
    ino=3540990 scontext=system_u:system_r:iptables_t:s0
    tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir
    permissive=1']

[7203593]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic}
-----------------------------------------------------------------
time:   00:54:56
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203593/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203593/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fcad30c24e404b93a8fb644432c13d19

    Command failed on smithi033 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    e3578610-c00b-11ed-9af2-001a4aab830c -e
    sha1=63c2dce869c8f63c396d3b6505a21c44088ff500 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.osd | length == 2\'"\'"\'\''

[7203613]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master}
-----------------------------------------------------------------
time:   00:06:15
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203613/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203613/
sentry: https://sentry.ceph.com/organizations/ceph/?query=158be313099d4adfb97a91b97da1cb2f

    Command failed on smithi112 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7203677]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic}
-----------------------------------------------------------------
time:   00:55:02
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203677/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203677/
sentry: https://sentry.ceph.com/organizations/ceph/?query=22958637d5d3431980de3780535957f7

    Command failed on smithi061 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    d2f50c44-c014-11ed-9af2-001a4aab830c -e
    sha1=63c2dce869c8f63c396d3b6505a21c44088ff500 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.osd | length == 2\'"\'"\'\''

[7203683]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2}
-----------------------------------------------------------------
time:   00:06:12
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203683/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203683/
sentry: https://sentry.ceph.com/organizations/ceph/?query=95e63529f99647feb5e4fdfd7c84f08a

    Command failed on smithi110 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'

[7203685]  orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm}
-----------------------------------------------------------------
time:   00:18:15
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203685/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203685/

    SELinux denials found on ubuntu@smithi196.front.sepia.ceph.com: ['type=AVC
    msg=audit(1678543706.722:19822): avc:  denied  { ioctl } for  pid=108624
    comm="iptables" path="/var/lib/containers/storage/overlay/78307f971604d758f
    1c46f4355061686a6171dcd967c50c84aec9d8ea14c4afd/merged" dev="overlay"
    ino=3412119 scontext=system_u:system_r:iptables_t:s0
    tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir
    permissive=1', 'type=AVC msg=audit(1678543706.834:19825): avc:  denied  {
    ioctl } for  pid=108641 comm="iptables" path="/var/lib/containers/storage/o
    verlay/78307f971604d758f1c46f4355061686a6171dcd967c50c84aec9d8ea14c4afd/mer
    ged" dev="overlay" ino=3412119 scontext=system_u:system_r:iptables_t:s0
    tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir
    permissive=1']

[7203687]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
-----------------------------------------------------------------
time:   00:13:58
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203687/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203687/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af278a1708bd4cc0b5275b60c45bc508

    Command failed on smithi046 with status 127: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay-quay-
    quay.apps.os.sepia.ceph.com/ceph-
    ci/ceph:63c2dce869c8f63c396d3b6505a21c44088ff500 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    3996d626-c015-11ed-9af2-001a4aab830c -- ceph osd stat -f json'

[7203752]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master}
-----------------------------------------------------------------
time:   00:06:28
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203752/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203752/
sentry: https://sentry.ceph.com/organizations/ceph/?query=245cb44f699f4330823c689cb24785ef

    Command failed on smithi033 with status 1: 'sudo systemctl enable --now
    kubelet && sudo kubeadm config images pull'



Pass
=================================================================
[7203497] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
time:   00:15:45
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203497/

[7203498] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:18:16
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203498/

[7203503] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
time:   00:28:09
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203503/

[7203504] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_nfs}
time:   00:30:49
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203504/

[7203506] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:19:56
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203506/

[7203508] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:15:45
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203508/

[7203510] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:39:48
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203510/

[7203512] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root}
time:   00:48:37
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203512/

[7203514] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
time:   00:31:24
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203514/

[7203516] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:17:19
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203516/

[7203518] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:41
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203518/

[7203520] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:17:55
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203520/

[7203522] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:13:24
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203522/

[7203524] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_orch_cli}
time:   00:17:59
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203524/

[7203526] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:17:22
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203526/

[7203528] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:18:19
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203528/

[7203530] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:15:04
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203530/

[7203534] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:26:09
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203534/

[7203536] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:18:44
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203536/

[7203538] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_orch_cli_mon}
time:   00:36:04
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203538/

[7203540] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:14:52
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203540/

[7203546] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:17:14
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203546/

[7203548] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:14:44
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203548/

[7203550] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:14:41
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203550/

[7203552] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_adoption}
time:   00:12:51
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203552/

[7203554] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:40:29
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203554/

[7203556] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli}
time:   00:16:16
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203556/

[7203558] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi}
time:   00:31:16
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203558/

[7203560] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final}
time:   00:13:18
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203560/

[7203562] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:27
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203562/

[7203564] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root}
time:   00:32:34
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203564/

[7203566] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:37:31
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203566/

[7203568] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:16:50
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203568/

[7203570] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:34:00
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203570/

[7203572] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:24:59
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203572/

[7203574] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:16:37
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203574/

[7203578] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:14:22
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203578/

[7203579] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root}
time:   00:40:53
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203579/

[7203581] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:27:14
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203581/

[7203583] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:20:50
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203583/

[7203585] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:16:30
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203585/

[7203587] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos}
time:   00:09:46
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203587/

[7203589] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:15:58
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203589/

[7203591] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:28
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203591/

[7203595] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:16:23
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203595/

[7203597] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:15:59
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203597/

[7203599] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:41:12
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203599/

[7203601] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
time:   00:38:20
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203601/

[7203603] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
time:   00:28:02
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203603/

[7203605] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:16:31
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203605/

[7203607] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
time:   00:17:15
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203607/

[7203609] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:15:53
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203609/

[7203611] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:14:52
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203611/

[7203615] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:24
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203615/

[7203617] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:15:40
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203617/

[7203619] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:24:08
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203619/

[7203621] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_nfs}
time:   00:33:17
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203621/

[7203623] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli}
time:   00:17:22
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203623/

[7203625] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final}
time:   00:14:16
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203625/

[7203627] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:13:48
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203627/

[7203629] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
time:   01:01:46
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203629/

[7203631] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests}
time:   00:43:33
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203631/

[7203633] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:16:00
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203633/

[7203635] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:18:18
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203635/

[7203637] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   00:34:23
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203637/

[7203639] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:14:07
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203639/

[7203641] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:14:02
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203641/

[7203643] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli}
time:   00:16:04
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203643/

[7203645] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:17:03
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203645/

[7203647] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:40:12
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203647/

[7203649] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
time:   00:32:11
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203649/

[7203651] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
time:   00:24:54
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203651/

[7203653] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:16:43
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203653/

[7203655] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon}
time:   00:24:36
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203655/

[7203657] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:15:27
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203657/

[7203659] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:13:35
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203659/

[7203661] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:18:17
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203661/

[7203663] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:19:42
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203663/

[7203665] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:32:02
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203665/

[7203667] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
time:   00:38:58
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203667/

[7203669] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:25:44
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203669/

[7203671] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption}
time:   00:14:37
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203671/

[7203673] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:15:08
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203673/

[7203675] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:24:06
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203675/

[7203679] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:15:53
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203679/

[7203681] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:14:31
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203681/

[7203689] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:39
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203689/

[7203691] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:40:07
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203691/

[7203693] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli}
time:   00:17:09
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203693/

[7203695] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi}
time:   00:33:14
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203695/

[7203697] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:16:22
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203697/

[7203699] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final}
time:   00:17:37
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203699/

[7203701] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:13:01
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203701/

[7203703] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
time:   00:40:27
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203703/

[7203705] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:40:32
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203705/

[7203707] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:17:50
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203707/

[7203709] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:14:39
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203709/

[7203711] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:06:46
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203711/

[7203713] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:22:57
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203713/

[7203715] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:16:29
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203715/

[7203717] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:14:34
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203717/

[7203719] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
time:   00:53:14
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203719/

[7203721] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:26:14
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203721/

[7203723] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:33:59
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203723/

[7203725] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
time:   00:15:31
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203725/

[7203727] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:14:29
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203727/

[7203729] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:17:15
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203729/

[7203731] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:36
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203731/

[7203732] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:19:58
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203732/

[7203734] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:18:09
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203734/

[7203736] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs}
time:   00:29:00
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203736/

[7203738] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:39:53
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203738/

[7203740] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
time:   00:44:56
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203740/

[7203742] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
time:   00:38:13
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203742/

[7203744] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:16:09
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203744/

[7203746] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:15
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203746/

[7203748] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:15:52
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203748/

[7203750] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:17:58
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203750/

[7203754] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:17:05
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203754/

[7203756] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli}
time:   00:18:49
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203756/

[7203758] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:15:20
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203758/

[7203760] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli}
time:   00:16:18
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203760/

[7203762] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final}
time:   00:16:21
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203762/

[7203764] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:13:33
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203764/

[7203766] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root}
time:   00:38:34
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203766/

[7203768] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:28:13
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203768/

[7203770] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:36:34
info:   http://pulpito.ceph.com/yuriw-2023-03-10_22:53:09-orch-reef-distro-default-smithi/7203770/