2023-11-19T16:47:16.990 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-19T16:47:16.990 INFO:teuthology.results:subset: '111/120000' 2023-11-19T16:47:16.990 INFO:teuthology.results:seed: '8632' 2023-11-19T23:17:21.303 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-19T23:17:21.318 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-19T23:58:24.715 INFO:teuthology.results:Tests finished! gathering results... 2023-11-19T23:58:31.487 INFO:scrape:Found 159 jobs 2023-11-19T23:58:31.799 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:31.799 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:31.799 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:31.837 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:31.837 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:31.838 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:32.615 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:32.615 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:32.615 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:32.685 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:32.685 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:32.685 WARNING:scrape:Saw end of BT but not start 2023-11-19T23:58:32.697 INFO:scrape:Found 5 distinct failure reasons 2023-11-19T23:58:32.698 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2023-11-19T23:58:32.698 INFO:scrape:1 jobs: ['7462385'] 2023-11-19T23:58:32.698 INFO:scrape:suites: ['agent/off', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_adoption}'] 2023-11-19T23:58:32.698 INFO:scrape: 2023-11-19T23:58:32.698 INFO:scrape:Failure: Command failed on smithi084 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53b435fa-8723-11ee-959e-87774f69a715 -e sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-11-19T23:58:32.698 INFO:scrape:5 jobs: ['7462359', '7462351', '7462300', '7462438', '7462425'] 2023-11-19T23:58:32.698 INFO:scrape:suites intersection: [] 2023-11-19T23:58:32.698 INFO:scrape:suites union: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '2-repo_digest/defaut', '3-upgrade-with-workload', '3-upgrade/staggered', '4-final}', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_rgw_multisite}'] 2023-11-19T23:58:32.699 INFO:scrape: 2023-11-19T23:58:32.699 INFO:scrape:Failure: Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76fd007c-8733-11ee-959e-87774f69a715 -- ceph rgw realm bootstrap -i -' 2023-11-19T23:58:32.699 INFO:scrape:2 jobs: ['7462447', '7462373'] 2023-11-19T23:58:32.699 INFO:scrape:suites intersection: ['agent/off', 'mon_election/connectivity', 'task/test_rgw_multisite}'] 2023-11-19T23:58:32.699 INFO:scrape:suites union: ['agent/off', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_rgw_multisite}'] 2023-11-19T23:58:32.699 INFO:scrape: 2023-11-19T23:58:32.699 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi078.front.sepia.ceph.com: ['type=AVC msg=audit(1700434000.095:21851): avc: denied { ioctl } for pid=123495 comm="iptables" path="/var/lib/containers/storage/overlay/cdb9d2d56105493a25aa347ce902a50d54adaad3395c991c06ec5e265ee89626/merged" dev="overlay" ino=1836693 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1700434000.436:21855): avc: denied { ioctl } for pid=123530 comm="iptables" path="/var/lib/containers/storage/overlay/cdb9d2d56105493a25aa347ce902a50d54adaad3395c991c06ec5e265ee89626/merged" dev="overlay" ino=1836693 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2023-11-19T23:58:32.699 INFO:scrape:1 jobs: ['7462410'] 2023-11-19T23:58:32.699 INFO:scrape:suites: ['agent/off', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_extra_daemon_features}'] 2023-11-19T23:58:32.700 INFO:scrape: 2023-11-19T23:58:32.700 INFO:scrape:Failure: Command failed on smithi049 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" 2023-11-19T23:58:32.700 INFO:scrape:4 jobs: ['7462395', '7462435', '7462356', '7462316'] 2023-11-19T23:58:32.700 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_20.04'] 2023-11-19T23:58:32.700 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}'] 2023-11-19T23:58:32.700 INFO:scrape: 2023-11-19T23:58:32.705 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/ failed: 13 dead: 0 running: 0 waiting: 0 queued: 0 passed: 146 Fail ================================================================= [7462300] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:31:22 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462300/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462300/ sentry: https://sentry.ceph.com/organizations/ceph/?query=37558a9d936945458443af7eb0b1e88b Command failed on smithi019 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c2344cc8-8718-11ee-959e-87774f69a715 -- ceph rgw realm bootstrap -i -' [7462316] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:06:12 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462316/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462316/ sentry: https://sentry.ceph.com/organizations/ceph/?query=535a52845c5e49aca78f299284365934 Command failed on smithi138 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7462351] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:42:12 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462351/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462351/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b812e58fd94a40dbbf2a601b2be8b728 Command failed on smithi012 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35006c70-8721-11ee-959e-87774f69a715 -e sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\'' [7462356] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:06:09 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462356/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462356/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2034b763c8043998c3b38e32ee95c18 Command failed on smithi073 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7462359] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:30:57 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462359/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462359/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e6b687c86394385bf9c4dacbfb77e65 Command failed on smithi084 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 53b435fa-8723-11ee-959e-87774f69a715 -e sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7462373] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:21:08 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462373/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462373/ sentry: https://sentry.ceph.com/organizations/ceph/?query=95f99a410d79410dba63ddbc6942f8d8 Command failed on smithi061 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8409728-8726-11ee-959e-87774f69a715 -- ceph rgw realm bootstrap -i -' [7462385] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:10:26 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462385/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462385/ sentry: https://sentry.ceph.com/organizations/ceph/?query=256a269caf87449d8566e2c6a9259515 Command failed (workunit test cephadm/test_adoption.sh) on smithi029 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [7462395] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:06:16 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462395/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462395/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9505a8c00aa4dcbb8fc62c4c443302c Command failed on smithi049 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7462410] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_extra_daemon_features} ----------------------------------------------------------------- time: 00:20:23 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462410/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462410/ SELinux denials found on ubuntu@smithi078.front.sepia.ceph.com: ['type=AVC msg=audit(1700434000.095:21851): avc: denied { ioctl } for pid=123495 comm="iptables" path="/var/lib/containers/storage/overlay/cdb9d2d56105493a2 5aa347ce902a50d54adaad3395c991c06ec5e265ee89626/merged" dev="overlay" ino=1836693 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1700434000.436:21855): avc: denied { ioctl } for pid=123530 comm="iptables" path="/var/lib/containers/storage/o verlay/cdb9d2d56105493a25aa347ce902a50d54adaad3395c991c06ec5e265ee89626/mer ged" dev="overlay" ino=1836693 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7462425] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:48:54 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462425/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462425/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5fd04fc3004453eb45b9d3567c6627e Command failed on smithi079 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 119b8784-872f-11ee-959e-87774f69a715 -e sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\'' [7462435] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:06:00 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462435/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462435/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83658b5714894e7291c98118b5d46e84 Command failed on smithi078 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7462438] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:31:02 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462438/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462438/ sentry: https://sentry.ceph.com/organizations/ceph/?query=502e012e18ec4fdea3f4ea6f6fd7418b Command failed on smithi162 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b812fe4-8732-11ee-959e-87774f69a715 -e sha1=b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7462447] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:18:04 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462447/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462447/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3c44458b7a54d92be5cf5535f9d16c8 Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:b0f45a51a24e8eca7cf153dba57cbb536ce5b3fe shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 76fd007c-8733-11ee-959e-87774f69a715 -- ceph rgw realm bootstrap -i -' Pass ================================================================= [7462292] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:24:52 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462292/ [7462293] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:20:17 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462293/ [7462294] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:19 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462294/ [7462295] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:19:25 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462295/ [7462296] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_orch_cli_mon} time: 00:38:19 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462296/ [7462297] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:42:26 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462297/ [7462298] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:15 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462298/ [7462299] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:23:25 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462299/ [7462301] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:39:42 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462301/ [7462302] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:26 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462302/ [7462303] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:24:53 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462303/ [7462304] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:18 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462304/ [7462305] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:49:53 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462305/ [7462306] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:27 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462306/ [7462307] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:17:01 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462307/ [7462308] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:24:42 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462308/ [7462309] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:42:40 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462309/ [7462310] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:30:04 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462310/ [7462311] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:20:48 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462311/ [7462312] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption} time: 00:18:07 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462312/ [7462313] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:28 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462313/ [7462314] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:33 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462314/ [7462315] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:38 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462315/ [7462317] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:19 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462317/ [7462318] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:19:29 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462318/ [7462319] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_ca_signed_key} time: 00:17:40 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462319/ [7462320] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} time: 00:13:17 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462320/ [7462321] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:18:20 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462321/ [7462322] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:19:45 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462322/ [7462323] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:14:18 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462323/ [7462324] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:03:41 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462324/ [7462325] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:43:49 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462325/ [7462326] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm} time: 00:18:58 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462326/ [7462327] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:51 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462327/ [7462328] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:17 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462328/ [7462329] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:41:20 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462329/ [7462330] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:02 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462330/ [7462331] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:18:02 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462331/ [7462332] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm_repos} time: 00:10:22 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462332/ [7462333] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:56 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462333/ [7462334] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:16:35 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462334/ [7462335] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:33:29 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462335/ [7462336] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:24:09 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462336/ [7462337] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_extra_daemon_features} time: 00:19:53 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462337/ [7462338] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:17 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462338/ [7462339] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:19:23 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462339/ [7462340] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:15:02 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462340/ [7462341] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:23 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462341/ [7462342] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:11 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462342/ [7462343] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_host_drain} time: 00:23:36 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462343/ [7462344] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:42 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462344/ [7462345] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:59 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462345/ [7462346] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:37:45 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462346/ [7462347] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:25:39 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462347/ [7462348] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:42 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462348/ [7462349] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:48 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462349/ [7462350] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:19:21 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462350/ [7462352] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:48 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462352/ [7462353] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_monitoring_stack_basic} time: 00:24:38 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462353/ [7462354] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:34 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462354/ [7462355] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:23:50 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462355/ [7462357] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli} time: 00:17:01 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462357/ [7462358] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:35 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462358/ [7462360] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} time: 00:29:40 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462360/ [7462361] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} time: 00:13:20 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462361/ [7462362] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} time: 00:35:27 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462362/ [7462363] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:57 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462363/ [7462364] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:43 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462364/ [7462365] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:13:54 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462365/ [7462366] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:59 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462366/ [7462367] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:42:39 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462367/ [7462368] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:41:52 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462368/ [7462369] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:17:34 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462369/ [7462370] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon} time: 00:26:57 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462370/ [7462371] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:51 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462371/ [7462372] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:19:31 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462372/ [7462374] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:24 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462374/ [7462375] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:42 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462375/ [7462376] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:54:07 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462376/ [7462377] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:41 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462377/ [7462378] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:32 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462378/ [7462379] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:37:19 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462379/ [7462380] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:19:23 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462380/ [7462381] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:24:34 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462381/ [7462382] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:20:34 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462382/ [7462383] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:15:30 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462383/ [7462384] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:17 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462384/ [7462386] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:20:28 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462386/ [7462387] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:16:44 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462387/ [7462388] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:44:57 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462388/ [7462389] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:38:14 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462389/ [7462390] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:20:11 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462390/ [7462391] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_ca_signed_key} time: 00:15:00 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462391/ [7462392] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:53 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462392/ [7462393] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:42 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462393/ [7462394] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:35 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462394/ [7462396] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_cephadm} time: 00:18:58 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462396/ [7462397] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:18:19 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462397/ [7462398] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:19:45 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462398/ [7462399] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} time: 00:19:59 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462399/ [7462400] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:36 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462400/ [7462401] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:18:23 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462401/ [7462402] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:14:33 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462402/ [7462403] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:38:05 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462403/ [7462404] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:29:17 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462404/ [7462405] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:36:25 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462405/ [7462406] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_cephadm_repos} time: 00:11:53 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462406/ [7462407] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:14:30 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462407/ [7462408] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:29 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462408/ [7462409] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:32 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462409/ [7462411] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:24:30 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462411/ [7462412] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:00 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462412/ [7462413] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:17:35 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462413/ [7462414] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_host_drain} time: 00:23:17 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462414/ [7462415] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:35:49 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462415/ [7462416] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:24:19 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462416/ [7462417] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:21:21 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462417/ [7462418] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:01 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462418/ [7462419] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:04 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462419/ [7462420] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:55 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462420/ [7462421] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:24 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462421/ [7462422] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:16:48 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462422/ [7462423] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:13 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462423/ [7462424] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:36 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462424/ [7462426] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_monitoring_stack_basic} time: 00:23:34 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462426/ [7462427] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:49:10 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462427/ [7462428] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:31:04 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462428/ [7462429] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:21:30 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462429/ [7462430] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:58 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462430/ [7462431] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_orch_cli} time: 00:20:39 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462431/ [7462432] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:05 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462432/ [7462433] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:17:55 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462433/ [7462434] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:42 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462434/ [7462436] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:20:36 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462436/ [7462437] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_orch_cli_mon} time: 00:32:19 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462437/ [7462439] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} time: 00:29:14 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462439/ [7462440] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} time: 00:22:34 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462440/ [7462441] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} time: 00:36:25 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462441/ [7462442] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:42 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462442/ [7462443] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:15:57 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462443/ [7462444] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:18 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462444/ [7462445] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:38:13 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462445/ [7462446] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:43:57 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462446/ [7462448] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:14:39 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462448/ [7462449] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:21:53 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462449/ [7462450] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:13:56 info: https://pulpito.ceph.com/yuriw-2023-11-18_13:58:58-orch-main-distro-default-smithi/7462450/