2023-11-20T07:05:45.499 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-20T07:05:45.499 INFO:teuthology.results:subset: '1/14' 2023-11-20T07:05:45.499 INFO:teuthology.results:seed: '5141' 2023-11-20T11:25:58.157 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-20T11:25:58.178 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-20T12:10:01.664 INFO:teuthology.results:Tests finished! gathering results... 2023-11-20T12:10:05.965 INFO:scrape:Found 98 jobs 2023-11-20T12:10:06.444 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462944/teuthology.log 2023-11-20T12:10:07.309 INFO:scrape:Found 8 distinct failure reasons 2023-11-20T12:10:07.309 INFO:scrape:Failure: Command failed on smithi008 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3e320d455af86abe397f026166a45eba1e1ba6f8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fe673eca-8787-11ee-959e-87774f69a715 -- ceph rgw realm bootstrap -i -' 2023-11-20T12:10:07.309 INFO:scrape:1 jobs: ['7462972'] 2023-11-20T12:10:07.309 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_rgw_multisite}'] 2023-11-20T12:10:07.310 INFO:scrape: 2023-11-20T12:10:07.310 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi057 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3e320d455af86abe397f026166a45eba1e1ba6f8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2023-11-20T12:10:07.310 INFO:scrape:1 jobs: ['7462999'] 2023-11-20T12:10:07.310 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_cephadm_repos}'] 2023-11-20T12:10:07.310 INFO:scrape: 2023-11-20T12:10:07.310 INFO:scrape:Failure: Command failed (workunit test cephadm/test_iscsi_setup.sh) on smithi029 with status 24: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3e320d455af86abe397f026166a45eba1e1ba6f8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_setup.sh' 2023-11-20T12:10:07.310 INFO:scrape:2 jobs: ['7462951', '7463018'] 2023-11-20T12:10:07.310 INFO:scrape:suites intersection: ['task/test_iscsi_container/{centos_8.stream_container_tools', 'test_iscsi_container}}'] 2023-11-20T12:10:07.310 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_iscsi_container/{centos_8.stream_container_tools', 'test_iscsi_container}}'] 2023-11-20T12:10:07.311 INFO:scrape: 2023-11-20T12:10:07.311 INFO:scrape:Dead: None 2023-11-20T12:10:07.311 INFO:scrape:1 jobs: ['7462944'] 2023-11-20T12:10:07.311 INFO:scrape: 2023-11-20T12:10:07.311 INFO:scrape:Failure: failed to install new kernel version within timeout 2023-11-20T12:10:07.311 INFO:scrape:1 jobs: ['7462943'] 2023-11-20T12:10:07.311 INFO:scrape:suites: ['1-start', '2-services/basic', '3-final}', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun}'] 2023-11-20T12:10:07.311 INFO:scrape: 2023-11-20T12:10:07.311 INFO:scrape:Failure: Command failed on smithi116 with status 1: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' 2023-11-20T12:10:07.311 INFO:scrape:2 jobs: ['7462937', '7462942'] 2023-11-20T12:10:07.311 INFO:scrape:suites intersection: [] 2023-11-20T12:10:07.312 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-flag}', 'base/install', 'cluster/{fixed-3', 'conf/{disable-pool-app}', 'openstack}', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/rbd_iscsi/{0-single-container-host', 'workloads/cephadm_iscsi}'] 2023-11-20T12:10:07.312 INFO:scrape: 2023-11-20T12:10:07.312 INFO:scrape:Failure: Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd87a2-8775-11ee-959e-87774f69a715 -e sha1=3e320d455af86abe397f026166a45eba1e1ba6f8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-11-20T12:10:07.312 INFO:scrape:1 jobs: ['7462939'] 2023-11-20T12:10:07.312 INFO:scrape:suites: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2023-11-20T12:10:07.312 INFO:scrape: 2023-11-20T12:10:07.312 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi055.front.sepia.ceph.com: ['type=AVC msg=audit(1700465394.012:22020): avc: denied { ioctl } for pid=124523 comm="iptables" path="/var/lib/containers/storage/overlay/b60ce6c56efbc11c1ddd2cf1d5f02783fe701873479dec0aae713f57f17158e9/merged" dev="overlay" ino=2228299 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2023-11-20T12:10:07.312 INFO:scrape:1 jobs: ['7462936'] 2023-11-20T12:10:07.312 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'task/test_extra_daemon_features}'] 2023-11-20T12:10:07.312 INFO:scrape: 2023-11-20T12:10:07.316 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/ failed: 9 dead: 1 running: 0 waiting: 0 queued: 0 passed: 88 Fail ================================================================= [7462936] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_extra_daemon_features} ----------------------------------------------------------------- time: 00:20:16 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462936/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462936/ SELinux denials found on ubuntu@smithi055.front.sepia.ceph.com: ['type=AVC msg=audit(1700465394.012:22020): avc: denied { ioctl } for pid=124523 comm="iptables" path="/var/lib/containers/storage/overlay/b60ce6c56efbc11c1 ddd2cf1d5f02783fe701873479dec0aae713f57f17158e9/merged" dev="overlay" ino=2228299 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7462937] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:13:49 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462937/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462937/ Command failed on smithi116 with status 1: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' [7462939] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:30:54 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462939/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462939/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b801b2ec74ea4f61849059ec13d56efe Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a7cd87a2-8775-11ee-959e-87774f69a715 -e sha1=3e320d455af86abe397f026166a45eba1e1ba6f8 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7462942] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462942/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462942/ sentry: https://sentry.ceph.com/organizations/ceph/?query=22eec6aee27f4aa38ec6774397c805a4 Command failed on smithi157 with status 1: 'sudo yum install -y kernel' [7462943] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462943/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462943/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea705ebbafed473290c7a40519b40589 failed to install new kernel version within timeout [7462951] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} ----------------------------------------------------------------- time: 00:19:04 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462951/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462951/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa1ccb14e96e4f0884ff05b9749b8798 Command failed (workunit test cephadm/test_iscsi_setup.sh) on smithi029 with status 24: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3e320d455af86abe397f026166a45eba1e1ba6f8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_iscsi_setup.sh' [7462972] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:18:21 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462972/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462972/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62559bfe46d042d2b6183aca6a597416 Command failed on smithi008 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:3e320d455af86abe397f026166a45eba1e1ba6f8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fe673eca-8787-11ee-959e-87774f69a715 -- ceph rgw realm bootstrap -i -' [7462999] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:28 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462999/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462999/ sentry: https://sentry.ceph.com/organizations/ceph/?query=499d174e3af74383958aacf361760107 Command failed (workunit test cephadm/test_repos.sh) on smithi057 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3e320d455af86abe397f026166a45eba1e1ba6f8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7463018] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} ----------------------------------------------------------------- time: 00:17:33 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463018/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463018/ sentry: https://sentry.ceph.com/organizations/ceph/?query=512af4dfaf1f46aeb46c30cc2ff31b01 Command failed (workunit test cephadm/test_iscsi_setup.sh) on smithi135 with status 24: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3e320d455af86abe397f026166a45eba1e1ba6f8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_iscsi_setup.sh' Dead ================================================================= [7462944] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462944/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462944/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7462935] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:46 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462935/ [7462938] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:20:04 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462938/ [7462940] orch:cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} time: 00:28:58 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462940/ [7462941] orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} time: 00:13:39 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462941/ [7462945] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:01 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462945/ [7462946] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:25:41 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462946/ [7462947] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_host_drain} time: 00:23:02 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462947/ [7462948] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:30 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462948/ [7462949] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:23:15 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462949/ [7462950] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:09:10 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462950/ [7462952] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:38:08 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462952/ [7462953] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:17:44 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462953/ [7462954] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:41:22 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462954/ [7462955] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:46 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462955/ [7462956] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:00 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462956/ [7462957] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_monitoring_stack_basic} time: 00:23:23 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462957/ [7462958] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:14:57 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462958/ [7462959] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:32:48 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462959/ [7462960] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:36:42 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462960/ [7462961] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:19:10 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462961/ [7462962] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:19:40 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462962/ [7462963] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:19 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462963/ [7462964] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:29 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462964/ [7462965] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:30:41 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462965/ [7462966] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:24:22 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462966/ [7462967] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:55 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462967/ [7462968] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:36 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462968/ [7462969] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:18 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462969/ [7462970] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:19:29 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462970/ [7462971] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:36:21 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462971/ [7462973] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:16:55 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462973/ [7462974] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:46:23 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462974/ [7462975] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:31:07 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462975/ [7462976] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:18:55 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462976/ [7462977] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:56 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462977/ [7462978] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:57 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462978/ [7462979] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:58 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462979/ [7462980] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:35 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462980/ [7462981] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:41 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462981/ [7462982] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:41:19 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462982/ [7462983] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:41:19 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462983/ [7462984] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} time: 00:13:36 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462984/ [7462985] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:43 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462985/ [7462986] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:19:32 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462986/ [7462987] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:26 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462987/ [7462988] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:20:12 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462988/ [7462989] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} time: 00:19:07 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462989/ [7462990] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:13:48 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462990/ [7462991] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:14:08 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462991/ [7462992] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} time: 00:21:06 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462992/ [7462993] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:54:53 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462993/ [7462994] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:15:54 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462994/ [7462995] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:38:27 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462995/ [7462996] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:58 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462996/ [7462997] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:49 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462997/ [7462998] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:27:48 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7462998/ [7463000] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:20 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463000/ [7463001] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:28 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463001/ [7463002] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_timeout} time: 00:17:33 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463002/ [7463003] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:20:08 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463003/ [7463004] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:44:37 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463004/ [7463005] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:36:18 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463005/ [7463006] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:26 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463006/ [7463007] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:18:08 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463007/ [7463008] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:11 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463008/ [7463009] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:24 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463009/ [7463010] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:22:01 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463010/ [7463011] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:28:11 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463011/ [7463012] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_host_drain} time: 00:22:37 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463012/ [7463013] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:23 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463013/ [7463014] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:00 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463014/ [7463015] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:58 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463015/ [7463016] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:38:23 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463016/ [7463017] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:30:11 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463017/ [7463019] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:29:17 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463019/ [7463020] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:54 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463020/ [7463021] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:42 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463021/ [7463022] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:24 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463022/ [7463023] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:24:06 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463023/ [7463024] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:19:14 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463024/ [7463025] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:35:55 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463025/ [7463026] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:57 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463026/ [7463027] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:21 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463027/ [7463028] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli} time: 00:18:24 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463028/ [7463029] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:38 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463029/ [7463030] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:19:24 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463030/ [7463031] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} time: 00:25:25 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463031/ [7463032] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:23:33 info: https://pulpito.ceph.com/adking-2023-11-20_05:57:12-orch:cephadm-wip-adk-testing-2023-11-19-1956-distro-default-smithi/7463032/