2024-04-15T21:08:50.094 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-04-15T21:08:50.094 INFO:teuthology.results:subset: '18/64' 2024-04-15T21:08:50.094 INFO:teuthology.results:seed: '7775' 2024-04-15T22:32:22.645 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-04-15T22:32:22.668 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-04-16T10:25:22.307 INFO:teuthology.results:Tests finished! gathering results... 2024-04-16T10:25:35.564 INFO:scrape:Found 173 jobs 2024-04-16T10:25:51.146 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657557/teuthology.log 2024-04-16T10:26:03.594 INFO:scrape:Found 10 distinct failure reasons 2024-04-16T10:26:03.595 INFO:scrape:Failure: Command failed on smithi116 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' 2024-04-16T10:26:03.595 INFO:scrape:127 jobs 2024-04-16T10:26:03.596 INFO:scrape:suites intersection: [] 2024-04-16T10:26:03.596 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/jaeger', '2-services/mirror', '2-services/nfs', '2-services/nfs-haproxy-proto', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs-keepalive-only', '2-services/nfs2', '2-services/nvmeof', '2-services/rgw', '2-services/rgw-ingress', '2-thrash', '3-final}', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', 'agent/off', 'agent/on', 'base/install', 'cluster/{fixed-3', 'conf/{client', 'conf/{disable-pool-app}', 'fixed-2', 'mds', 'mgr', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch/cephadm/nfs/{cluster/{1-node}', 'orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream', 'orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc', 'orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04', 'orch/cephadm/osds/{0-distro/centos_9.stream', 'orch/cephadm/osds/{0-distro/centos_9.stream_runc', 'orch/cephadm/osds/{0-distro/ubuntu_22.04', 'orch/cephadm/rbd_iscsi/{0-single-container-host', 'orch/cephadm/smoke-roleless/{0-distro/centos_9.stream', 'orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc', 'orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04', 'orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc}', 'orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream}', 'orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc', 'orch/cephadm/smoke/{0-distro/centos_9.stream', 'orch/cephadm/smoke/{0-distro/centos_9.stream_runc', 'orch/cephadm/smoke/{0-distro/ubuntu_22.04', 'orch/cephadm/thrash/{0-distro/centos_9.stream', 'orch/cephadm/thrash/{0-distro/centos_9.stream_runc', 'orch/cephadm/thrash/{0-distro/ubuntu_22.04', 'orch/cephadm/with-work/{0-distro/centos_9.stream', 'orch/cephadm/with-work/{0-distro/centos_9.stream_runc', 'orch/cephadm/with-work/{0-distro/ubuntu_22.04', 'orch/cephadm/workunits/{0-distro/centos_9.stream', 'orch/cephadm/workunits/{0-distro/centos_9.stream_runc', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'osd}', 'overrides/ignorelist_health', 'root}', 'start', 'start}', 'supported-random-distros$/{centos_latest}', 'supported-random-distros$/{ubuntu_latest}', 'task/test_ca_signed_key}', 'task/test_cephadm_timeout}', 'task/test_extra_daemon_features}', 'task/test_host_drain}', 'task/test_iscsi_container/{centos_9.stream', 'task/test_monitoring_stack_basic}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'task/test_rgw_multisite}', 'task/test_set_mon_crush_locations}', 'tasks/nfs}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/rotate-keys}', 'test_iscsi_container}}', 'workloads/cephadm_iscsi}'] 2024-04-16T10:26:03.596 INFO:scrape: 2024-04-16T10:26:03.596 INFO:scrape:Failure: Command failed on smithi123 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed-by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" 2024-04-16T10:26:03.596 INFO:scrape:4 jobs: ['7657518', '7657476', '7657560', '7657602'] 2024-04-16T10:26:03.596 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', 'k8s/1.21', 'orch/rook/smoke/{0-distro/ubuntu_22.04'] 2024-04-16T10:26:03.596 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'orch/rook/smoke/{0-distro/ubuntu_22.04', 'rook/1.7.2}', 'rook/master}'] 2024-04-16T10:26:03.597 INFO:scrape: 2024-04-16T10:26:03.597 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2024-04-16T10:26:03.597 INFO:scrape:3 jobs: ['7657441', '7657507', '7657574'] 2024-04-16T10:26:03.597 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2024-04-16T10:26:03.597 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/centos_9.stream', 'orch/cephadm/workunits/{0-distro/centos_9.stream_runc', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_cephadm}'] 2024-04-16T10:26:03.597 INFO:scrape: 2024-04-16T10:26:03.597 INFO:scrape:Failure: Command failed on smithi053 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a70d5d5c-fb73-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' 2024-04-16T10:26:03.597 INFO:scrape:12 jobs: ['7657508', '7657447', '7657535', '7657480', '7657599', '7657526', '7657457', '7657448', '7657477', '7657501', '7657536', '7657551'] 2024-04-16T10:26:03.597 INFO:scrape:suites intersection: [] 2024-04-16T10:26:03.597 INFO:scrape:suites union: ['1-bootstrap/17.2.0', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/kclient', '2-nfs', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-inline/no', '3-upgrade-mgr-staggered', '3-upgrade-with-workload', '3-upgrade/simple', '3-upgrade/staggered', '4-config-upgrade/{fail_fs}', '4-final}', '4-verify}', '4-wait', '5-upgrade-ls', '5-upgrade-with-workload', '6-verify}}', 'agent/off', 'agent/on', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'mon_election/classic}', 'mon_election/connectivity}', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream', 'orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/reef/{v18.2.0}', 'tasks/{0-from/reef/{v18.2.1}'] 2024-04-16T10:26:03.598 INFO:scrape: 2024-04-16T10:26:03.598 INFO:scrape:Dead: b'2024-04-16T10:07:41.297 DEBUG:teuthology.exit:Finished running handlers' 2024-04-16T10:26:03.598 INFO:scrape:5 jobs: ['7657561', '7657486', '7657495', '7657573', '7657519'] 2024-04-16T10:26:03.598 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start'] 2024-04-16T10:26:03.598 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', '2-ops/rm-zap-wait}', '2-services/iscsi', '2-services/nfs2', '2-services/rgw-ingress', '3-final}', 'orch/cephadm/osds/{0-distro/centos_9.stream', 'orch/cephadm/smoke-roleless/{0-distro/centos_9.stream', 'orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc'] 2024-04-16T10:26:03.598 INFO:scrape: 2024-04-16T10:26:03.598 INFO:scrape:Failure: SSH connection to smithi069 was lost: 'sudo apt-get update' 2024-04-16T10:26:03.598 INFO:scrape:3 jobs: ['7657575', '7657558', '7657576'] 2024-04-16T10:26:03.598 INFO:scrape:suites intersection: [] 2024-04-16T10:26:03.598 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-repo_digest/repo_digest', '2-services/jaeger', '2-services/nvmeof', '3-final}', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/off', 'mon_election/connectivity}', 'orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04'] 2024-04-16T10:26:03.598 INFO:scrape: 2024-04-16T10:26:03.599 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2024-04-16T10:26:03.599 INFO:scrape:1 jobs: ['7657514'] 2024-04-16T10:26:03.599 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'orch/cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_cephadm_repos}'] 2024-04-16T10:26:03.599 INFO:scrape: 2024-04-16T10:26:03.599 INFO:scrape:Failure: Command failed (workunit test suites/fsstress.sh) on smithi189 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' 2024-04-16T10:26:03.599 INFO:scrape:2 jobs: ['7657608', '7657578'] 2024-04-16T10:26:03.599 INFO:scrape:suites intersection: ['1-ranks/2', '1-volume/{0-create', '2-client/kclient', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}'] 2024-04-16T10:26:03.599 INFO:scrape:suites union: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/kclient', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/reef/{v18.2.0}', 'tasks/{0-from/reef/{v18.2.1}'] 2024-04-16T10:26:03.599 INFO:scrape: 2024-04-16T10:26:03.599 INFO:scrape:Dead: None 2024-04-16T10:26:03.599 INFO:scrape:1 jobs: ['7657557'] 2024-04-16T10:26:03.600 INFO:scrape: 2024-04-16T10:26:03.600 INFO:scrape:Failure: Command failed on smithi170 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dbfbc314-fb73-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'" 2024-04-16T10:26:03.600 INFO:scrape:6 jobs: ['7657522', '7657492', '7657564', '7657554', '7657593', '7657467'] 2024-04-16T10:26:03.600 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client/fuse', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/yes', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy'] 2024-04-16T10:26:03.600 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/fuse', '3-inline/no', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/yes', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy'] 2024-04-16T10:26:03.600 INFO:scrape: 2024-04-16T10:26:03.605 INFO:teuthology.results:Sending results to ceph-qa@ceph.com: Test Run: teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/ failed: 156 dead: 8 running: 0 waiting: 0 queued: 0 passed: 9 Fail ================================================================= [7657437] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:07:19 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657437/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657437/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8a71b6d732cb4cd3911d45c0e3ec38a5 Command failed on smithi154 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657438] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:07:23 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657438/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657438/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dea59e3090c041629c4d22277ee044a5 Command failed on smithi033 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657439] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} ----------------------------------------------------------------- time: 00:04:29 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657439/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657439/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1036bbd07e4a45beacc0b3e237ace69e Command failed on smithi043 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657440] orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:30 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657440/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657440/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7c18f97fa7604af8b8c6372c93534d9e Command failed on smithi086 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657441] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:17:13 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657441/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657441/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1d6db5d4a8274f09a0320b5f4af4e19f Command failed (workunit test cephadm/test_cephadm.sh) on smithi194 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7657442] orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:06:56 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657442/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657442/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddd62d66a09144299ae3a317d12f1caf Command failed on smithi138 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657443] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:04:37 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657443/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657443/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7fff4b39fcda4f52abc7d2836034735b Command failed on smithi007 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657444] orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:06:58 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657444/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=365047d5178a47c3b85255a30284ad8e Command failed on smithi060 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657445] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:07:17 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657445/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03ae2150018b469e9e4a65fcf4c61700 Command failed on smithi137 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657447] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:20:04 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657447/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657447/ sentry: https://sentry.ceph.com/organizations/ceph/?query=73e1898060344886bad79886a157028f Command failed on smithi090 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b818e4c-fb6f-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657448] orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:17:24 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657448/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657448/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fcf64b3f13ce49289de702f7351883a1 Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a42038-fb6e-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657449] orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs} ----------------------------------------------------------------- time: 00:09:02 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657449/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657449/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6633740c61e84bfc9f2c38aa2dc25ff9 Command failed on smithi062 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657452] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:04:29 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657452/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657452/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe6c50f3c4114cbba2d45fbc60e4962b Command failed on smithi050 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657453] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:04:26 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657453/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657453/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac5f568d57fe4c4693dc3bd8f46862ad Command failed on smithi164 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657454] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:04:29 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657454/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657454/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a832ce35d0c7486bab221425b4cbb67c Command failed on smithi047 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657455] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:04:25 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657455/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657455/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2835dc1a6d38431d8cf94ff511511d92 Command failed on smithi116 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657456] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:48 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657456/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657456/ sentry: https://sentry.ceph.com/organizations/ceph/?query=423da41c1b244538988eb9530d4d6176 Command failed on smithi112 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657457] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:27:33 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657457/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657457/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6518eff857ab48f582bd762cfb2e161e Command failed on smithi131 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b5a4313c-fb6f-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\'' [7657458] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:04:29 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657458/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657458/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4431a7dbbf154cafb817c71d8e4d4656 Command failed on smithi142 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657459] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/classic task/test_extra_daemon_features} ----------------------------------------------------------------- time: 00:07:14 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657459/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657459/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b4b1ea1bd17444f6a001c3b03ad5a88b Command failed on smithi064 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657460] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:07:28 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657460/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657460/ sentry: https://sentry.ceph.com/organizations/ceph/?query=946700a525e742d49e1c77840e278eaa Command failed on smithi117 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657461] orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:07:04 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657461/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657461/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c35b6f93b95e40f9bd5f47c8d0ebcf64 Command failed on smithi055 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657462] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:20 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657462/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657462/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2d9d67a2d76a4c93a8c6e2468c291372 Command failed on smithi063 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657463] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:04:24 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657463/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657463/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d126d93d1ee44a498a13e55424b555f7 Command failed on smithi031 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657464] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:04:44 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657464/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657464/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e27978ea646422cbae175b23432c133 Command failed on smithi111 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657465] orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:55 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657465/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657465/ sentry: https://sentry.ceph.com/organizations/ceph/?query=521b52d62ddf44ab8cc33fe2fe8a223a Command failed on smithi037 with status 1: 'sudo cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657466] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_host_drain} ----------------------------------------------------------------- time: 00:09:17 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657466/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657466/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b904c77fbfe4d7cb33b864a409d75c9 Command failed on smithi059 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657467] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:17:30 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657467/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657467/ sentry: https://sentry.ceph.com/organizations/ceph/?query=553788c3276847718e342bc6dc0afc1b Command failed on smithi067 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e43aed82-fb70-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'" [7657468] orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_cephadm_timeout} ----------------------------------------------------------------- time: 00:06:59 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657468/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657468/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3656ef8166ec4dc88654a917b07dcfac Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657469] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:04:34 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657469/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657469/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f813fc6acfdd4274ae940b196ec4f210 Command failed on smithi023 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657470] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} ----------------------------------------------------------------- time: 00:07:24 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657470/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657470/ sentry: https://sentry.ceph.com/organizations/ceph/?query=38a892f05f7a483a83271392a05765ad Command failed on smithi053 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657471] orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} ----------------------------------------------------------------- time: 00:07:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657471/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657471/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6e49f1f8b9a6417aafff1e25a809a72b Command failed on smithi177 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657472] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:04:42 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657472/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657472/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d83813d83f224004ae9419b315aefccb Command failed on smithi022 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657473] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:44 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657473/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657473/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad828f582d5e4fb0aefb429ef1ab4d48 Command failed on smithi113 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657474] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:07:30 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657474/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657474/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c841b9722e44ee49231679b2141e0ab Command failed on smithi008 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657475] orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:07:22 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657475/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657475/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f505b2e903e464eba94d46d3f31370e Command failed on smithi046 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657476] orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:07:36 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657476/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657476/ sentry: https://sentry.ceph.com/organizations/ceph/?query=add5dbc749554b109531e010e6f7ac55 Command failed on smithi043 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7657477] orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:18:02 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657477/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657477/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2f4d5abd2f49463591127c9a995a0444 Command failed on smithi007 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 18ed60a0-fb71-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657478] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:04:32 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657478/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657478/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac850746eacc4457abf405848f875b14 Command failed on smithi167 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657479] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/connectivity task/test_monitoring_stack_basic} ----------------------------------------------------------------- time: 00:07:24 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657479/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657479/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0b667c0ca124406a6dd3971d31ce861 Command failed on smithi072 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657480] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:20:11 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657480/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657480/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5bbfd304cac0483faa94ba9834760a67 Command failed on smithi130 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad16f0ca- fb71-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657481] orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:09:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657481/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657481/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f5db523deef844e3829de8f4ea6e4343 Command failed on smithi050 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657482] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:07:20 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657482/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657482/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7fba9d76bcaa4dbab3fb2473e4e2aeda Command failed on smithi137 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657483] orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:09:08 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657483/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657483/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b067a5316f194b7f8cf1e51eedba6594 Command failed on smithi017 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657484] orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:33 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657484/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657484/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62453e692b9c426ebc1b61fde479e2d0 Command failed on smithi038 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657485] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:04:29 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657485/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657485/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a467c2a27574c258e150e3edd5817a2 Command failed on smithi089 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657487] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/classic task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:09:18 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657487/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657487/ sentry: https://sentry.ceph.com/organizations/ceph/?query=912f2ca1a3f849d28e33a0c64961be38 Command failed on smithi082 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657488] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:04:35 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657488/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657488/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0567f7d617a45f5a3c80eee9febe195 Command failed on smithi086 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657489] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:09:14 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657489/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657489/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b229fffb1da4a93bf8042ee8fec771f Command failed on smithi135 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657490] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:07:22 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657490/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657490/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca50665ff75b4fbc8854a88fd40044f3 Command failed on smithi060 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657491] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:06:55 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657491/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657491/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b48b76b620a4346ba5e35c6974126c5 Command failed on smithi154 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657492] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:17:39 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657492/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657492/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d80908d60dfd473db55192ef11e2a699 Command failed on smithi047 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cdb457dc-fb71-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'" [7657493] orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:07:23 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657493/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657493/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79341e9a30274b748e7c5c85ff235e51 Command failed on smithi112 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657496] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:04:24 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657496/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657496/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d44817fce85042f1862e5fa52b0b99f7 Command failed on smithi078 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657497] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:41 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657497/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657497/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a5e9360816a4938bb91f8574a54eaf1 Command failed on smithi049 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657498] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:04:32 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657498/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657498/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51c6d68a6c0e4e97bbbd3f7030b02898 Command failed on smithi006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657499] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nvmeof 3-final} ----------------------------------------------------------------- time: 00:04:27 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657499/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657499/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f932625d283c446286c5db73499307e8 Command failed on smithi081 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657500] orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:06:50 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657500/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657500/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c41f7b241a344d248766abd571daf692 Command failed on smithi027 with status 1: 'sudo cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657501] orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:18:04 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657501/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657501/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4641073f0c2b443cb0bdf0282f7d8072 Command failed on smithi106 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 528464ce- fb73-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657502] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_ca_signed_key} ----------------------------------------------------------------- time: 00:07:05 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657502/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5420ea56cba7451d9623c8ebd957cfaa Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657503] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:07:26 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657503/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657503/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6e087d0bae994224bdef161222c259e7 Command failed on smithi044 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657504] orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:39 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657504/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657504/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5b2046c9f584400a5c7c2079d9e0edf Command failed on smithi022 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657505] orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:07:15 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657505/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657505/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef42e4b7e1ee4dfd8f6cde0d61c8a95e Command failed on smithi069 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657506] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:04:36 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657506/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657506/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d26316647174d5fac0490ea33c12d4b Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657507] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:12:57 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657507/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657507/ sentry: https://sentry.ceph.com/organizations/ceph/?query=40799431726642bbaf0881cbd4a4d355 Command failed (workunit test cephadm/test_cephadm.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7657508] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:20:44 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657508/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657508/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f09b1408aa364ef795cb64201139ed46 Command failed on smithi053 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a70d5d5c-fb73-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657510] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:07:29 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657510/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5cdca9f6cdcc4d9d80218400b440b869 Command failed on smithi023 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657511] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:04:36 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657511/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657511/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69b75eecbacf4f10a4ed95f5a103f019 Command failed on smithi063 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657512] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:07:27 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657512/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657512/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a2a611992a3451eacb1b9b1f942e626 Command failed on smithi103 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657513] orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:28 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657513/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657513/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61da11233ae74b04a01b0b333dfb5748 Command failed on smithi077 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657514] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:09:12 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657514/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=af1a92c2c7cb4dc5a49a099cc3f8542b Command failed (workunit test cephadm/test_repos.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7657515] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:04:41 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657515/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657515/ sentry: https://sentry.ceph.com/organizations/ceph/?query=251c757104164183adc63923cccd9db9 Command failed on smithi026 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657516] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:45 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657516/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657516/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4808b777ccac485ab07d3aecbdddb9c3 Command failed on smithi031 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657517] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:04:41 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657517/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657517/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eed605183cca470e8268633ef47fc668 Command failed on smithi059 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657518] orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/1-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:07:27 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657518/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657518/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a990ca38149d4c30b8abb624c16688ba Command failed on smithi123 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7657520] orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:07:09 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657520/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657520/ sentry: https://sentry.ceph.com/organizations/ceph/?query=65a423f9985a4ba38cd02c3ea1a6e1e9 Command failed on smithi038 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657521] orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_extra_daemon_features} ----------------------------------------------------------------- time: 00:07:20 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657521/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657521/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8726a30d511946aa9ec49f7a279db2f5 Command failed on smithi090 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657522] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:17:36 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657522/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657522/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f22986ec6d74b66acc2865fad0a95f0 Command failed on smithi170 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dbfbc314-fb73-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'" [7657523] orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_cephadm_timeout} ----------------------------------------------------------------- time: 00:08:53 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657523/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657523/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bff718a981f941afad9c607f50e018cb Command failed on smithi110 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657524] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:07:32 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657524/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657524/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7540cac181664c97823b7737fdd9bb05 Command failed on smithi055 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657525] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:07:22 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657525/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5ee1f1353c94ee29bf300bf28230c98 Command failed on smithi142 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657526] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:27:50 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657526/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657526/ sentry: https://sentry.ceph.com/organizations/ceph/?query=12f0d4e38c4e4d038ecc41b9b9666a2b Command failed on smithi078 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea9734c6-fb73-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\'' [7657527] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} ----------------------------------------------------------------- time: 00:04:34 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657527/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657527/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a1bb82144ec44cbaac13c50712079e54 Command failed on smithi005 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657528] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_host_drain} ----------------------------------------------------------------- time: 00:07:01 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657528/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657528/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7c980895a8854520bd39455645a087b3 Command failed on smithi040 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657529] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:04:27 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657529/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657529/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ba1d87016f64a17b285424c976c8b03 Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657530] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:04:33 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657530/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657530/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a59ba3eabc174312957a9782dc8ed01a Command failed on smithi122 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657531] orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:08:59 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657531/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657531/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32488e10f85a4f449f383de8456693e6 Command failed on smithi071 with status 1: 'sudo cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657532] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:07:28 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657532/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657532/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f017c7f0854643a58a5274e969f00d1b Command failed on smithi022 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657533] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:09:57 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657533/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657533/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff1f905ec5c84c25bff13d96d47d7724 Command failed on smithi043 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657534] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} ----------------------------------------------------------------- time: 00:06:58 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657534/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657534/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c7a51b3f46647d394b8e3eb4112532e Command failed on smithi155 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657535] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:20:25 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657535/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657535/ sentry: https://sentry.ceph.com/organizations/ceph/?query=16ad2caa2d8f4c8f82abcd82812f8c7e Command failed on smithi120 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19569f0c-fb76-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657536] orch/cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:17:44 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657536/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657536/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec3c4ddbc6724492904164c0f13ec73b Command failed on smithi081 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e7d16278-fb75-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657537] orch/cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} ----------------------------------------------------------------- time: 00:06:52 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657537/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657537/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ec6751d09844b89877ae345d338f240 Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657538] orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:06:54 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657538/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657538/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f93eaacde81e4a4bb9d203c65b0b4851 Command failed on smithi007 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657540] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:04:46 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657540/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657540/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e749cc09dca84d9f97283f24334e8285 Command failed on smithi027 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657541] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:04:45 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657541/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657541/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4458b5a1fad4dc099f79ebc161f46b7 Command failed on smithi018 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657542] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:04:41 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657542/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657542/ sentry: https://sentry.ceph.com/organizations/ceph/?query=12acee6d8e284c5593bd1901727908e9 Command failed on smithi149 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657543] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:54 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657543/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657543/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7a7fd83f84c74ed1b6e5a14910a4d488 Command failed on smithi026 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657544] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:04:51 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657544/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657544/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82aea78cf20646cd82a3cf6f3695b488 Command failed on smithi050 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657545] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:07:33 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657545/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657545/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dbe66d9add974ac1b4f28ef98f84a667 Command failed on smithi037 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657546] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_monitoring_stack_basic} ----------------------------------------------------------------- time: 00:07:27 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657546/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657546/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed3d4d5d6e6d4b8893d603ebb12451a2 Command failed on smithi033 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657547] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:07:35 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657547/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657547/ sentry: https://sentry.ceph.com/organizations/ceph/?query=182932717f9445bdafa677703212fa0d Command failed on smithi059 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657548] orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:54 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657548/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657548/ sentry: https://sentry.ceph.com/organizations/ceph/?query=460305bcc2694719a0e281507357936d Command failed on smithi066 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657549] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:04:55 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657549/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657549/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bbb0866f8d744d34a5ec828072b65464 Command failed on smithi017 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657550] orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:07:15 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657550/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657550/ sentry: https://sentry.ceph.com/organizations/ceph/?query=45734ac9725d4629a96629568a821baa Command failed on smithi169 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657551] orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:18:53 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657551/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657551/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4835b59349454ef2b34618d3e60df80c Command failed on smithi092 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d537646e-fb75-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7657552] orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:07:40 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657552/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657552/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f8932b1cc4e8476e83465c58d8f98e66 Command failed on smithi006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657553] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:07:56 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657553/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657553/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d52d15f800394090b3874500a099bd84 Command failed on smithi067 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657554] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:18:10 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657554/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657554/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f0bb0208a7434bb19165fc4b8a56fa4d Command failed on smithi086 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06b081c4-fb76-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'" [7657555] orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:08:02 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657555/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657555/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b7084f86b40b474d835b16c940d4630f Command failed on smithi008 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657556] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:04:56 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657556/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657556/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6dc15d7021334ee19dc039ef0fbecc42 Command failed on smithi012 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657559] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:10:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657559/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657559/ sentry: https://sentry.ceph.com/organizations/ceph/?query=67e162f9c68b4884a0089842bf42a473 Command failed on smithi047 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657560] orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/3-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:07:46 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657560/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657560/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58ee3bdb380a456b92a154f9e7cfbbc7 Command failed on smithi046 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7657562] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:53 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657562/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657562/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ca6b26278fd42ffb97a44390e68f0c6 Command failed on smithi161 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657563] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:04:47 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657563/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657563/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f575d85c114463a96e323eb8fce54a5 Command failed on smithi131 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657564] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:17:48 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657564/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657564/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c569a89f71640d2ba88a89a69841760 Command failed on smithi107 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3eb8ef52-fb76-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'" [7657566] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:05:06 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657566/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657566/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f7ebb0ca988741b98aed3089a0b740b8 Command failed on smithi005 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657567] orch/cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:47 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657567/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657567/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8918bb0ccbe34572a2d9107647eff847 Command failed on smithi042 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657568] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:07:19 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657568/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657568/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1966b4e316ad4421a2d473ea71036991 Command failed on smithi113 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657569] orch/cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:07:04 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657569/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657569/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d444bc8ca6447ed8d905bb4d15d2a85 Command failed on smithi102 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657570] orch/cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:05 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657570/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657570/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79878ff2d50d43179e609842407f1937 Command failed on smithi023 with status 1: 'sudo cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657571] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_ca_signed_key} ----------------------------------------------------------------- time: 00:09:13 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657571/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657571/ sentry: https://sentry.ceph.com/organizations/ceph/?query=700efadccb654986a372aa5aa90198bd Command failed on smithi071 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657572] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:04:44 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657572/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657572/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c6e7a597f8c457d98b691f23cfb7a82 Command failed on smithi007 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657574] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:12:38 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657574/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657574/ sentry: https://sentry.ceph.com/organizations/ceph/?query=317356840cc84a9a98ccf34bb0fb01da Command failed (workunit test cephadm/test_cephadm.sh) on smithi096 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7657576] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657576/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657576/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba02a227c4064105b91f320aace556a9 Command failed on smithi069 with status 100: 'sudo apt-get clean' [7657577] orch/cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:07:27 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657577/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657577/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a81b2c5d4294778bfd44e0a2f36f413 Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657578] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 03:37:57 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657578/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657578/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1185ed8d552145e89e07d6069facf60b Command failed (workunit test suites/fsstress.sh) on smithi165 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' [7657579] orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout} ----------------------------------------------------------------- time: 00:06:59 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657579/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657579/ sentry: https://sentry.ceph.com/organizations/ceph/?query=007f0ca8ed354ecebaf6da031387ec33 Command failed on smithi193 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657581] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:04:31 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657581/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657581/ sentry: https://sentry.ceph.com/organizations/ceph/?query=430d4287ec9c456c9f1b9d868371f113 Command failed on smithi103 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657582] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:04:32 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657582/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657582/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5865771702d459592e63c928ff90889 Command failed on smithi077 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657583] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:50 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657583/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657583/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2bf78ad4dccd4953b164f9fbb61d50aa Command failed on smithi050 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657585] orch/cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:09:24 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657585/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657585/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a23da05c54dc4efd9237cde6cf1316fb Command failed on smithi031 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657586] orch/cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:08 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657586/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657586/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06a0e43fa581412290e02a7215191fea Command failed on smithi070 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657587] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} ----------------------------------------------------------------- time: 00:04:38 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657587/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657587/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e8da418a6e4d4117b4892ac7a9b3bf0b Command failed on smithi038 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657588] orch/cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:30 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657588/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657588/ sentry: https://sentry.ceph.com/organizations/ceph/?query=66d1b5a79af14b648a70447bd76eb85e Command failed on smithi090 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657589] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:07:16 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657589/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657589/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1490b5254a804d4c9840628ed5e7eebb Command failed on smithi170 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657590] orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_extra_daemon_features} ----------------------------------------------------------------- time: 00:09:15 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657590/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657590/ sentry: https://sentry.ceph.com/organizations/ceph/?query=65edfb72771d441a81901ddcb0e1f036 Command failed on smithi055 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657591] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:04:29 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657591/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657591/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dba6d1f177c64dfb97964fd3143df7b2 Command failed on smithi110 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657592] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:04:28 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657592/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657592/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4043ef14d2d847c79121d7976fb7ac1c Command failed on smithi142 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657593] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:18:20 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657593/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657593/ sentry: https://sentry.ceph.com/organizations/ceph/?query=671e634777a74690a2c130579287cd64 Command failed on smithi057 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5993aa40-fb78-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr'" [7657594] orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:06:59 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657594/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657594/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f7de2958cc4413ea562253ef138081f Command failed on smithi087 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657595] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:04:38 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657595/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657595/ sentry: https://sentry.ceph.com/organizations/ceph/?query=71489590d7744a2680319554506e2d56 Command failed on smithi106 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657596] orch/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} ----------------------------------------------------------------- time: 00:07:26 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657596/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657596/ sentry: https://sentry.ceph.com/organizations/ceph/?query=86c67a7db35c47c7baea8de409959e0c Command failed on smithi049 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657597] orch/cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:07:18 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657597/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657597/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c700163be2e6463f8be2dcfefc9c8825 Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657598] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:07:30 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657598/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657598/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3dfc29d7eadf4393aab468243b16c26c Command failed on smithi042 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657599] orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:20:22 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657599/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657599/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2917ecd49187464a8f8b9de4cb2699f2 Command failed on smithi044 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cab6ebdc- fb79-11ee-bc8f-c7b262605968 -e sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\'' [7657600] orch/cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:10:13 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657600/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657600/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e25ee7aef694a18ae0e3c6a79e62016 Command failed on smithi007 with status 1: 'sudo cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657601] orch/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:04:47 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657601/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657601/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f5b703720074460a805f513c1b40e93 Command failed on smithi081 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657602] orch/rook/smoke/{0-distro/ubuntu_22.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:07:53 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657602/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657602/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d0ca418ad2cc453e9bcd9371597622c8 Command failed on smithi072 with status 100: "sudo apt update && sudo apt install -y apt-transport-https ca-certificates curl && sudo curl -fsSLo /usr/share/keyrings/kubernetes-archive-keyring.gpg https://packages.cloud.google.com/apt/doc/apt-key.gpg && echo 'deb [signed- by=/usr/share/keyrings/kubernetes-archive-keyring.gpg] https://apt.kubernetes.io/ kubernetes-xenial main' | sudo tee /etc/apt/sources.list.d/kubernetes.list && sudo apt update && sudo apt install -y kubelet kubeadm kubectl bridge-utils" [7657603] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:04:47 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657603/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657603/ sentry: https://sentry.ceph.com/organizations/ceph/?query=871c707e7bd54d1e9723addb9b47509a Command failed on smithi027 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657604] orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:55 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657604/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657604/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5bc79157c2c44a0687f5a89848d23783 Command failed on smithi059 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657605] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} ----------------------------------------------------------------- time: 00:07:05 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657605/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657605/ sentry: https://sentry.ceph.com/organizations/ceph/?query=860348451efd46c3af1a2df91873e6e9 Command failed on smithi018 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657606] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:04:50 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657606/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657606/ sentry: https://sentry.ceph.com/organizations/ceph/?query=832e0e23868747fdb3127b4641138a8d Command failed on smithi077 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657607] orch/cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:48 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657607/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657607/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83ac27bba419448aa6a703ee1c99771d Command failed on smithi026 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' [7657608] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:37:32 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657608/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657608/ sentry: https://sentry.ceph.com/organizations/ceph/?query=75dd15f32ab747bcb0e47b9418dc6def Command failed (workunit test suites/fsstress.sh) on smithi189 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' [7657609] orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:11:38 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657609/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657609/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4dd31277dbd948668eafe9f51e17c3b0 Command failed on smithi033 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:a9a752df26c63acad72e1b3569fd79a515ca0765 pull' Dead ================================================================= [7657486] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657486/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657486/ hit max job timeout [7657495] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657495/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657495/ hit max job timeout [7657519] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657519/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657519/ hit max job timeout [7657557] orch/cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657557/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657557/ Error reimaging machines: Expected smithi190's OS to be centos 9 but found ubuntu 22.04 [7657558] orch/cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657558/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657558/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a294c3a2a1a4129a852a4b5cd99144f SSH connection to smithi190 was lost: 'sudo apt-get update' [7657561] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657561/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657561/ hit max job timeout [7657573] orch/cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657573/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657573/ hit max job timeout [7657575] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657575/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657575/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b208015c40d42449e0a67b77bf80899 SSH connection to smithi069 was lost: 'sudo apt-get update' Pass ================================================================= [7657446] orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:06:14 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657446/ [7657450] orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_adoption} time: 00:09:40 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657450/ [7657451] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/off orchestrator_cli} time: 00:12:02 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657451/ [7657494] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/on orchestrator_cli} time: 00:11:40 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657494/ [7657509] orch/cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_adoption} time: 00:10:24 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657509/ [7657539] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} time: 00:12:01 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657539/ [7657565] orch/cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption} time: 00:13:01 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657565/ [7657580] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream} 2-node-mgr agent/on orchestrator_cli} time: 00:11:53 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657580/ [7657584] orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:06:26 info: https://pulpito.ceph.com/teuthology-2024-04-15_21:08:03-orch-squid-distro-default-smithi/7657584/