2023-10-21T11:14:07.707 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T11:14:07.708 INFO:teuthology.results:subset: '111/120000' 2023-10-21T11:14:07.708 INFO:teuthology.results:seed: '1362' 2023-10-21T14:37:58.357 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T14:37:58.419 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-21T15:19:01.944 INFO:teuthology.results:Tests finished! gathering results... 2023-10-21T15:19:12.986 INFO:scrape:Found 155 jobs 2023-10-21T15:19:21.799 INFO:scrape:Found 8 distinct failure reasons 2023-10-21T15:19:21.800 INFO:scrape:Failure: Command failed on smithi070 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1focal cephadm=18.0.0-6820-gf0804064-1focal ceph-mds=18.0.0-6820-gf0804064-1focal ceph-mgr=18.0.0-6820-gf0804064-1focal ceph-common=18.0.0-6820-gf0804064-1focal ceph-fuse=18.0.0-6820-gf0804064-1focal ceph-test=18.0.0-6820-gf0804064-1focal ceph-volume=18.0.0-6820-gf0804064-1focal radosgw=18.0.0-6820-gf0804064-1focal python3-rados=18.0.0-6820-gf0804064-1focal python3-rgw=18.0.0-6820-gf0804064-1focal python3-cephfs=18.0.0-6820-gf0804064-1focal python3-rbd=18.0.0-6820-gf0804064-1focal libcephfs2=18.0.0-6820-gf0804064-1focal libcephfs-dev=18.0.0-6820-gf0804064-1focal librados2=18.0.0-6820-gf0804064-1focal librbd1=18.0.0-6820-gf0804064-1focal rbd-fuse=18.0.0-6820-gf0804064-1focal' 2023-10-21T15:19:21.801 INFO:scrape:3 jobs: ['7434223', '7434099', '7434163'] 2023-10-21T15:19:21.801 INFO:scrape:suites intersection: [] 2023-10-21T15:19:21.802 INFO:scrape:suites union: ['agent/off', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v2only', 'orch/cephadm/with-work/{0-distro/ubuntu_20.04', 'orch/cephadm/workunits/{0-distro/ubuntu_20.04', 'start', 'task/test_orch_cli}', 'tasks/rados_python}', 'tasks/rotate-keys}'] 2023-10-21T15:19:21.802 INFO:scrape: 2023-10-21T15:19:21.802 INFO:scrape:Failure: ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] 2023-10-21T15:19:21.803 INFO:scrape:20 jobs: ['7434091', '7434145', '7434049', '7434105', '7434247', '7434047', '7434189', '7434260', '7434256', '7434161', '7434107', '7434133', '7434057', '7434259', '7434035', '7434089', '7434221', '7434183', '7434181', '7434102'] 2023-10-21T15:19:21.803 INFO:scrape:suites intersection: [] 2023-10-21T15:19:21.804 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '1-start', '2-node-mgr', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '2-services/client-keyring', '2-services/nfs', '2-services/nfs-haproxy-proto', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs2', '2-thrash', '2-workload/none', '2-workload/radosbench', '3-final}', '3-tasks/snaps-few-objects', '3-upgrade/simple', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'cluster/1-node', 'cluster/3-node', 'fixed-2', 'k8s/1.21', 'mon_election/classic', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr/async-v2only', 'net/calico', 'net/flannel', 'net/host', 'orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04}', 'orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'orch/cephadm/smoke/{0-distro/ubuntu_20.04', 'orch/cephadm/thrash/{0-distro/ubuntu_20.04', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'orch/cephadm/workunits/{0-distro/ubuntu_20.04', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'orchestrator_cli}', 'rook/1.7.2}', 'rook/master}', 'root}', 'start}', 'task/test_ca_signed_key}'] 2023-10-21T15:19:21.804 INFO:scrape: 2023-10-21T15:19:21.805 INFO:scrape:Failure: HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/quincy/e778460a8e3193b796994c235f1cab5f2dc62ddf/centos/8/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) 2023-10-21T15:19:21.805 INFO:scrape:51 jobs 2023-10-21T15:19:21.806 INFO:scrape:suites intersection: [] 2023-10-21T15:19:21.806 INFO:scrape:suites union: ['0-nvme-loop', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-node-mgr', '2-ops/repave-all}', '2-ops/rm-zap-wait}', '2-services/basic', '2-services/jaeger', '2-services/mirror', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nvmeof', '2-services/rgw', '2-thrash', '3-final}', '3-inline/no', '3-inline/yes', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'agent/off', 'agent/on', 'base/install', 'centos_8.stream_container_tools', 'cluster/{fixed-3', 'conf/{client', 'conf/{disable-pool-app}', 'fail_fs/no', 'fail_fs/yes', 'fixed-2', 'ignorelist_wrongly_marked_down', 'mds', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'orch/cephadm/osds/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/rbd_iscsi/{0-single-container-host', 'orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8', 'orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04}', 'orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8', 'orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'orchestrator_cli}', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'root}', 'start', 'start}', 'syntax}', 'task/test_ca_signed_key}', 'task/test_extra_daemon_features}', 'task/test_iscsi_container/{centos_8.stream_container_tools', 'task/test_set_mon_crush_locations}', 'tasks/rados_api_tests}', 'tasks/rotate-keys}', 'tasks/{0-from/quincy', 'test_iscsi_container}}', 'workloads/cephadm_iscsi}'] 2023-10-21T15:19:21.807 INFO:scrape: 2023-10-21T15:19:21.808 INFO:scrape:Failure: Command failed on smithi186 with status 7: 'curl --silent -L https://2.chacra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' 2023-10-21T15:19:21.808 INFO:scrape:12 jobs: ['7434248', '7434175', '7434229', '7434139', '7434117', '7434165', '7434025', '7434021', '7434067', '7434159', '7434177', '7434103'] 2023-10-21T15:19:21.809 INFO:scrape:suites intersection: [] 2023-10-21T15:19:21.809 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/repave-all}', '2-services/jaeger', '2-services/mirror', '2-services/nfs-haproxy-proto', '2-services/nfs-ingress', '2-services/nfs-keepalive-only', '2-thrash', '3-final}', '3-tasks/radosbench', 'agent/off', 'agent/on', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8', 'orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun', 'orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'root}', 'start}', 'task/test_orch_cli_mon}'] 2023-10-21T15:19:21.810 INFO:scrape: 2023-10-21T15:19:21.810 INFO:scrape:Failure: Command failed (workunit test suites/fsstress.sh) on smithi186 with status 4: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0804064d67a2a63dbabf1801ff452580a050cfc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' 2023-10-21T15:19:21.810 INFO:scrape:1 jobs: ['7434051'] 2023-10-21T15:19:21.811 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/quincy'] 2023-10-21T15:19:21.811 INFO:scrape: 2023-10-21T15:19:21.812 INFO:scrape:Failure: Command failed on smithi105 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e39acb30-7007-11ee-8db6-212e2dc638e7 -e sha1=f0804064d67a2a63dbabf1801ff452580a050cfc -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-10-21T15:19:21.812 INFO:scrape:2 jobs: ['7434053', '7434185'] 2023-10-21T15:19:21.812 INFO:scrape:suites intersection: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2023-10-21T15:19:21.813 INFO:scrape:suites union: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2023-10-21T15:19:21.813 INFO:scrape: 2023-10-21T15:19:21.813 INFO:scrape:Failure: Command failed on smithi161 with status 1: 'sudo yum -y install cephfs-java' 2023-10-21T15:19:21.814 INFO:scrape:1 jobs: ['7434073'] 2023-10-21T15:19:21.814 INFO:scrape:suites: ['agent/on', 'mon_election/classic', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_orch_cli_mon}'] 2023-10-21T15:19:21.814 INFO:scrape: 2023-10-21T15:19:21.815 INFO:scrape:Failure: No module named 'tasks.cephadm' 2023-10-21T15:19:21.815 INFO:scrape:1 jobs: ['7434055'] 2023-10-21T15:19:21.816 INFO:scrape:suites: ['orch/cephadm/nfs/{cluster/{1-node}', 'overrides/ignorelist_health', 'supported-random-distros$/{centos_latest}', 'tasks/nfs}'] 2023-10-21T15:19:21.816 INFO:scrape: 2023-10-21T15:19:21.822 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/ failed: 71 dead: 20 running: 0 waiting: 0 queued: 0 passed: 64 Fail ================================================================= [7434019] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:10:06 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434019/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434019/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8b4f82b68974c909cf99588977f7f59 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434021] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:12:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434021/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434021/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a304f551fa784a3597a39c41a4b18954 Command failed on smithi086 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434025] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:10:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434025/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434025/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7964132282424dbb901211bd162e10d4 Command failed on smithi003 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434027] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:09:57 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434027/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434027/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32b72f6ebced4dd3afa8ffb28110f7fd HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/quincy/e778460a8e3193b796994c235f1cab5f2dc62 ddf/centos/8/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434029] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:37:47 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434029/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434029/ sentry: https://sentry.ceph.com/organizations/ceph/?query=107062199eff475bb1758be1decdaf63 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434031] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:28:52 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434031/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434031/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f982b831133645fe8411f37e9948b0be HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434037] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434037/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434037/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e6a17d7e3cf4161ac714eb1dea52f1b HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434041] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:11:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434041/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434041/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4639ca88ad474b0fa9097ce56460899a HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434043] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434043/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434043/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ede8f326c9f437598cd1b718881fe7f HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434051] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:43:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434051/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434051/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe24009d1e664e0f9ea3b6dd08527e2d Command failed (workunit test suites/fsstress.sh) on smithi186 with status 4: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f0804064d67a2a63dbabf1801ff452580a050cfc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' [7434053] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:31:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434053/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434053/ sentry: https://sentry.ceph.com/organizations/ceph/?query=10954197937646fbb03e0a2cf223f52b Command failed on smithi105 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e39acb30-7007-11ee-8db6-212e2dc638e7 -e sha1=f0804064d67a2a63dbabf1801ff452580a050cfc -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7434055] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} ----------------------------------------------------------------- time: 00:19:13 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434055/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434055/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5cff2fc6be694aa88760ffd676ebcfd8 No module named 'tasks.cephadm' [7434059] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:19:23 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434059/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434059/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c7d793b3f1a24a4f809723ef05f86f0b HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cf c/centos/8/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434063] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:10:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434063/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434063/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8a3fa204499a4cbbbe678aa1e43e6826 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434065] orch/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:10:44 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434065/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434065/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad67ff07e158431ca884482eaaffd690 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434067] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434067/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434067/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b4b1bab7c96f474f9df4519e23a37ec1 Command failed on smithi129 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434071] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:13:09 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434071/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434071/ sentry: https://sentry.ceph.com/organizations/ceph/?query=34d36db274a14dfc880807b10edfad52 HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cf c/centos/8/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434073] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:16:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434073/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434073/ sentry: https://sentry.ceph.com/organizations/ceph/?query=19d92f40f09c4ce6a0d2d92c13d64447 Command failed on smithi161 with status 1: 'sudo yum -y install cephfs- java' [7434081] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434081/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434081/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8231729a69dd49119936c626b4837b7f HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434086] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434086/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434086/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a55beff7ec8d4451b9e6b62ce5f18cf5 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434088] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434088/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=749507ba97fc457cb2404d81fa1082c6 HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/quincy/e778460a8e3193b796994c235f1cab5f2dc62 ddf/centos/8/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434090] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:35:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434090/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434090/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7cae9a3cb2364d1491d40befbd4069dd HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434094] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:10:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434094/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434094/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dffb7f6805224f218975f9f40bdc59a5 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?project=ceph&distros=centos%2F8%2Fx86_64&flavor=defau lt&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434096] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434096/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434096/ sentry: https://sentry.ceph.com/organizations/ceph/?query=013dc36f20a74c77890da61d19a176fc HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?project=ceph&distros=centos%2F8%2Fx86_64&flavor=defau lt&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434098] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434098/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434098/ sentry: https://sentry.ceph.com/organizations/ceph/?query=abd719850acb497688c6c7de32f07d3a HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F20.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434099] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:06:33 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434099/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434099/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba73d267864047f7a809055bd037eb70 Command failed on smithi094 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1focal cephadm=18.0.0-6820-gf0804064-1focal ceph-mds=18.0.0-6820-gf0804064-1focal ceph-mgr=18.0.0-6820-gf0804064-1focal ceph-common=18.0.0-6820-gf0804064-1focal ceph- fuse=18.0.0-6820-gf0804064-1focal ceph-test=18.0.0-6820-gf0804064-1focal ceph-volume=18.0.0-6820-gf0804064-1focal radosgw=18.0.0-6820-gf0804064-1focal python3-rados=18.0.0-6820-gf0804064-1focal python3-rgw=18.0.0-6820-gf0804064-1focal python3-cephfs=18.0.0-6820-gf0804064-1focal python3-rbd=18.0.0-6820-gf0804064-1focal libcephfs2=18.0.0-6820-gf0804064-1focal libcephfs- dev=18.0.0-6820-gf0804064-1focal librados2=18.0.0-6820-gf0804064-1focal librbd1=18.0.0-6820-gf0804064-1focal rbd-fuse=18.0.0-6820-gf0804064-1focal' [7434100] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:13:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434100/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2354f8be8d5949eba8f71c065773a198 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?project=ceph&distros=centos%2F8%2Fx86_64&flavor=defau lt&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434101] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434101/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434101/ sentry: https://sentry.ceph.com/organizations/ceph/?query=64c26edff15743869bfb5eb39257c9f9 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434103] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:13:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434103/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434103/ sentry: https://sentry.ceph.com/organizations/ceph/?query=65922b54aa13438baca8de7307ae7348 Command failed on smithi124 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434106] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434106/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434106/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2434acd28a7e48b8ae04785e352015d5 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434109] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434109/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434109/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa19c23ad75f4217b7a02e322c24478e HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434111] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} ----------------------------------------------------------------- time: 00:39:29 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434111/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434111/ sentry: https://sentry.ceph.com/organizations/ceph/?query=151a93343ac948c4bab24cc74b1d11c1 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434113] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434113/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434113/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0c2d722c1b74e16a0c525bdc6d391a0 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434117] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434117/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434117/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0225ac6570248ae81fbc5c1291bb33f Command failed on smithi195 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434119] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434119/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434119/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4092eba3c69845db923e7a516299bb13 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434121] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434121/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434121/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6fb0ee268af4d72a967988200396a2c HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434123] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:29:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434123/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434123/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ebfef8c026d48eeb33831cead006fe5 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434125] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:10:02 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434125/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434125/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4def10118177498e9b54d7e7cdee7753 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?project=ceph&distros=centos%2F8%2Fx86_64&flavor=defau lt&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434129] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434129/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434129/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11cf11d7de2544408417b05069bc7387 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434132] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:09:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434132/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434132/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28911b3ed1ca488d9b84fe665d678cc1 HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/quincy/e778460a8e3193b796994c235f1cab5f2dc62 ddf/centos/8/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434135] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:12:53 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434135/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434135/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff14c558f4f64ed8a2432556af86b699 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434137] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_extra_daemon_features} ----------------------------------------------------------------- time: 00:37:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434137/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434137/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8cc85e16281c4242a8bb674ee8059ea2 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434139] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} ----------------------------------------------------------------- time: 00:13:59 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434139/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434139/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1185eeb9ba74ca09687fe0f56268af6 Command failed on smithi124 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434143] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434143/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434143/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5681b430ce31484ba8bff38a8e69a564 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434147] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434147/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434147/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6fee3733af4145f7ac174ea4d17cf135 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F20.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434149] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} ----------------------------------------------------------------- time: 00:34:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434149/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434149/ sentry: https://sentry.ceph.com/organizations/ceph/?query=15bcb4a0c29d47e5a145bf1ba720193e HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434153] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434153/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434153/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01a962c393544c45bf35fc027c5795f3 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434155] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:10:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434155/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434155/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8a538f54707451cb9a5c92ad3bd15a1 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?project=ceph&distros=centos%2F8%2Fx86_64&flavor=defau lt&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434159] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:10:06 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434159/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434159/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc3a6ac949164d5aa9adba4de7012f31 Command failed on smithi155 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434163] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:07:28 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434163/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434163/ sentry: https://sentry.ceph.com/organizations/ceph/?query=95bfa84bbdb74b82be9607fa003fd9a0 Command failed on smithi112 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1focal cephadm=18.0.0-6820-gf0804064-1focal ceph-mds=18.0.0-6820-gf0804064-1focal ceph-mgr=18.0.0-6820-gf0804064-1focal ceph-common=18.0.0-6820-gf0804064-1focal ceph- fuse=18.0.0-6820-gf0804064-1focal ceph-test=18.0.0-6820-gf0804064-1focal ceph-volume=18.0.0-6820-gf0804064-1focal radosgw=18.0.0-6820-gf0804064-1focal python3-rados=18.0.0-6820-gf0804064-1focal python3-rgw=18.0.0-6820-gf0804064-1focal python3-cephfs=18.0.0-6820-gf0804064-1focal python3-rbd=18.0.0-6820-gf0804064-1focal libcephfs2=18.0.0-6820-gf0804064-1focal libcephfs- dev=18.0.0-6820-gf0804064-1focal librados2=18.0.0-6820-gf0804064-1focal librbd1=18.0.0-6820-gf0804064-1focal rbd-fuse=18.0.0-6820-gf0804064-1focal' [7434165] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:38:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434165/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434165/ sentry: https://sentry.ceph.com/organizations/ceph/?query=20fa12cbcb074f0294affc5027959475 Command failed on smithi007 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434167] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:34:01 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434167/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434167/ sentry: https://sentry.ceph.com/organizations/ceph/?query=822ee242653941acaa8d96b42954c86c HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434171] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:09:57 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434171/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=45b1b6bc62a14cceb21719e6e800106e HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434173] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:13 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434173/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434173/ sentry: https://sentry.ceph.com/organizations/ceph/?query=937894c6028e459ba8b8a470491759af HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?project=ceph&distros=centos%2F8%2Fx86_64&flavor=defau lt&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434175] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:13:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434175/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434175/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c13a460e4efe4a8494626fba973f22e7 Command failed on smithi053 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434177] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_orch_cli_mon} ----------------------------------------------------------------- time: 01:14:08 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434177/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434177/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c27f98b71d54898b0b8baee6cafcfbf Command failed on smithi022 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434185] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:41:10 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434185/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434185/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa20a2f4f831475694c61e7d6ebfe447 Command failed on smithi094 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cf50010-7014-11ee-8db6-212e2dc638e7 -e sha1=f0804064d67a2a63dbabf1801ff452580a050cfc -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7434191] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434191/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434191/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4b6c867b9be4f63bd9fccfe83d347dd HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434195] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434195/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434195/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e4de2a3d0f140ba93c33f403ad3b612 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F20.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434199] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:31:53 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434199/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434199/ sentry: https://sentry.ceph.com/organizations/ceph/?query=037bc624677447c8967fb83d3683d951 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?project=ceph&distros=centos%2F8%2Fx86_64&flavor=defau lt&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434209] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nvmeof 3-final} ----------------------------------------------------------------- time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434209/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=94b922f775f1404288e74afe37647b6a HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?project=ceph&distros=centos%2F8%2Fx86_64&flavor=defau lt&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434215] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:38:55 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434215/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434215/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d45647139d074498a67be9778458df9a HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/quincy/e778460a8e3193b796994c235f1cab5f2dc62 ddf/centos/8/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434223] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434223/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bce3461c3c084cf0a7874a7483f8287b Command failed on smithi070 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6820-gf0804064-1focal cephadm=18.0.0-6820-gf0804064-1focal ceph-mds=18.0.0-6820-gf0804064-1focal ceph-mgr=18.0.0-6820-gf0804064-1focal ceph-common=18.0.0-6820-gf0804064-1focal ceph- fuse=18.0.0-6820-gf0804064-1focal ceph-test=18.0.0-6820-gf0804064-1focal ceph-volume=18.0.0-6820-gf0804064-1focal radosgw=18.0.0-6820-gf0804064-1focal python3-rados=18.0.0-6820-gf0804064-1focal python3-rgw=18.0.0-6820-gf0804064-1focal python3-cephfs=18.0.0-6820-gf0804064-1focal python3-rbd=18.0.0-6820-gf0804064-1focal libcephfs2=18.0.0-6820-gf0804064-1focal libcephfs- dev=18.0.0-6820-gf0804064-1focal librados2=18.0.0-6820-gf0804064-1focal librbd1=18.0.0-6820-gf0804064-1focal rbd-fuse=18.0.0-6820-gf0804064-1focal' [7434227] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:32:34 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434227/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434227/ sentry: https://sentry.ceph.com/organizations/ceph/?query=987aa957681a4009b6fb3976b1828f80 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434229] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:39 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434229/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46a26ec189244a83b6913e9ebce63734 Command failed on smithi088 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434231] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434231/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5e4384cef5ab405d9d0f5565b680568a HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F20.04%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434237] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/classic task/test_ca_signed_key} ----------------------------------------------------------------- time: 00:11:51 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434237/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434237/ sentry: https://sentry.ceph.com/organizations/ceph/?query=942c3dade26c4449a590c0d7625939c4 HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cf c/centos/8/flavors/default/repo (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434248] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:14:03 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434248/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434248/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e6f01b480228453c881b9e60582fccff Command failed on smithi186 with status 7: 'curl --silent -L https://2.chac ra.ceph.com/binaries/ceph/main/f0804064d67a2a63dbabf1801ff452580a050cfc/cen tos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7434252] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434252/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434252/ sentry: https://sentry.ceph.com/organizations/ceph/?query=decd5670dadb442daeb28b7f436372dd HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F20.04%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434270] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434270/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434270/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b75694caea084e13bad82e0806d381d3 HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=cent os%2F8%2Fx86_64&ref=main (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) [7434272] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:07:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434272/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434272/ sentry: https://sentry.ceph.com/organizations/ceph/?query=608009e95dcf4a9b903720b7d88cd36e HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubun tu%2F20.04%2Fx86_64&sha1=f0804064d67a2a63dbabf1801ff452580a050cfc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) Dead ================================================================= [7434035] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434035/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434035/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e0b3b8fbebb4e2cb1a28a65f5d423a0 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434047] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:03:18 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434047/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434047/ sentry: https://sentry.ceph.com/organizations/ceph/?query=202677053cfb4376b9014468bedee5e0 ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434049] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434049/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434049/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4e418fda1414e7ea1303679c153597d ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434057] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} ----------------------------------------------------------------- time: 00:03:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434057/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434057/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77db6b965e6946d8bd8b89fd9cc0d13e ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434089] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434089/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434089/ sentry: https://sentry.ceph.com/organizations/ceph/?query=87112b8b245d4b72a7c79714c2caf9d5 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434091] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:03:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434091/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434091/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c283c04362a84ba4830417e57052ffb7 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434102] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_ca_signed_key} ----------------------------------------------------------------- time: 00:05:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434102/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434102/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1672a2f5413342f19fb54a5a8031735f ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7434105] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:05:41 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434105/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434105/ sentry: https://sentry.ceph.com/organizations/ceph/?query=149519f8395e4b19a3113413f2ff593d ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434107] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434107/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434107/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69c82885e6b04c47917434275a651702 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434133] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:49 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434133/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434133/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b9a396919e06491a8d6a1203b62d71cd ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434145] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434145/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434145/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a35aa993a0b04c2eb52a9bb27830a3ae ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434161] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:03:19 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434161/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434161/ sentry: https://sentry.ceph.com/organizations/ceph/?query=965c0a33e7e9484eaf108f691984b151 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7434181] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:03:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434181/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434181/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f9724e5a0334ddc9982d1cae95ab2a4 ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434183] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:05:46 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434183/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434183/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b567138b9f7b497e934f6aef2fc2c393 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434189] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} ----------------------------------------------------------------- time: 00:03:23 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434189/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a9f6e1cca8ce477f95ca10244e9f22fc ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434221] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:05:42 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434221/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434221/ sentry: https://sentry.ceph.com/organizations/ceph/?query=86f63480c9da4f08a23c8e821f16aa6b ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '] [7434247] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434247/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2cfdcb63a3924f9dbe1f9ed16d5bd121 ['Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434256] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434256/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434256/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9a4b369c5994b8fa3c4aab348eda797 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434259] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:05:41 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434259/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb01f494e2564f20927e4aa052d5b2a9 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] [7434260] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} ----------------------------------------------------------------- time: 00:03:25 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434260/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434260/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d4f19c8672fc46c4985b7a526fc55802 ['Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: ', 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '] Pass ================================================================= [7434023] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434023/ [7434033] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:38:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434033/ [7434039] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:47:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434039/ [7434045] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_orch_cli} time: 00:31:58 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434045/ [7434061] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434061/ [7434069] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 01:05:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434069/ [7434075] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:44 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434075/ [7434077] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434077/ [7434079] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:22:08 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434079/ [7434083] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:39 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434083/ [7434085] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:20:17 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434085/ [7434087] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:40:42 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434087/ [7434092] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:20:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434092/ [7434093] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:15:06 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434093/ [7434095] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_adoption} time: 00:36:16 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434095/ [7434097] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:18:45 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434097/ [7434104] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:18:24 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434104/ [7434115] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:19:56 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434115/ [7434127] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_cephadm_repos} time: 00:25:39 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434127/ [7434141] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 01:03:29 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434141/ [7434151] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:52:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434151/ [7434157] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434157/ [7434169] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:23:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434169/ [7434179] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 01:49:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434179/ [7434187] orch/cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{centos_latest} tasks/nfs} time: 00:42:46 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434187/ [7434193] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:38:09 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434193/ [7434197] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:28:00 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434197/ [7434201] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:51:46 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434201/ [7434203] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_rgw_multisite} time: 00:34:13 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434203/ [7434205] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:35:38 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434205/ [7434207] orch/cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:22:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434207/ [7434211] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_set_mon_crush_locations} time: 00:42:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434211/ [7434213] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:22:53 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434213/ [7434217] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:45:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434217/ [7434219] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:20:37 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434219/ [7434225] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_adoption} time: 00:34:42 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434225/ [7434233] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:15:09 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434233/ [7434235] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434235/ [7434239] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:25 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434239/ [7434241] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:38 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434241/ [7434243] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:36:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434243/ [7434245] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:28:11 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434245/ [7434250] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:20:43 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434250/ [7434254] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:18:55 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434254/ [7434262] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/classic task/test_cephadm_repos} time: 00:09:13 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434262/ [7434265] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:54 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434265/ [7434267] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli} time: 00:19:10 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434267/ [7434268] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:44 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434268/ [7434274] orch/cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:14:18 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434274/ [7434276] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:47:31 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434276/ [7434278] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:37:27 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434278/ [7434280] orch/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:29 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434280/ [7434282] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/connectivity task/test_extra_daemon_features} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434282/ [7434284] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:16:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434284/ [7434286] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:21:28 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434286/ [7434288] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:21 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434288/ [7434290] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:48 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434290/ [7434292] orch/cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:57 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434292/ [7434294] orch/cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:38:06 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434294/ [7434296] orch/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:27:35 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434296/ [7434298] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:10 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434298/ [7434300] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:10 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434300/ [7434302] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:20:20 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434302/ [7434304] orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/connectivity task/test_orch_cli} time: 00:19:30 info: http://pulpito.ceph.com/yuriw-2023-10-20_18:45:04-orch-main-distro-default-smithi/7434304/