2026-02-12T07:30:41.433 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T07:30:41.433 INFO:teuthology.results:subset: '1/20' 2026-02-12T07:30:41.433 INFO:teuthology.results:seed: '3755' 2026-02-12T07:46:00.754 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062 2026-02-12T07:46:00.761 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2026-02-12T19:46:45.536 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2026-02-12T19:46:46.112 INFO:scrape:Found 22 jobs 2026-02-12T19:46:46.113 WARNING:scrape:Missing teuthology log /home/teuthworker/mnt/teuthology/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43028/teuthology.log 2026-02-12T19:46:46.264 INFO:scrape:Found 3 distinct failure reasons 2026-02-12T19:46:46.264 INFO:scrape:Dead: None 2026-02-12T19:46:46.264 INFO:scrape:2 jobs: ['43028', '43016'] 2026-02-12T19:46:46.264 INFO:scrape: 2026-02-12T19:46:46.264 INFO:scrape:Failure: Command failed on trial007 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c \'grep \'"\'"\'Number of nodes:3 (including 1 deleted nodes)\'"\'"\' /tmp/ctdb_status\'' 2026-02-12T19:46:46.264 INFO:scrape:1 jobs: ['43021'] 2026-02-12T19:46:46.264 INFO:scrape:suites: ['orch:cephadm:smb/{0-distro/ubuntu_22.04', 'tasks/deploy_smb_ctdb_node_gone_state}'] 2026-02-12T19:46:46.264 INFO:scrape: 2026-02-12T19:46:46.264 INFO:scrape:Failure: Command failed (workunit test smb/smb_tests.sh) on trial020 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ebae5bc0c47dd63a96cf24654d383d83e0ca09fc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 SMB=yes SMB_TEST_META=/var/tmp/ceph-smb-test-meta.json timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/smb/smb_tests.sh -m \'default or hosts_access or rate_limiting\' tests' 2026-02-12T19:46:46.264 INFO:scrape:3 jobs: ['43015', '43031', '43030'] 2026-02-12T19:46:46.264 INFO:scrape:suites intersection: [] 2026-02-12T19:46:46.264 INFO:scrape:suites union: ['orch:cephadm:smb/{0-distro/centos_9.stream', 'orch:cephadm:smb/{0-distro/ubuntu_22.04', 'tasks/deploy_smb_mgr_res_basic}', 'tasks/deploy_smb_mgr_res_dom}'] 2026-02-12T19:46:46.264 INFO:scrape: 2026-02-12T19:46:46.265 INFO:teuthology.results:Sending results to athakkar@redhat.com: Test Run: avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial ================================================================= info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/ logs: https://qa-proxy.ceph.com/teuthology/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/ failed: 4 dead: 1 running: 0 waiting: 1 queued: 0 passed: 16 Fail ================================================================= [43015] orch:cephadm:smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_basic} ----------------------------------------------------------------- time: 00:22:01 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43015/ log: https://qa-proxy.ceph.com/teuthology/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43015/ Command failed (workunit test smb/smb_tests.sh) on trial020 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ebae5bc0c47dd63a96cf24654d383d83e0ca09fc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 SMB=yes SMB_TEST_META=/var/tmp/ceph- smb-test-meta.json timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/smb/smb_tests.sh -m \'default or hosts_access or rate_limiting\' tests' [43021] orch:cephadm:smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_ctdb_node_gone_state} ----------------------------------------------------------------- time: 00:10:15 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43021/ log: https://qa-proxy.ceph.com/teuthology/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43021/ Command failed on trial007 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c \'grep \'"\'"\'Number of nodes:3 (including 1 deleted nodes)\'"\'"\' /tmp/ctdb_status\'' [43030] orch:cephadm:smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_basic} ----------------------------------------------------------------- time: 00:24:34 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43030/ log: https://qa-proxy.ceph.com/teuthology/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43030/ Command failed (workunit test smb/smb_tests.sh) on trial166 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ebae5bc0c47dd63a96cf24654d383d83e0ca09fc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 SMB=yes SMB_TEST_META=/var/tmp/ceph- smb-test-meta.json timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/smb/smb_tests.sh -m \'default or hosts_access or rate_limiting\' tests' [43031] orch:cephadm:smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_dom} ----------------------------------------------------------------- time: 00:22:10 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43031/ log: https://qa-proxy.ceph.com/teuthology/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43031/ Command failed (workunit test smb/smb_tests.sh) on trial176 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ebae5bc0c47dd63a96cf24654d383d83e0ca09fc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 SMB=yes SMB_TEST_META=/var/tmp/ceph- smb-test-meta.json timeout 1h /home/ubuntu/cephtest/clone.client.0/qa/workunits/smb/smb_tests.sh -m \'default or hosts_access or rate_limiting\' tests' Dead ================================================================= [43028] orch:cephadm:smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_ports2c} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43028/ log: https://qa-proxy.ceph.com/teuthology/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43028/ Error reimaging machines: reached maximum tries (120) after waiting for 1800 seconds Waiting ================================================================= [43016] orch:cephadm:smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_dom} info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43016/ Pass ================================================================= [43012] orch:cephadm:smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_ips} time: 00:07:37 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43012/ [43013] orch:cephadm:smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_ctdb_res_ports2c} time: 00:08:09 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43013/ [43014] orch:cephadm:smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_domain} time: 00:13:38 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43014/ [43017] orch:cephadm:smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_ports} time: 00:07:00 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43017/ [43018] orch:cephadm:smb/{0-distro/centos_9.stream tasks/deploy_smb_proxy_disabled} time: 00:04:45 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43018/ [43019] orch:cephadm:smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_proxy_enabled} time: 00:05:09 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43019/ [43020] orch:cephadm:smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic} time: 00:05:07 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43020/ [43022] orch:cephadm:smb/{0-distro/centos_9.stream tasks/deploy_smb_domain} time: 00:03:43 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43022/ [43023] orch:cephadm:smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_basic} time: 00:11:22 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43023/ [43024] orch:cephadm:smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_clustering_ips} time: 00:11:03 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43024/ [43025] orch:cephadm:smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_basic} time: 00:06:35 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43025/ [43026] orch:cephadm:smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_ctdb_res_dom} time: 00:07:13 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43026/ [43027] orch:cephadm:smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_ctdb_res_ips} time: 00:11:16 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43027/ [43029] orch:cephadm:smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_domain} time: 00:11:16 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43029/ [43032] orch:cephadm:smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_ports} time: 00:04:31 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43032/ [43033] orch:cephadm:smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_proxy_disabled} time: 00:07:25 info: https://pulpito.ceph.com/avan-2026-02-10_15:17:14-orch:cephadm:smb-wip-athakkar-testing-2026-02-09-1402-distro-default-trial/43033/ 2026-02-12T19:46:46.272 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/results.py", line 33, in main results(args['--archive-dir'], args['--name'], args['--email'], File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/results.py", line 78, in results email_results( File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/results.py", line 95, in email_results smtp = smtplib.SMTP('localhost') ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 255, in __init__ (code, msg) = self.connect(host, port) ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 341, in connect self.sock = self._get_socket(host, port, self.timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket return socket.create_connection((host, port), timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect self._internal_connect(address) File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect raise _SocketError(err, strerror(err)) ConnectionRefusedError: [Errno 111] Connection refused