2026-02-12T02:12:58.605 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T02:12:58.606 INFO:teuthology.results:subset: '1/8'
2026-02-12T02:12:58.606 INFO:teuthology.results:seed: '7688'
2026-02-12T03:33:58.448 INFO:root:teuthology version: 0.0.1.dev29+gc433f1062
2026-02-12T03:33:58.454 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2026-02-12T15:34:46.627 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2026-02-12T15:34:50.112 INFO:scrape:Found 128 jobs
2026-02-12T15:34:51.360 WARNING:scrape:Missing teuthology log /home/teuthworker/mnt/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45537/teuthology.log
2026-02-12T15:34:56.361 INFO:scrape:Found 13 distinct failure reasons
2026-02-12T15:34:56.361 INFO:scrape:Failure: Command failed on trial004 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:84a80275f63e26ece3f633fd033fd9ecbda16ed2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9d523ccd-07be-11f1-bb37-d404e6e7d460 -- bash -c \'set -ex\n# since we don\'"\'"\'t know the real hostnames before the test, the next\n# bit is in order to replace the fake hostnames "host.a/b/c" with\n# the actual names cephadm knows the host by within the mon spec\nceph orch host ls --format json | jq -r \'"\'"\'.[] | .hostname\'"\'"\' > realnames\necho $\'"\'"\'host.a\\nhost.b\\nhost.c\'"\'"\' > fakenames\necho $\'"\'"\'a\\nb\\nc\'"\'"\' > mon_ids\necho $\'"\'"\'{datacenter=a}\\n{datacenter=b,rack=2}\\n{datacenter=a,rack=3}\'"\'"\' > crush_locs\nceph orch ls --service-name mon --export > mon.yaml\nMONSPEC=`cat mon.yaml`\necho "$MONSPEC"\nwhile read realname <&3 && read fakename <&4; do\n  MONSPEC="${MONSPEC//$fakename/$realname}"\ndone 3<realnames 4<fakenames\necho "$MONSPEC" > mon.yaml\ncat mon.yaml\n# now the spec should have the real hostnames, so let\'"\'"\'s re-apply\nceph orch apply -i mon.yaml\nsleep 90\nceph orch ps --refresh\nceph orch ls --service-name mon --export > mon.yaml; ceph orch apply -i mon.yaml\nsleep 90\nceph mon dump\nceph mon dump --format json\n# verify all the crush locations got set from "ceph mon dump" output\nwhile read monid <&3 && read crushloc <&4; do\n  ceph mon dump --format json | jq --arg monid "$monid" --arg crushloc "$crushloc" -e \'"\'"\'.mons | .[] | select(.name == $monid) | .crush_location == $crushloc\'"\'"\'\ndone 3<mon_ids 4<crush_locs\n\''
2026-02-12T15:34:56.361 INFO:scrape:2 jobs: ['45524', '45605']
2026-02-12T15:34:56.361 INFO:scrape:suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_set_mon_crush_locations}']
2026-02-12T15:34:56.361 INFO:scrape:suites union: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_9.stream_runc', 'orch:cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_set_mon_crush_locations}']
2026-02-12T15:34:56.361 INFO:scrape:
2026-02-12T15:34:56.361 INFO:scrape:Failure: Command failed on trial098 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2251f8f2-07bc-11f1-acf8-d404e6e7d460 -e sha1=84a80275f63e26ece3f633fd033fd9ecbda16ed2 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''
2026-02-12T15:34:56.361 INFO:scrape:3 jobs: ['45505', '45566', '45597']
2026-02-12T15:34:56.361 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client/fuse', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/yes', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/squid']
2026-02-12T15:34:56.361 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/fuse', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/yes', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/squid']
2026-02-12T15:34:56.361 INFO:scrape:
2026-02-12T15:34:56.361 INFO:scrape:Failure: Test failure: test_error (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli.test_error)
2026-02-12T15:34:56.361 INFO:scrape:2 jobs: ['45485', '45550']
2026-02-12T15:34:56.361 INFO:scrape:suites intersection: ['2-node-mgr', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04}', 'orchestrator_cli}']
2026-02-12T15:34:56.361 INFO:scrape:suites union: ['2-node-mgr', 'agent/off', 'agent/on', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04}', 'orchestrator_cli}']
2026-02-12T15:34:56.361 INFO:scrape:
2026-02-12T15:34:56.361 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on trial047 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84a80275f63e26ece3f633fd033fd9ecbda16ed2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'
2026-02-12T15:34:56.361 INFO:scrape:1 jobs: ['45538']
2026-02-12T15:34:56.361 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_9.stream', 'task/test_cephadm}']
2026-02-12T15:34:56.362 INFO:scrape:
2026-02-12T15:34:56.362 INFO:scrape:Dead: b'2026-02-12T08:27:46.178 DEBUG:teuthology.exit:Finished running handlers'
2026-02-12T15:34:56.362 INFO:scrape:1 jobs: ['45493']
2026-02-12T15:34:56.362 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_9.stream', 'task/test_iscsi_container/{centos_9.stream', 'test_iscsi_container}}']
2026-02-12T15:34:56.362 INFO:scrape:
2026-02-12T15:34:56.362 INFO:scrape:Failure: Command failed on trial086 with status 1: 'test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm'
2026-02-12T15:34:56.362 INFO:scrape:1 jobs: ['45482']
2026-02-12T15:34:56.362 INFO:scrape:suites: ['1-bootstrap/18.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream']
2026-02-12T15:34:56.362 INFO:scrape:
2026-02-12T15:34:56.362 INFO:scrape:Dead: None
2026-02-12T15:34:56.362 INFO:scrape:1 jobs: ['45537']
2026-02-12T15:34:56.362 INFO:scrape:
2026-02-12T15:34:56.362 INFO:scrape:Failure: Command failed on trial066 with status 4: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:84a80275f63e26ece3f633fd033fd9ecbda16ed2 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a2ff49c-07bc-11f1-b5cd-d404e6e7d460 -- bash -c \'set -e\nset -x\nceph orch apply node-exporter\nceph orch apply grafana\nceph orch apply alertmanager\nceph orch apply prometheus\nsleep 240\nceph orch ls\nceph orch ps\nceph orch host ls\nMON_DAEMON=$(ceph orch ps --daemon-type mon -f json | jq -r \'"\'"\'last | .daemon_name\'"\'"\')\nGRAFANA_HOST=$(ceph orch ps --daemon-type grafana -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nPROM_HOST=$(ceph orch ps --daemon-type prometheus -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nALERTM_HOST=$(ceph orch ps --daemon-type alertmanager -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r \'"\'"\'.hostname\'"\'"\')\nGRAFANA_IP=$(ceph orch host ls -f json | jq -r --arg GRAFANA_HOST "$GRAFANA_HOST" \'"\'"\'.[] | select(.hostname==$GRAFANA_HOST) | .addr\'"\'"\')\nPROM_IP=$(ceph orch host ls -f json | jq -r --arg PROM_HOST "$PROM_HOST" \'"\'"\'.[] | select(.hostname==$PROM_HOST) | .addr\'"\'"\')\nALERTM_IP=$(ceph orch host ls -f json | jq -r --arg ALERTM_HOST "$ALERTM_HOST" \'"\'"\'.[] | select(.hostname==$ALERTM_HOST) | .addr\'"\'"\')\n# check each host node-exporter metrics endpoint is responsive\nALL_HOST_IPS=$(ceph orch host ls -f json | jq -r \'"\'"\'.[] | .addr\'"\'"\')\nfor ip in $ALL_HOST_IPS; do\n  curl -s http://${ip}:9100/metric\ndone\n# check grafana endpoints are responsive and database health is okay\ncurl -k -s https://${GRAFANA_IP}:3000/api/health\ncurl -k -s https://${GRAFANA_IP}:3000/api/health | jq -e \'"\'"\'.database == "ok"\'"\'"\'\n# stop mon daemon in order to trigger an alert\nceph orch daemon stop $MON_DAEMON\nsleep 120\n# check prometheus endpoints are responsive and mon down alert is firing\ncurl -s http://${PROM_IP}:9095/api/v1/status/config\ncurl -s http://${PROM_IP}:9095/api/v1/status/config | jq -e \'"\'"\'.status == "success"\'"\'"\'\ncurl -s http://${PROM_IP}:9095/api/v1/alerts\ncurl -s http://${PROM_IP}:9095/api/v1/alerts | jq -e \'"\'"\'.data | .alerts | .[] | select(.labels | .alertname == "CephMonDown") | .state == "firing"\'"\'"\'\n# check alertmanager endpoints are responsive and mon down alert is active\ncurl -s http://${ALERTM_IP}:9093/api/v2/status\ncurl -s http://${ALERTM_IP}:9093/api/v2/alerts\ncurl -s http://${ALERTM_IP}:9093/api/v2/alerts | jq -e \'"\'"\'.[] | select(.labels | .alertname == "CephMonDown") | .status | .state == "active"\'"\'"\'\n# check prometheus metrics endpoint is not empty and make sure we can get metrics\nMETRICS_URL=$(ceph mgr services | jq -r .prometheus)\n[ -n "$METRICS_URL" ] || exit 1\ncurl -s "${METRICS_URL}metrics" | grep -q \'"\'"\'^ceph_health_status\'"\'"\'\n\''
2026-02-12T15:34:56.362 INFO:scrape:2 jobs: ['45508', '45590']
2026-02-12T15:34:56.362 INFO:scrape:suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_monitoring_stack_basic}']
2026-02-12T15:34:56.362 INFO:scrape:suites union: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_9.stream', 'orch:cephadm/workunits/{0-distro/ubuntu_22.04', 'task/test_monitoring_stack_basic}']
2026-02-12T15:34:56.362 INFO:scrape:
2026-02-12T15:34:56.362 INFO:scrape:Failure: Failed to reconnect to trial164
2026-02-12T15:34:56.362 INFO:scrape:1 jobs: ['45487']
2026-02-12T15:34:56.362 INFO:scrape:suites: ['cluster/{fixed-3}', 'conf/{disable-pool-app}', 'orch:cephadm/rbd_iscsi/{base/install', 'supported-container-hosts$/{centos_9.stream}', 'workloads/cephadm_iscsi}']
2026-02-12T15:34:56.362 INFO:scrape:
2026-02-12T15:34:56.362 INFO:scrape:Failure: Command failed on trial013 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9e0eb436-07bd-11f1-8ba0-d404e6e7d460 -e sha1=84a80275f63e26ece3f633fd033fd9ecbda16ed2 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''
2026-02-12T15:34:56.362 INFO:scrape:1 jobs: ['45522']
2026-02-12T15:34:56.362 INFO:scrape:suites: ['2-repo_digest/defaut', '3-upgrade/simple', '4-wait', '5-upgrade-ls', 'agent/on', 'mon_election/classic}', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef']
2026-02-12T15:34:56.362 INFO:scrape:
2026-02-12T15:34:56.362 INFO:scrape:Failure: "2026-02-12T03:12:29.144282+0000 mon.a (mon.0) 238 : cluster [WRN] Health check failed: SSH command execution failed with TimeoutError for 1 hosts (CEPHADM_HOST_TIMEOUT_ERROR)" in cluster log
2026-02-12T15:34:56.362 INFO:scrape:2 jobs: ['45549', '45483']
2026-02-12T15:34:56.362 INFO:scrape:suites intersection: []
2026-02-12T15:34:56.362 INFO:scrape:suites union: ['conf/{client', 'ignorelist_health', 'mds', 'mgr', 'mon', 'mon_election/connectivity', 'nfs-version/{unset}', 'orch:cephadm/nfs/{cluster/{1-node}', 'orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream', 'osd}', 'overrides/{ignore_mgr_down', 'pg_health}', 'supported-random-distros$/{ubuntu_latest}', 'task/test_cephadm_timeout}', 'tasks/nfs}']
2026-02-12T15:34:56.362 INFO:scrape:
2026-02-12T15:34:56.363 INFO:scrape:Failure: Command failed on trial030 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 192.168.17.30:/fake /mnt/foo'"
2026-02-12T15:34:56.363 INFO:scrape:1 jobs: ['45582']
2026-02-12T15:34:56.363 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-keepalive-only', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_9.stream']
2026-02-12T15:34:56.363 INFO:scrape:
2026-02-12T15:34:56.363 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds
2026-02-12T15:34:56.363 INFO:scrape:1 jobs: ['45534']
2026-02-12T15:34:56.363 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client/fuse', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/yes', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'kernel', 'mds', 'mgr', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/squid']
2026-02-12T15:34:56.363 INFO:scrape:
2026-02-12T15:34:56.365 INFO:teuthology.results:Sending results to gabrioux@ibm.com: Test Run: gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial
=================================================================
info:    https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/
logs:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/
failed:  17
dead:    1
running: 0
waiting: 1
queued:  0
passed:  109


Fail
=================================================================
[45482]  orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/18.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:01:31
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45482/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45482/

    Command failed on trial086 with status 1: 'test -s
    /home/ubuntu/cephtest/cephadm && test $(stat -c%s
    /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x
    /home/ubuntu/cephtest/cephadm'

[45483]  orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mgr mon osd} nfs-version/{unset} overrides/{ignore_mgr_down ignorelist_health pg_health} supported-random-distros$/{ubuntu_latest} tasks/nfs}
-----------------------------------------------------------------
time:   00:38:56
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45483/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45483/

    "2026-02-12T02:26:09.109673+0000 mon.a (mon.0) 228 : cluster [WRN] Health
    check failed: 1 host (1 osds) down (OSD_HOST_DOWN)" in cluster log

[45485]  orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/off orchestrator_cli}
-----------------------------------------------------------------
time:   00:03:59
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45485/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45485/

    Test failure: test_error
    (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli.test_error)

[45487]  orch:cephadm/rbd_iscsi/{base/install cluster/{fixed-3} conf/{disable-pool-app} supported-container-hosts$/{centos_9.stream} workloads/cephadm_iscsi}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45487/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45487/

    Failed to reconnect to trial164

[45505]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:15:47
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45505/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45505/

    Command failed on trial098 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell
    -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    2251f8f2-07bc-11f1-acf8-d404e6e7d460 -e
    sha1=84a80275f63e26ece3f633fd033fd9ecbda16ed2 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[45508]  orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_monitoring_stack_basic}
-----------------------------------------------------------------
time:   00:14:19
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45508/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45508/

    Command failed on trial066 with status 4: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:84a80275f63e26ece3f633fd033fd9ecbda16ed2 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    3a2ff49c-07bc-11f1-b5cd-d404e6e7d460 -- bash -c \'set -e\nset -x\nceph orch
    apply node-exporter\nceph orch apply grafana\nceph orch apply
    alertmanager\nceph orch apply prometheus\nsleep 240\nceph orch ls\nceph
    orch ps\nceph orch host ls\nMON_DAEMON=$(ceph orch ps --daemon-type mon -f
    json | jq -r \'"\'"\'last | .daemon_name\'"\'"\')\nGRAFANA_HOST=$(ceph orch
    ps --daemon-type grafana -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r
    \'"\'"\'.hostname\'"\'"\')\nPROM_HOST=$(ceph orch ps --daemon-type
    prometheus -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r
    \'"\'"\'.hostname\'"\'"\')\nALERTM_HOST=$(ceph orch ps --daemon-type
    alertmanager -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r
    \'"\'"\'.hostname\'"\'"\')\nGRAFANA_IP=$(ceph orch host ls -f json | jq -r
    --arg GRAFANA_HOST "$GRAFANA_HOST" \'"\'"\'.[] |
    select(.hostname==$GRAFANA_HOST) | .addr\'"\'"\')\nPROM_IP=$(ceph orch host
    ls -f json | jq -r --arg PROM_HOST "$PROM_HOST" \'"\'"\'.[] |
    select(.hostname==$PROM_HOST) | .addr\'"\'"\')\nALERTM_IP=$(ceph orch host
    ls -f json | jq -r --arg ALERTM_HOST "$ALERTM_HOST" \'"\'"\'.[] |
    select(.hostname==$ALERTM_HOST) | .addr\'"\'"\')\n# check each host node-
    exporter metrics endpoint is responsive\nALL_HOST_IPS=$(ceph orch host ls
    -f json | jq -r \'"\'"\'.[] | .addr\'"\'"\')\nfor ip in $ALL_HOST_IPS; do\n
    curl -s http://${ip}:9100/metric\ndone\n# check grafana endpoints are
    responsive and database health is okay\ncurl -k -s
    https://${GRAFANA_IP}:3000/api/health\ncurl -k -s
    https://${GRAFANA_IP}:3000/api/health | jq -e \'"\'"\'.database ==
    "ok"\'"\'"\'\n# stop mon daemon in order to trigger an alert\nceph orch
    daemon stop $MON_DAEMON\nsleep 120\n# check prometheus endpoints are
    responsive and mon down alert is firing\ncurl -s
    http://${PROM_IP}:9095/api/v1/status/config\ncurl -s
    http://${PROM_IP}:9095/api/v1/status/config | jq -e \'"\'"\'.status ==
    "success"\'"\'"\'\ncurl -s http://${PROM_IP}:9095/api/v1/alerts\ncurl -s
    http://${PROM_IP}:9095/api/v1/alerts | jq -e \'"\'"\'.data | .alerts | .[]
    | select(.labels | .alertname == "CephMonDown") | .state ==
    "firing"\'"\'"\'\n# check alertmanager endpoints are responsive and mon
    down alert is active\ncurl -s http://${ALERTM_IP}:9093/api/v2/status\ncurl
    -s http://${ALERTM_IP}:9093/api/v2/alerts\ncurl -s
    http://${ALERTM_IP}:9093/api/v2/alerts | jq -e \'"\'"\'.[] | select(.labels
    | .alertname == "CephMonDown") | .status | .state == "active"\'"\'"\'\n#
    check prometheus metrics endpoint is not empty and make sure we can get
    metrics\nMETRICS_URL=$(ceph mgr services | jq -r .prometheus)\n[ -n
    "$METRICS_URL" ] || exit 1\ncurl -s "${METRICS_URL}metrics" | grep -q
    \'"\'"\'^ceph_health_status\'"\'"\'\n\''

[45522]  orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
-----------------------------------------------------------------
time:   00:16:09
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45522/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45522/

    Command failed on trial013 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell
    -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    9e0eb436-07bd-11f1-8ba0-d404e6e7d460 -e
    sha1=84a80275f63e26ece3f633fd033fd9ecbda16ed2 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[45524]  orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations}
-----------------------------------------------------------------
time:   00:07:42
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45524/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45524/

    Command failed on trial004 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:84a80275f63e26ece3f633fd033fd9ecbda16ed2 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    9d523ccd-07be-11f1-bb37-d404e6e7d460 -- bash -c \'set -ex\n# since we
    don\'"\'"\'t know the real hostnames before the test, the next\n# bit is in
    order to replace the fake hostnames "host.a/b/c" with\n# the actual names
    cephadm knows the host by within the mon spec\nceph orch host ls --format
    json | jq -r \'"\'"\'.[] | .hostname\'"\'"\' > realnames\necho
    $\'"\'"\'host.a\\nhost.b\\nhost.c\'"\'"\' > fakenames\necho
    $\'"\'"\'a\\nb\\nc\'"\'"\' > mon_ids\necho $\'"\'"\'{datacenter=a}\\n{datac
    enter=b,rack=2}\\n{datacenter=a,rack=3}\'"\'"\' > crush_locs\nceph orch ls
    --service-name mon --export > mon.yaml\nMONSPEC=`cat mon.yaml`\necho
    "$MONSPEC"\nwhile read realname <&3 && read fakename <&4; do\n
    MONSPEC="${MONSPEC//$fakename/$realname}"\ndone 3<realnames
    4<fakenames\necho "$MONSPEC" > mon.yaml\ncat mon.yaml\n# now the spec
    should have the real hostnames, so let\'"\'"\'s re-apply\nceph orch apply
    -i mon.yaml\nsleep 90\nceph orch ps --refresh\nceph orch ls --service-name
    mon --export > mon.yaml; ceph orch apply -i mon.yaml\nsleep 90\nceph mon
    dump\nceph mon dump --format json\n# verify all the crush locations got set
    from "ceph mon dump" output\nwhile read monid <&3 && read crushloc <&4;
    do\n  ceph mon dump --format json | jq --arg monid "$monid" --arg crushloc
    "$crushloc" -e \'"\'"\'.mons | .[] | select(.name == $monid) |
    .crush_location == $crushloc\'"\'"\'\ndone 3<mon_ids 4<crush_locs\n\''

[45534]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:18:37
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45534/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45534/

    reached maximum tries (50) after waiting for 300 seconds

[45538]  orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:08:35
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45538/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45538/

    Command failed (workunit test cephadm/test_cephadm.sh) on trial047 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=84a80275f63e26ece3f633fd033fd9ecbda16ed2
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[45549]  orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/connectivity task/test_cephadm_timeout}
-----------------------------------------------------------------
time:   00:06:36
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45549/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45549/

    "2026-02-12T03:12:29.144282+0000 mon.a (mon.0) 238 : cluster [WRN] Health
    check failed: SSH command execution failed with TimeoutError for 1 hosts
    (CEPHADM_HOST_TIMEOUT_ERROR)" in cluster log

[45550]  orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_22.04} 2-node-mgr agent/on orchestrator_cli}
-----------------------------------------------------------------
time:   00:03:56
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45550/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45550/

    Test failure: test_error
    (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli.test_error)

[45566]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:15:25
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45566/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45566/

    Command failed on trial105 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell
    -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    08ef1c89-07c2-11f1-9120-d404e6e7d460 -e
    sha1=84a80275f63e26ece3f633fd033fd9ecbda16ed2 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[45582]  orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
-----------------------------------------------------------------
time:   00:06:37
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45582/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45582/

    Command failed on trial030 with status 32: "sudo
    TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 192.168.17.30:/fake
    /mnt/foo'"

[45590]  orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_monitoring_stack_basic}
-----------------------------------------------------------------
time:   00:10:45
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45590/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45590/

    Command failed on trial049 with status 4: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:84a80275f63e26ece3f633fd033fd9ecbda16ed2 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    075ff6ea-07c4-11f1-a932-d404e6e7d460 -- bash -c \'set -e\nset -x\nceph orch
    apply node-exporter\nceph orch apply grafana\nceph orch apply
    alertmanager\nceph orch apply prometheus\nsleep 240\nceph orch ls\nceph
    orch ps\nceph orch host ls\nMON_DAEMON=$(ceph orch ps --daemon-type mon -f
    json | jq -r \'"\'"\'last | .daemon_name\'"\'"\')\nGRAFANA_HOST=$(ceph orch
    ps --daemon-type grafana -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r
    \'"\'"\'.hostname\'"\'"\')\nPROM_HOST=$(ceph orch ps --daemon-type
    prometheus -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r
    \'"\'"\'.hostname\'"\'"\')\nALERTM_HOST=$(ceph orch ps --daemon-type
    alertmanager -f json | jq -e \'"\'"\'.[]\'"\'"\' | jq -r
    \'"\'"\'.hostname\'"\'"\')\nGRAFANA_IP=$(ceph orch host ls -f json | jq -r
    --arg GRAFANA_HOST "$GRAFANA_HOST" \'"\'"\'.[] |
    select(.hostname==$GRAFANA_HOST) | .addr\'"\'"\')\nPROM_IP=$(ceph orch host
    ls -f json | jq -r --arg PROM_HOST "$PROM_HOST" \'"\'"\'.[] |
    select(.hostname==$PROM_HOST) | .addr\'"\'"\')\nALERTM_IP=$(ceph orch host
    ls -f json | jq -r --arg ALERTM_HOST "$ALERTM_HOST" \'"\'"\'.[] |
    select(.hostname==$ALERTM_HOST) | .addr\'"\'"\')\n# check each host node-
    exporter metrics endpoint is responsive\nALL_HOST_IPS=$(ceph orch host ls
    -f json | jq -r \'"\'"\'.[] | .addr\'"\'"\')\nfor ip in $ALL_HOST_IPS; do\n
    curl -s http://${ip}:9100/metric\ndone\n# check grafana endpoints are
    responsive and database health is okay\ncurl -k -s
    https://${GRAFANA_IP}:3000/api/health\ncurl -k -s
    https://${GRAFANA_IP}:3000/api/health | jq -e \'"\'"\'.database ==
    "ok"\'"\'"\'\n# stop mon daemon in order to trigger an alert\nceph orch
    daemon stop $MON_DAEMON\nsleep 120\n# check prometheus endpoints are
    responsive and mon down alert is firing\ncurl -s
    http://${PROM_IP}:9095/api/v1/status/config\ncurl -s
    http://${PROM_IP}:9095/api/v1/status/config | jq -e \'"\'"\'.status ==
    "success"\'"\'"\'\ncurl -s http://${PROM_IP}:9095/api/v1/alerts\ncurl -s
    http://${PROM_IP}:9095/api/v1/alerts | jq -e \'"\'"\'.data | .alerts | .[]
    | select(.labels | .alertname == "CephMonDown") | .state ==
    "firing"\'"\'"\'\n# check alertmanager endpoints are responsive and mon
    down alert is active\ncurl -s http://${ALERTM_IP}:9093/api/v2/status\ncurl
    -s http://${ALERTM_IP}:9093/api/v2/alerts\ncurl -s
    http://${ALERTM_IP}:9093/api/v2/alerts | jq -e \'"\'"\'.[] | select(.labels
    | .alertname == "CephMonDown") | .status | .state == "active"\'"\'"\'\n#
    check prometheus metrics endpoint is not empty and make sure we can get
    metrics\nMETRICS_URL=$(ceph mgr services | jq -r .prometheus)\n[ -n
    "$METRICS_URL" ] || exit 1\ncurl -s "${METRICS_URL}metrics" | grep -q
    \'"\'"\'^ceph_health_status\'"\'"\'\n\''

[45597]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:14:48
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45597/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45597/

    Command failed on trial121 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell
    -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    90313b97-07c4-11f1-9f94-d404e6e7d460 -e
    sha1=84a80275f63e26ece3f633fd033fd9ecbda16ed2 -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[45605]  orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_set_mon_crush_locations}
-----------------------------------------------------------------
time:   00:11:28
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45605/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45605/

    Command failed on trial043 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:84a80275f63e26ece3f633fd033fd9ecbda16ed2 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    b6994378-07c4-11f1-885f-d404e6e7d460 -- bash -c \'set -ex\n# since we
    don\'"\'"\'t know the real hostnames before the test, the next\n# bit is in
    order to replace the fake hostnames "host.a/b/c" with\n# the actual names
    cephadm knows the host by within the mon spec\nceph orch host ls --format
    json | jq -r \'"\'"\'.[] | .hostname\'"\'"\' > realnames\necho
    $\'"\'"\'host.a\\nhost.b\\nhost.c\'"\'"\' > fakenames\necho
    $\'"\'"\'a\\nb\\nc\'"\'"\' > mon_ids\necho $\'"\'"\'{datacenter=a}\\n{datac
    enter=b,rack=2}\\n{datacenter=a,rack=3}\'"\'"\' > crush_locs\nceph orch ls
    --service-name mon --export > mon.yaml\nMONSPEC=`cat mon.yaml`\necho
    "$MONSPEC"\nwhile read realname <&3 && read fakename <&4; do\n
    MONSPEC="${MONSPEC//$fakename/$realname}"\ndone 3<realnames
    4<fakenames\necho "$MONSPEC" > mon.yaml\ncat mon.yaml\n# now the spec
    should have the real hostnames, so let\'"\'"\'s re-apply\nceph orch apply
    -i mon.yaml\nsleep 90\nceph orch ps --refresh\nceph orch ls --service-name
    mon --export > mon.yaml; ceph orch apply -i mon.yaml\nsleep 90\nceph mon
    dump\nceph mon dump --format json\n# verify all the crush locations got set
    from "ceph mon dump" output\nwhile read monid <&3 && read crushloc <&4;
    do\n  ceph mon dump --format json | jq --arg monid "$monid" --arg crushloc
    "$crushloc" -e \'"\'"\'.mons | .[] | select(.name == $monid) |
    .crush_location == $crushloc\'"\'"\'\ndone 3<mon_ids 4<crush_locs\n\''



Dead
=================================================================
[45493]  orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}}
-----------------------------------------------------------------
time:   00:00:00
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45493/
log:    https://qa-proxy.ceph.com/teuthology/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45493/

    hit max job timeout



Waiting
=================================================================
[45537] orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_ctdb_node_gone_state}
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45537/



Pass
=================================================================
[45479] orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:11:55
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45479/

[45480] orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_ips}
time:   00:07:18
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45480/

[45481] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:14:40
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45481/

[45484] orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream mon_election/classic task/test_orch_cli}
time:   00:05:59
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45484/

[45486] orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:05:14
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45486/

[45488] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:05:52
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45488/

[45489] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream} 1-start 2-services/basic 3-final}
time:   00:03:33
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45489/

[45490] orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:04:16
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45490/

[45491] orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
time:   00:29:19
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45491/

[45492] orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
time:   00:13:04
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45492/

[45494] orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_ctdb_res_ports2c}
time:   00:09:55
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45494/

[45495] orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
time:   00:15:18
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45495/

[45496] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:05:47
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45496/

[45497] orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_domain}
time:   00:13:58
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45497/

[45498] orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_mgmt_gateway}
time:   00:10:23
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45498/

[45499] orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final}
time:   00:05:24
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45499/

[45500] orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:04:30
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45500/

[45501] orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_basic}
time:   00:11:07
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45501/

[45502] orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:13:49
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45502/

[45503] orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
time:   00:19:55
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45503/

[45504] orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:18:24
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45504/

[45506] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:05:48
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45506/

[45507] orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:31:09
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45507/

[45509] orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_dom}
time:   00:11:37
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45509/

[45510] orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/connectivity task/test_orch_cli_mon}
time:   00:11:05
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45510/

[45511] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:04:37
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45511/

[45512] orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
time:   00:12:23
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45512/

[45513] orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_ports}
time:   00:06:45
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45513/

[45514] orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite}
time:   00:05:40
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45514/

[45515] orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:04:57
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45515/

[45516] orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:05:37
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45516/

[45517] orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
time:   00:25:23
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45517/

[45518] orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_proxy_disabled}
time:   00:04:59
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45518/

[45519] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:12:45
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45519/

[45520] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:06:39
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45520/

[45521] orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
time:   00:04:41
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45521/

[45523] orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys}
time:   00:15:05
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45523/

[45525] orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_proxy_enabled}
time:   00:05:09
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45525/

[45526] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:06:06
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45526/

[45527] orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/classic task/test_adoption}
time:   00:02:54
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45527/

[45528] orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/deploy-raw}
time:   00:04:26
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45528/

[45529] orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_basic}
time:   00:06:16
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45529/

[45530] orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:05:17
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45530/

[45531] orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:04:25
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45531/

[45532] orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests}
time:   00:14:53
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45532/

[45533] orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_ca_signed_key}
time:   00:03:39
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45533/

[45535] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:04:37
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45535/

[45536] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:45:21
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45536/

[45539] orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python}
time:   00:15:59
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45539/

[45540] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:04:44
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45540/

[45541] orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_domain}
time:   00:03:48
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45541/

[45542] orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:04:36
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45542/

[45543] orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
time:   00:26:47
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45543/

[45544] orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:04:47
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45544/

[45545] orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_basic}
time:   00:11:26
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45545/

[45546] orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm_repos}
time:   00:01:57
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45546/

[45547] orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys}
time:   00:23:00
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45547/

[45548] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:13:37
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45548/

[45551] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:04:49
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45551/

[45552] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/rgw 3-final}
time:   00:04:39
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45552/

[45553] orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:04:47
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45553/

[45554] orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   00:13:36
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45554/

[45555] orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_clustering_ips}
time:   00:08:49
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45555/

[45556] orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_extra_daemon_features}
time:   00:07:10
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45556/

[45557] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final}
time:   00:05:26
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45557/

[45558] orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:04:09
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45558/

[45559] orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_basic}
time:   00:06:40
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45559/

[45560] orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:05:44
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45560/

[45561] orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
time:   00:18:12
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45561/

[45562] orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests}
time:   00:15:15
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45562/

[45563] orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:05:35
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45563/

[45564] orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_ctdb_res_dom}
time:   00:07:00
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45564/

[45565] orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_host_drain}
time:   00:07:04
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45565/

[45567] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:05:07
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45567/

[45568] orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:31:11
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45568/

[45569] orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
time:   00:13:52
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45569/

[45570] orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_ctdb_res_ips}
time:   00:11:06
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45570/

[45571] orch:cephadm/no-agent-workunits/{0-distro/centos_9.stream_runc mon_election/classic task/test_orch_cli}
time:   00:05:43
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45571/

[45572] orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:04:36
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45572/

[45573] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:05:53
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45573/

[45574] orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root}
time:   00:24:58
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45574/

[45575] orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}}
time:   00:06:04
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45575/

[45576] orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_ctdb_res_ports2c}
time:   00:07:36
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45576/

[45577] orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:14:23
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45577/

[45578] orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:06:30
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45578/

[45579] orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_domain}
time:   00:11:12
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45579/

[45580] orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_mgmt_gateway}
time:   00:11:27
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45580/

[45581] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:12:44
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45581/

[45583] orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:04:18
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45583/

[45584] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-reef 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   00:22:52
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45584/

[45585] orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:04:41
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45585/

[45586] orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_mgr_res_basic}
time:   00:13:13
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45586/

[45587] orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start}
time:   00:16:00
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45587/

[45588] orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:15:13
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45588/

[45589] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:05:43
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45589/

[45591] orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_mgr_res_dom}
time:   00:11:08
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45591/

[45592] orch:cephadm/no-agent-workunits/{0-distro/ubuntu_22.04 mon_election/connectivity task/test_orch_cli_mon}
time:   00:16:24
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45592/

[45593] orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:04:48
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45593/

[45594] orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:16:00
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45594/

[45595] orch:cephadm/smb/{0-distro/centos_9.stream_runc tasks/deploy_smb_mgr_res_ports}
time:   00:04:31
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45595/

[45596] orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_rgw_multisite}
time:   00:06:03
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45596/

[45598] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final}
time:   00:04:28
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45598/

[45599] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_22.04-squid 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:45:45
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45599/

[45600] orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:04:37
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45600/

[45601] orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root}
time:   00:31:49
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45601/

[45602] orch:cephadm/smb/{0-distro/ubuntu_22.04 tasks/deploy_smb_proxy_disabled}
time:   00:07:23
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45602/

[45603] orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:06:56
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45603/

[45604] orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
time:   00:22:36
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45604/

[45606] orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_proxy_enabled}
time:   00:04:58
info:   https://pulpito.ceph.com/gabrioux-2026-02-11_14:50:33-orch:cephadm-wip-guits-main-2026-02-11-1317-distro-default-trial/45606/
2026-02-12T15:34:56.372 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/results.py", line 33, in main
    results(args['--archive-dir'], args['--name'], args['--email'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/results.py", line 78, in results
    email_results(
  File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/teuthology/results.py", line 95, in email_results
    smtp = smtplib.SMTP('localhost')
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/smtplib.py", line 255, in __init__
    (code, msg) = self.connect(host, port)
                  ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/smtplib.py", line 341, in connect
    self.sock = self._get_socket(host, port, self.timeout)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/smtplib.py", line 312, in _get_socket
    return socket.create_connection((host, port), timeout,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/gevent/socket.py", line 115, in create_connection
    sock.connect(sa)
  File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 590, in connect
    self._internal_connect(address)
  File "/home/teuthworker/src/git.ceph.com_teuthology_c433f1062990a0488dc29a553589bc609a460691/virtualenv/lib/python3.12/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect
    raise _SocketError(err, strerror(err))
ConnectionRefusedError: [Errno 111] Connection refused