2026-02-13T20:35:13.133 INFO:root:teuthology version: 1.2.4.dev6+g76f36e686
2026-02-13T20:35:13.133 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:35:13.206 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:35:13.405 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7404a7a6dd00>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7404a7a15300>, signals=[15])
2026-02-13T20:35:13.405 INFO:teuthology.lock.ops:Start node 'trial025.front.sepia.ceph.com' reimaging
2026-02-13T20:35:13.406 INFO:teuthology.lock.ops:Updating [trial025.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T20:35:13.406 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server
2026-02-13T20:35:13.463 INFO:teuthology.lock.ops:Start node 'trial097.front.sepia.ceph.com' reimaging
2026-02-13T20:35:13.463 INFO:teuthology.lock.ops:Updating [trial097.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T20:35:13.464 INFO:teuthology.lock.ops:Updating trial097.front.sepia.ceph.com on lock server
2026-02-13T20:35:13.699 DEBUG:teuthology.provision.fog.trial025:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T20:35:13.706 DEBUG:teuthology.provision.fog.trial097:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T20:35:13.753 INFO:teuthology.provision.fog.trial025:Scheduling deploy of centos 9.stream
2026-02-13T20:35:13.755 INFO:teuthology.provision.fog.trial097:Scheduling deploy of centos 9.stream
2026-02-13T20:35:14.939 INFO:teuthology.orchestra.console.trial097:Power off
2026-02-13T20:35:14.939 DEBUG:teuthology.orchestra.console.trial097:pexpect command: ipmitool -H trial097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T20:35:14.959 INFO:teuthology.orchestra.console.trial025:Power off
2026-02-13T20:35:14.959 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T20:35:14.979 DEBUG:teuthology.orchestra.console.trial097:power off output: Chassis Power Control: Down/Off
2026-02-13T20:35:15.000 DEBUG:teuthology.orchestra.console.trial025:power off output: Chassis Power Control: Down/Off
2026-02-13T20:35:18.983 DEBUG:teuthology.orchestra.console.trial097:pexpect command: ipmitool -H trial097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T20:35:19.000 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T20:35:19.092 DEBUG:teuthology.orchestra.console.trial097:check power output: Chassis Power is off
2026-02-13T20:35:19.092 INFO:teuthology.orchestra.console.trial097:Power off completed
2026-02-13T20:35:19.109 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is off
2026-02-13T20:35:19.109 INFO:teuthology.orchestra.console.trial025:Power off completed
2026-02-13T20:35:19.194 INFO:teuthology.orchestra.console.trial097:Power on
2026-02-13T20:35:19.194 DEBUG:teuthology.orchestra.console.trial097:pexpect command: ipmitool -H trial097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T20:35:19.210 INFO:teuthology.orchestra.console.trial025:Power on
2026-02-13T20:35:19.211 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T20:35:19.235 DEBUG:teuthology.orchestra.console.trial097:power on output: Chassis Power Control: Up/On
2026-02-13T20:35:19.252 DEBUG:teuthology.orchestra.console.trial025:power on output: Chassis Power Control: Up/On
2026-02-13T20:35:23.241 DEBUG:teuthology.orchestra.console.trial097:pexpect command: ipmitool -H trial097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T20:35:23.253 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T20:35:23.349 DEBUG:teuthology.orchestra.console.trial097:check power output: Chassis Power is on
2026-02-13T20:35:23.350 INFO:teuthology.orchestra.console.trial097:Power on completed
2026-02-13T20:35:23.364 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is on
2026-02-13T20:35:23.364 INFO:teuthology.orchestra.console.trial025:Power on completed
2026-02-13T20:35:23.451 INFO:teuthology.provision.fog.trial097:Waiting for deploy to finish
2026-02-13T20:35:23.464 INFO:teuthology.provision.fog.trial025:Waiting for deploy to finish
2026-02-13T20:37:10.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:37:25.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:37:29.053 WARNING:teuthology.provision.fog.trial097:[Errno None] Unable to connect to port 22 on 10.20.193.97
2026-02-13T20:37:35.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:37:38.141 WARNING:teuthology.provision.fog.trial097:[Errno None] Unable to connect to port 22 on 10.20.193.97
2026-02-13T20:37:44.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:37:47.229 WARNING:teuthology.provision.fog.trial097:[Errno None] Unable to connect to port 22 on 10.20.193.97
2026-02-13T20:37:53.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:37:56.317 WARNING:teuthology.provision.fog.trial097:[Errno None] Unable to connect to port 22 on 10.20.193.97
2026-02-13T20:38:02.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:38:10.748 WARNING:teuthology.provision.fog.trial025:timed out
2026-02-13T20:38:16.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:38:24.009 ERROR:teuthology.orchestra.connection:Error authenticating with trial025.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T20:38:28.110 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T20:38:28.110 DEBUG:teuthology.orchestra.run.trial025:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T20:38:32.902 INFO:teuthology.provision.fog.trial025:Node is ready
2026-02-13T20:38:32.903 DEBUG:teuthology.orchestra.run.trial025:> hostname
2026-02-13T20:38:32.922 INFO:teuthology.orchestra.run.trial025.stdout:trial025.front.sepia.ceph.com
2026-02-13T20:38:32.922 DEBUG:teuthology.orchestra.run.trial025:> grep trial025.front.sepia.ceph.com /etc/hosts
2026-02-13T20:38:32.975 INFO:teuthology.orchestra.run.trial025.stdout:10.20.193.25 trial025.front.sepia.ceph.com trial025
2026-02-13T20:38:32.976 DEBUG:teuthology.orchestra.run.trial025:> sudo hostname trial025
2026-02-13T20:38:33.077 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/trial025.front.sepia.ceph.com/trial025/g' /etc/hosts
2026-02-13T20:38:33.163 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/10.20.193.25/10.20.193.25/g' /etc/hosts
2026-02-13T20:38:33.195 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/trial025.front.sepia.ceph.com/trial025/g' /etc/hostname
2026-02-13T20:38:33.260 DEBUG:teuthology.orchestra.run.trial025:> sudo hostname trial025
2026-02-13T20:38:33.325 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:NAME="CentOS Stream"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="9"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:ID="centos"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE="rhel fedora"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="9"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:PLATFORM_ID="platform:el9"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:ANSI_COLOR="0;31"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:LOGO="fedora-logo-icon"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://centos.org/"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T20:38:33.380 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T20:38:33.381 INFO:teuthology.provision.fog.trial025:Deploy complete!
2026-02-13T20:38:33.381 DEBUG:teuthology.parallel:result is None
2026-02-13T20:38:38.116 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T20:38:38.116 DEBUG:teuthology.orchestra.run.trial097:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T20:38:38.279 INFO:teuthology.provision.fog.trial097:Node is ready
2026-02-13T20:38:38.279 DEBUG:teuthology.orchestra.run.trial097:> hostname
2026-02-13T20:38:38.335 INFO:teuthology.orchestra.run.trial097.stdout:trial097.front.sepia.ceph.com
2026-02-13T20:38:38.335 DEBUG:teuthology.orchestra.run.trial097:> grep trial097.front.sepia.ceph.com /etc/hosts
2026-02-13T20:38:38.392 INFO:teuthology.orchestra.run.trial097.stdout:10.20.193.97 trial097.front.sepia.ceph.com trial097
2026-02-13T20:38:38.392 DEBUG:teuthology.orchestra.run.trial097:> sudo hostname trial097
2026-02-13T20:38:38.460 DEBUG:teuthology.orchestra.run.trial097:> sudo sed -i -e 's/trial097.front.sepia.ceph.com/trial097/g' /etc/hosts
2026-02-13T20:38:38.525 DEBUG:teuthology.orchestra.run.trial097:> sudo sed -i -e 's/10.20.193.97/10.20.193.97/g' /etc/hosts
2026-02-13T20:38:38.590 DEBUG:teuthology.orchestra.run.trial097:> sudo sed -i -e 's/trial097.front.sepia.ceph.com/trial097/g' /etc/hostname
2026-02-13T20:38:38.655 DEBUG:teuthology.orchestra.run.trial097:> sudo hostname trial097
2026-02-13T20:38:38.720 DEBUG:teuthology.orchestra.run.trial097:> cat /etc/os-release
2026-02-13T20:38:38.776 INFO:teuthology.orchestra.run.trial097.stdout:NAME="CentOS Stream"
2026-02-13T20:38:38.776 INFO:teuthology.orchestra.run.trial097.stdout:VERSION="9"
2026-02-13T20:38:38.776 INFO:teuthology.orchestra.run.trial097.stdout:ID="centos"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:ID_LIKE="rhel fedora"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:VERSION_ID="9"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:PLATFORM_ID="platform:el9"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:ANSI_COLOR="0;31"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:LOGO="fedora-logo-icon"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:HOME_URL="https://centos.org/"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T20:38:38.777 INFO:teuthology.orchestra.run.trial097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T20:38:38.778 INFO:teuthology.provision.fog.trial097:Deploy complete!
2026-02-13T20:38:38.779 DEBUG:teuthology.parallel:result is None
2026-02-13T20:38:39.174 INFO:teuthology.lock.ops:Checking trial025.front.sepia.ceph.com
2026-02-13T20:38:39.174 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T20:38:39.269 INFO:teuthology.lock.ops:Checking trial097.front.sepia.ceph.com
2026-02-13T20:38:39.269 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T20:38:39.330 INFO:teuthology.lock.ops:Updating [trial025.front.sepia.ceph.com]: set os type and version on server
2026-02-13T20:38:39.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com'
2026-02-13T20:38:39.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:38:39.389 DEBUG:teuthology.orchestra.run.trial025:> true
2026-02-13T20:38:39.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com'
2026-02-13T20:38:39.464 DEBUG:teuthology.orchestra.run.trial025:> uname -m
2026-02-13T20:38:39.520 INFO:teuthology.orchestra.run.trial025.stdout:x86_64
2026-02-13T20:38:39.520 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release
2026-02-13T20:38:39.577 INFO:teuthology.orchestra.run.trial025.stdout:NAME="CentOS Stream"
2026-02-13T20:38:39.577 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="9"
2026-02-13T20:38:39.577 INFO:teuthology.orchestra.run.trial025.stdout:ID="centos"
2026-02-13T20:38:39.577 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE="rhel fedora"
2026-02-13T20:38:39.577 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="9"
2026-02-13T20:38:39.577 INFO:teuthology.orchestra.run.trial025.stdout:PLATFORM_ID="platform:el9"
2026-02-13T20:38:39.577 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T20:38:39.577 INFO:teuthology.orchestra.run.trial025.stdout:ANSI_COLOR="0;31"
2026-02-13T20:38:39.578 INFO:teuthology.orchestra.run.trial025.stdout:LOGO="fedora-logo-icon"
2026-02-13T20:38:39.578 INFO:teuthology.orchestra.run.trial025.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T20:38:39.578 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://centos.org/"
2026-02-13T20:38:39.578 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T20:38:39.578 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T20:38:39.578 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T20:38:39.579 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server
2026-02-13T20:38:39.678 INFO:teuthology.lock.ops:Updating [trial097.front.sepia.ceph.com]: set os type and version on server
2026-02-13T20:38:39.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial097.front.sepia.ceph.com'
2026-02-13T20:38:39.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T20:38:39.744 DEBUG:teuthology.orchestra.run.trial097:> true
2026-02-13T20:38:39.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial097.front.sepia.ceph.com'
2026-02-13T20:38:39.819 DEBUG:teuthology.orchestra.run.trial097:> uname -m
2026-02-13T20:38:39.874 INFO:teuthology.orchestra.run.trial097.stdout:x86_64
2026-02-13T20:38:39.874 DEBUG:teuthology.orchestra.run.trial097:> cat /etc/os-release
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:NAME="CentOS Stream"
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:VERSION="9"
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:ID="centos"
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:ID_LIKE="rhel fedora"
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:VERSION_ID="9"
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:PLATFORM_ID="platform:el9"
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:ANSI_COLOR="0;31"
2026-02-13T20:38:39.930 INFO:teuthology.orchestra.run.trial097.stdout:LOGO="fedora-logo-icon"
2026-02-13T20:38:39.931 INFO:teuthology.orchestra.run.trial097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T20:38:39.931 INFO:teuthology.orchestra.run.trial097.stdout:HOME_URL="https://centos.org/"
2026-02-13T20:38:39.931 INFO:teuthology.orchestra.run.trial097.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T20:38:39.931 INFO:teuthology.orchestra.run.trial097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T20:38:39.931 INFO:teuthology.orchestra.run.trial097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T20:38:39.931 INFO:teuthology.lock.ops:Updating trial097.front.sepia.ceph.com on lock server
2026-02-13T20:38:40.022 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:38:40.115 INFO:teuthology.dispatcher.supervisor:Running job 50041
2026-02-13T20:38:40.115 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50041 --name pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no kernel overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50041/orig.config.yaml
2026-02-13T20:38:40.116 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50041
2026-02-13T20:38:40.116 INFO:teuthology.dispatcher.supervisor:Job PID: 4007869
2026-02-13T20:38:40.116 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T20:40:40.216 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:42:40.298 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:44:40.490 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:46:40.690 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:47:00.790 ERROR:teuthology.report:POST to https://paddles-paddles.apps.pok.os.sepia.ceph.com/runs/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/jobs/ failed with status 503: <html>
  <head>
    <meta name="viewport" content="width=device-width, initial-scale=1">

    <style type="text/css">
      body {
        font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
        line-height: 1.66666667;
        font-size: 16px;
        color: #333;
        background-color: #fff;
        margin: 2em 1em;
      }
      h1 {
        font-size: 28px;
        font-weight: 400;
      }
      p {
        margin: 0 0 10px;
      }
      .alert.alert-info {
        background-color: #F0F0F0;
        margin-top: 30px;
        padding: 30px;
      }
      .alert p {
        padding-left: 35px;
      }
      ul {
        padding-left: 51px;
        position: relative;
      }
      li {
        font-size: 14px;
        margin-bottom: 1em;
      }
      p.info {
        position: relative;
        font-size: 20px;
      }
      p.info:before, p.info:after {
        content: "";
        left: 0;
        position: absolute;
        top: 0;
      }
      p.info:before {
        background: #0066CC;
        border-radius: 16px;
        color: #fff;
        content: "i";
        font: bold 16px/24px serif;
        height: 24px;
        left: 0px;
        text-align: center;
        top: 4px;
        width: 24px;
      }

      @media (min-width: 768px) {
        body {
          margin: 6em;
        }
      }
    </style>
  </head>
  <body>
    <div>
      <h1>Application is not available</h1>
      <p>The application is currently not serving requests at this endpoint. It may not have been started or is still starting.</p>

      <div class="alert alert-info">
        <p class="info">
          Possible reasons you are seeing this page:
        </p>
        <ul>
          <li>
            <strong>The host doesn't exist.</strong>
            Make sure the hostname was typed correctly and that a route matching this hostname exists.
          </li>
          <li>
            <strong>The host exists, but doesn't have a matching path.</strong>
            Check if the URL path was typed correctly and that the route was created using the desired path.
          </li>
          <li>
            <strong>Route and path matches, but all pods are down.</strong>
            Make sure that the resources exposed by this route (pods, services, deployment configs, etc) have at least one pod running.
          </li>
        </ul>
      </div>
    </div>
  </body>
</html>

2026-02-13T20:49:07.640 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:51:07.755 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:53:07.942 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:55:08.125 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:57:08.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T20:59:08.509 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:01:08.689 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:03:08.870 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:03:08.961 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T21:03:09.077 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T21:03:09.610 INFO:teuthology.orchestra.console.trial097:Power off
2026-02-13T21:03:09.611 DEBUG:teuthology.orchestra.console.trial097:pexpect command: ipmitool -H trial097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T21:03:09.631 INFO:teuthology.orchestra.console.trial025:Power off
2026-02-13T21:03:09.631 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T21:03:09.649 DEBUG:teuthology.orchestra.console.trial097:power off output: Chassis Power Control: Down/Off
2026-02-13T21:03:09.669 DEBUG:teuthology.orchestra.console.trial025:power off output: Chassis Power Control: Down/Off
2026-02-13T21:03:13.654 DEBUG:teuthology.orchestra.console.trial097:pexpect command: ipmitool -H trial097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:03:13.670 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:03:13.763 DEBUG:teuthology.orchestra.console.trial097:check power output: Chassis Power is on
2026-02-13T21:03:13.780 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is on
2026-02-13T21:03:17.767 DEBUG:teuthology.orchestra.console.trial097:pexpect command: ipmitool -H trial097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:03:17.781 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:03:17.878 DEBUG:teuthology.orchestra.console.trial097:check power output: Chassis Power is off
2026-02-13T21:03:17.879 INFO:teuthology.orchestra.console.trial097:Power off completed
2026-02-13T21:03:17.891 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is off
2026-02-13T21:03:17.892 INFO:teuthology.orchestra.console.trial025:Power off completed
2026-02-13T21:03:18.115 INFO:teuthology.lock.ops:unlocked: trial097.front.sepia.ceph.com
2026-02-13T21:03:18.128 INFO:teuthology.lock.ops:unlocked: trial025.front.sepia.ceph.com