2026-02-18T04:24:19.078 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-18T04:24:19.078 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T04:24:19.150 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T04:24:19.398 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x751a86160d40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x751a8593b600>, signals=[15])
2026-02-18T04:24:19.398 INFO:teuthology.lock.ops:Start node 'trial077.front.sepia.ceph.com' reimaging
2026-02-18T04:24:19.398 INFO:teuthology.lock.ops:Updating [trial077.front.sepia.ceph.com]: reset os type and version on server
2026-02-18T04:24:19.398 INFO:teuthology.lock.ops:Updating trial077.front.sepia.ceph.com on lock server
2026-02-18T04:24:19.455 INFO:teuthology.lock.ops:Start node 'trial154.front.sepia.ceph.com' reimaging
2026-02-18T04:24:19.455 INFO:teuthology.lock.ops:Updating [trial154.front.sepia.ceph.com]: reset os type and version on server
2026-02-18T04:24:19.455 INFO:teuthology.lock.ops:Updating trial154.front.sepia.ceph.com on lock server
2026-02-18T04:24:19.513 INFO:teuthology.lock.ops:Start node 'trial172.front.sepia.ceph.com' reimaging
2026-02-18T04:24:19.513 INFO:teuthology.lock.ops:Updating [trial172.front.sepia.ceph.com]: reset os type and version on server
2026-02-18T04:24:19.513 INFO:teuthology.lock.ops:Updating trial172.front.sepia.ceph.com on lock server
2026-02-18T04:24:19.692 DEBUG:teuthology.provision.fog.trial154:Requesting image trial_centos_9.stream (ID 3)
2026-02-18T04:24:19.746 INFO:teuthology.provision.fog.trial154:Scheduling deploy of centos 9.stream
2026-02-18T04:24:19.747 DEBUG:teuthology.provision.fog.trial077:Requesting image trial_centos_9.stream (ID 3)
2026-02-18T04:24:19.784 DEBUG:teuthology.provision.fog.trial172:Requesting image trial_centos_9.stream (ID 3)
2026-02-18T04:24:19.793 INFO:teuthology.provision.fog.trial077:Scheduling deploy of centos 9.stream
2026-02-18T04:24:19.829 INFO:teuthology.provision.fog.trial172:Scheduling deploy of centos 9.stream
2026-02-18T04:24:21.296 INFO:teuthology.orchestra.console.trial077:Power off
2026-02-18T04:24:21.296 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-18T04:24:21.309 INFO:teuthology.orchestra.console.trial172:Power off
2026-02-18T04:24:21.309 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-18T04:24:21.319 INFO:teuthology.orchestra.console.trial154:Power off
2026-02-18T04:24:21.319 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-18T04:24:21.336 DEBUG:teuthology.orchestra.console.trial077:power off output: Chassis Power Control: Down/Off
2026-02-18T04:24:21.348 DEBUG:teuthology.orchestra.console.trial172:power off output: Chassis Power Control: Down/Off
2026-02-18T04:24:21.358 DEBUG:teuthology.orchestra.console.trial154:power off output: Chassis Power Control: Down/Off
2026-02-18T04:24:25.341 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:24:25.349 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:24:25.359 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:24:25.449 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is off
2026-02-18T04:24:25.450 INFO:teuthology.orchestra.console.trial077:Power off completed
2026-02-18T04:24:25.457 DEBUG:teuthology.orchestra.console.trial172:check power output: Chassis Power is off
2026-02-18T04:24:25.457 INFO:teuthology.orchestra.console.trial172:Power off completed
2026-02-18T04:24:25.466 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is off
2026-02-18T04:24:25.466 INFO:teuthology.orchestra.console.trial154:Power off completed
2026-02-18T04:24:25.551 INFO:teuthology.orchestra.console.trial077:Power on
2026-02-18T04:24:25.552 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-18T04:24:25.560 INFO:teuthology.orchestra.console.trial172:Power on
2026-02-18T04:24:25.561 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-18T04:24:25.568 INFO:teuthology.orchestra.console.trial154:Power on
2026-02-18T04:24:25.569 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-18T04:24:25.592 DEBUG:teuthology.orchestra.console.trial077:power on output: Chassis Power Control: Up/On
2026-02-18T04:24:25.600 DEBUG:teuthology.orchestra.console.trial172:power on output: Chassis Power Control: Up/On
2026-02-18T04:24:25.608 DEBUG:teuthology.orchestra.console.trial154:power on output: Chassis Power Control: Up/On
2026-02-18T04:24:29.597 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:24:29.605 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:24:29.613 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:24:29.707 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is on
2026-02-18T04:24:29.708 INFO:teuthology.orchestra.console.trial077:Power on completed
2026-02-18T04:24:29.715 DEBUG:teuthology.orchestra.console.trial172:check power output: Chassis Power is on
2026-02-18T04:24:29.716 INFO:teuthology.orchestra.console.trial172:Power on completed
2026-02-18T04:24:29.724 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is on
2026-02-18T04:24:29.725 INFO:teuthology.orchestra.console.trial154:Power on completed
2026-02-18T04:24:29.809 INFO:teuthology.provision.fog.trial077:Waiting for deploy to finish
2026-02-18T04:24:29.817 INFO:teuthology.provision.fog.trial172:Waiting for deploy to finish
2026-02-18T04:24:29.825 INFO:teuthology.provision.fog.trial154:Waiting for deploy to finish
2026-02-18T04:26:17.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:26:17.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:26:17.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:26:17.808 ERROR:teuthology.orchestra.connection:Error authenticating with trial154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-18T04:26:20.736 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-18T04:26:26.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:26:29.824 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-18T04:26:35.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:26:38.912 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-18T04:26:44.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:26:48.000 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-18T04:26:54.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:26:57.088 WARNING:teuthology.provision.fog.trial172:[Errno None] Unable to connect to port 22 on 10.20.193.172
2026-02-18T04:27:03.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:27:17.581 WARNING:teuthology.provision.fog.trial077:timed out
2026-02-18T04:27:21.812 WARNING:teuthology.provision.fog.trial154:timed out
2026-02-18T04:27:23.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:27:27.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:27:28.833 ERROR:teuthology.orchestra.connection:Error authenticating with trial077.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-18T04:27:32.958 ERROR:teuthology.orchestra.connection:Error authenticating with trial077.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-18T04:27:38.857 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-18T04:27:38.857 DEBUG:teuthology.orchestra.run.trial172:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-18T04:27:39.126 ERROR:teuthology.orchestra.connection:Error authenticating with trial154.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-18T04:27:39.162 INFO:teuthology.provision.fog.trial172:Node is ready
2026-02-18T04:27:39.162 DEBUG:teuthology.orchestra.run.trial172:> hostname
2026-02-18T04:27:39.223 INFO:teuthology.orchestra.run.trial172.stdout:trial172.front.sepia.ceph.com
2026-02-18T04:27:39.223 DEBUG:teuthology.orchestra.run.trial172:> grep trial172.front.sepia.ceph.com /etc/hosts
2026-02-18T04:27:39.267 INFO:teuthology.orchestra.run.trial172.stdout:10.20.193.172 trial172.front.sepia.ceph.com trial172
2026-02-18T04:27:39.268 DEBUG:teuthology.orchestra.run.trial172:> sudo hostname trial172
2026-02-18T04:27:39.338 DEBUG:teuthology.orchestra.run.trial172:> sudo sed -i -e 's/trial172.front.sepia.ceph.com/trial172/g' /etc/hosts
2026-02-18T04:27:39.404 DEBUG:teuthology.orchestra.run.trial172:> sudo sed -i -e 's/10.20.193.172/10.20.193.172/g' /etc/hosts
2026-02-18T04:27:39.469 DEBUG:teuthology.orchestra.run.trial172:> sudo sed -i -e 's/trial172.front.sepia.ceph.com/trial172/g' /etc/hostname
2026-02-18T04:27:39.536 DEBUG:teuthology.orchestra.run.trial172:> sudo hostname trial172
2026-02-18T04:27:39.599 DEBUG:teuthology.orchestra.run.trial172:> cat /etc/os-release
2026-02-18T04:27:39.657 INFO:teuthology.orchestra.run.trial172.stdout:NAME="CentOS Stream"
2026-02-18T04:27:39.657 INFO:teuthology.orchestra.run.trial172.stdout:VERSION="9"
2026-02-18T04:27:39.657 INFO:teuthology.orchestra.run.trial172.stdout:ID="centos"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:ID_LIKE="rhel fedora"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:VERSION_ID="9"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:PLATFORM_ID="platform:el9"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:ANSI_COLOR="0;31"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:LOGO="fedora-logo-icon"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:HOME_URL="https://centos.org/"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-18T04:27:39.658 INFO:teuthology.orchestra.run.trial172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-18T04:27:39.659 INFO:teuthology.provision.fog.trial172:Deploy complete!
2026-02-18T04:27:39.661 DEBUG:teuthology.parallel:result is None
2026-02-18T04:27:40.069 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-18T04:27:40.069 DEBUG:teuthology.orchestra.run.trial077:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-18T04:27:40.233 INFO:teuthology.provision.fog.trial077:Node is ready
2026-02-18T04:27:40.234 DEBUG:teuthology.orchestra.run.trial077:> hostname
2026-02-18T04:27:40.288 INFO:teuthology.orchestra.run.trial077.stdout:trial077.front.sepia.ceph.com
2026-02-18T04:27:40.288 DEBUG:teuthology.orchestra.run.trial077:> grep trial077.front.sepia.ceph.com /etc/hosts
2026-02-18T04:27:40.342 INFO:teuthology.orchestra.run.trial077.stdout:10.20.193.77 trial077.front.sepia.ceph.com trial077
2026-02-18T04:27:40.342 DEBUG:teuthology.orchestra.run.trial077:> sudo hostname trial077
2026-02-18T04:27:40.410 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/trial077.front.sepia.ceph.com/trial077/g' /etc/hosts
2026-02-18T04:27:40.475 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/10.20.193.77/10.20.193.77/g' /etc/hosts
2026-02-18T04:27:40.537 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/trial077.front.sepia.ceph.com/trial077/g' /etc/hostname
2026-02-18T04:27:40.599 DEBUG:teuthology.orchestra.run.trial077:> sudo hostname trial077
2026-02-18T04:27:40.661 DEBUG:teuthology.orchestra.run.trial077:> cat /etc/os-release
2026-02-18T04:27:40.715 INFO:teuthology.orchestra.run.trial077.stdout:NAME="CentOS Stream"
2026-02-18T04:27:40.715 INFO:teuthology.orchestra.run.trial077.stdout:VERSION="9"
2026-02-18T04:27:40.715 INFO:teuthology.orchestra.run.trial077.stdout:ID="centos"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:ID_LIKE="rhel fedora"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_ID="9"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:PLATFORM_ID="platform:el9"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:ANSI_COLOR="0;31"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:LOGO="fedora-logo-icon"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:HOME_URL="https://centos.org/"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-18T04:27:40.716 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-18T04:27:40.717 INFO:teuthology.provision.fog.trial077:Deploy complete!
2026-02-18T04:27:40.718 DEBUG:teuthology.parallel:result is None
2026-02-18T04:27:43.286 ERROR:teuthology.orchestra.connection:Error authenticating with trial154.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-18T04:27:50.398 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-18T04:27:50.399 DEBUG:teuthology.orchestra.run.trial154:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-18T04:27:50.560 INFO:teuthology.provision.fog.trial154:Node is ready
2026-02-18T04:27:50.560 DEBUG:teuthology.orchestra.run.trial154:> hostname
2026-02-18T04:27:50.615 INFO:teuthology.orchestra.run.trial154.stdout:trial154.front.sepia.ceph.com
2026-02-18T04:27:50.616 DEBUG:teuthology.orchestra.run.trial154:> grep trial154.front.sepia.ceph.com /etc/hosts
2026-02-18T04:27:50.755 INFO:teuthology.orchestra.run.trial154.stdout:10.20.193.154 trial154.front.sepia.ceph.com trial154
2026-02-18T04:27:50.755 DEBUG:teuthology.orchestra.run.trial154:> sudo hostname trial154
2026-02-18T04:27:50.821 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i -e 's/trial154.front.sepia.ceph.com/trial154/g' /etc/hosts
2026-02-18T04:27:50.883 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i -e 's/10.20.193.154/10.20.193.154/g' /etc/hosts
2026-02-18T04:27:50.946 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i -e 's/trial154.front.sepia.ceph.com/trial154/g' /etc/hostname
2026-02-18T04:27:51.010 DEBUG:teuthology.orchestra.run.trial154:> sudo hostname trial154
2026-02-18T04:27:51.073 DEBUG:teuthology.orchestra.run.trial154:> cat /etc/os-release
2026-02-18T04:27:51.126 INFO:teuthology.orchestra.run.trial154.stdout:NAME="CentOS Stream"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:VERSION="9"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:ID="centos"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:ID_LIKE="rhel fedora"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:VERSION_ID="9"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:PLATFORM_ID="platform:el9"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:ANSI_COLOR="0;31"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:LOGO="fedora-logo-icon"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:HOME_URL="https://centos.org/"
2026-02-18T04:27:51.127 INFO:teuthology.orchestra.run.trial154.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-18T04:27:51.128 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-18T04:27:51.128 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-18T04:27:51.128 INFO:teuthology.provision.fog.trial154:Deploy complete!
2026-02-18T04:27:51.128 DEBUG:teuthology.parallel:result is None
2026-02-18T04:27:51.663 INFO:teuthology.lock.ops:Checking trial077.front.sepia.ceph.com
2026-02-18T04:27:51.663 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-18T04:27:51.782 INFO:teuthology.lock.ops:Checking trial154.front.sepia.ceph.com
2026-02-18T04:27:51.782 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-18T04:27:51.851 INFO:teuthology.lock.ops:Checking trial172.front.sepia.ceph.com
2026-02-18T04:27:51.851 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-18T04:27:51.908 INFO:teuthology.lock.ops:Updating [trial077.front.sepia.ceph.com]: set os type and version on server
2026-02-18T04:27:51.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com'
2026-02-18T04:27:51.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:27:51.969 DEBUG:teuthology.orchestra.run.trial077:> true
2026-02-18T04:27:52.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial077.front.sepia.ceph.com'
2026-02-18T04:27:52.135 DEBUG:teuthology.orchestra.run.trial077:> uname -m
2026-02-18T04:27:52.203 INFO:teuthology.orchestra.run.trial077.stdout:x86_64
2026-02-18T04:27:52.203 DEBUG:teuthology.orchestra.run.trial077:> cat /etc/os-release
2026-02-18T04:27:52.262 INFO:teuthology.orchestra.run.trial077.stdout:NAME="CentOS Stream"
2026-02-18T04:27:52.262 INFO:teuthology.orchestra.run.trial077.stdout:VERSION="9"
2026-02-18T04:27:52.262 INFO:teuthology.orchestra.run.trial077.stdout:ID="centos"
2026-02-18T04:27:52.263 INFO:teuthology.orchestra.run.trial077.stdout:ID_LIKE="rhel fedora"
2026-02-18T04:27:52.263 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_ID="9"
2026-02-18T04:27:52.263 INFO:teuthology.orchestra.run.trial077.stdout:PLATFORM_ID="platform:el9"
2026-02-18T04:27:52.263 INFO:teuthology.orchestra.run.trial077.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-18T04:27:52.263 INFO:teuthology.orchestra.run.trial077.stdout:ANSI_COLOR="0;31"
2026-02-18T04:27:52.263 INFO:teuthology.orchestra.run.trial077.stdout:LOGO="fedora-logo-icon"
2026-02-18T04:27:52.264 INFO:teuthology.orchestra.run.trial077.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-18T04:27:52.264 INFO:teuthology.orchestra.run.trial077.stdout:HOME_URL="https://centos.org/"
2026-02-18T04:27:52.264 INFO:teuthology.orchestra.run.trial077.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-18T04:27:52.264 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-18T04:27:52.264 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-18T04:27:52.265 INFO:teuthology.lock.ops:Updating trial077.front.sepia.ceph.com on lock server
2026-02-18T04:27:52.368 INFO:teuthology.lock.ops:Updating [trial154.front.sepia.ceph.com]: set os type and version on server
2026-02-18T04:27:52.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com'
2026-02-18T04:27:52.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:27:52.430 DEBUG:teuthology.orchestra.run.trial154:> true
2026-02-18T04:27:52.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com'
2026-02-18T04:27:52.505 DEBUG:teuthology.orchestra.run.trial154:> uname -m
2026-02-18T04:27:52.560 INFO:teuthology.orchestra.run.trial154.stdout:x86_64
2026-02-18T04:27:52.560 DEBUG:teuthology.orchestra.run.trial154:> cat /etc/os-release
2026-02-18T04:27:52.615 INFO:teuthology.orchestra.run.trial154.stdout:NAME="CentOS Stream"
2026-02-18T04:27:52.615 INFO:teuthology.orchestra.run.trial154.stdout:VERSION="9"
2026-02-18T04:27:52.615 INFO:teuthology.orchestra.run.trial154.stdout:ID="centos"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:ID_LIKE="rhel fedora"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:VERSION_ID="9"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:PLATFORM_ID="platform:el9"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:ANSI_COLOR="0;31"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:LOGO="fedora-logo-icon"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:HOME_URL="https://centos.org/"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-18T04:27:52.616 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-18T04:27:52.617 INFO:teuthology.lock.ops:Updating trial154.front.sepia.ceph.com on lock server
2026-02-18T04:27:52.721 INFO:teuthology.lock.ops:Updating [trial172.front.sepia.ceph.com]: set os type and version on server
2026-02-18T04:27:52.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial172.front.sepia.ceph.com'
2026-02-18T04:27:52.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T04:27:52.798 DEBUG:teuthology.orchestra.run.trial172:> true
2026-02-18T04:27:52.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial172.front.sepia.ceph.com'
2026-02-18T04:27:52.961 DEBUG:teuthology.orchestra.run.trial172:> uname -m
2026-02-18T04:27:53.016 INFO:teuthology.orchestra.run.trial172.stdout:x86_64
2026-02-18T04:27:53.017 DEBUG:teuthology.orchestra.run.trial172:> cat /etc/os-release
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:NAME="CentOS Stream"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:VERSION="9"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:ID="centos"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:ID_LIKE="rhel fedora"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:VERSION_ID="9"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:PLATFORM_ID="platform:el9"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:ANSI_COLOR="0;31"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:LOGO="fedora-logo-icon"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:HOME_URL="https://centos.org/"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-18T04:27:53.072 INFO:teuthology.orchestra.run.trial172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-18T04:27:53.072 INFO:teuthology.lock.ops:Updating trial172.front.sepia.ceph.com on lock server
2026-02-18T04:27:53.129 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T04:27:53.330 INFO:teuthology.dispatcher.supervisor:Running job 54611
2026-02-18T04:27:53.330 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_yuriw@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:23:05-orch-20.2.1_2.17.26-baseline_2-distro-default-trial/54611 --name yuriw-2026-02-17_21:23:05-orch-20.2.1_2.17.26-baseline_2-distro-default-trial --description orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} -- /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:23:05-orch-20.2.1_2.17.26-baseline_2-distro-default-trial/54611/orig.config.yaml
2026-02-18T04:27:53.331 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:23:05-orch-20.2.1_2.17.26-baseline_2-distro-default-trial/54611
2026-02-18T04:27:53.331 INFO:teuthology.dispatcher.supervisor:Job PID: 2634598
2026-02-18T04:27:53.331 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-18T04:29:53.332 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T04:31:53.453 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T04:33:53.524 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T04:35:53.764 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T04:37:53.890 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T04:37:54.011 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-18T04:37:54.209 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-18T04:37:54.803 INFO:teuthology.orchestra.console.trial154:Power off
2026-02-18T04:37:54.803 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-18T04:37:54.907 DEBUG:teuthology.orchestra.console.trial154:power off output: Chassis Power Control: Down/Off
2026-02-18T04:37:54.919 INFO:teuthology.orchestra.console.trial172:Power off
2026-02-18T04:37:54.919 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-18T04:37:54.960 DEBUG:teuthology.orchestra.console.trial172:power off output: Chassis Power Control: Down/Off
2026-02-18T04:37:55.183 INFO:teuthology.orchestra.console.trial077:Power off
2026-02-18T04:37:55.184 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-18T04:37:55.223 DEBUG:teuthology.orchestra.console.trial077:power off output: Chassis Power Control: Down/Off
2026-02-18T04:37:58.908 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:37:58.961 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:37:59.019 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is on
2026-02-18T04:37:59.071 DEBUG:teuthology.orchestra.console.trial172:check power output: Chassis Power is on
2026-02-18T04:37:59.224 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:37:59.334 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is on
2026-02-18T04:38:03.020 DEBUG:teuthology.orchestra.console.trial154:pexpect command: ipmitool -H trial154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:38:03.072 DEBUG:teuthology.orchestra.console.trial172:pexpect command: ipmitool -H trial172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:38:03.130 DEBUG:teuthology.orchestra.console.trial154:check power output: Chassis Power is off
2026-02-18T04:38:03.131 INFO:teuthology.orchestra.console.trial154:Power off completed
2026-02-18T04:38:03.181 DEBUG:teuthology.orchestra.console.trial172:check power output: Chassis Power is off
2026-02-18T04:38:03.181 INFO:teuthology.orchestra.console.trial172:Power off completed
2026-02-18T04:38:03.374 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T04:38:03.382 INFO:teuthology.lock.ops:unlocked: trial154.front.sepia.ceph.com
2026-02-18T04:38:03.396 INFO:teuthology.lock.ops:unlocked: trial172.front.sepia.ceph.com
2026-02-18T04:38:03.483 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is off
2026-02-18T04:38:03.483 INFO:teuthology.orchestra.console.trial077:Power off completed
2026-02-18T04:38:03.685 INFO:teuthology.lock.ops:unlocked: trial077.front.sepia.ceph.com