2026-02-24T09:28:32.523 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-24T09:28:32.523 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:28:32.602 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:28:32.805 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x785f025014f0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x785f024a0cc0>, signals=[15])
2026-02-24T09:28:32.805 INFO:teuthology.lock.ops:Start node 'trial104.front.sepia.ceph.com' reimaging
2026-02-24T09:28:32.805 INFO:teuthology.lock.ops:Updating [trial104.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T09:28:32.805 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server
2026-02-24T09:28:32.864 INFO:teuthology.lock.ops:Start node 'trial155.front.sepia.ceph.com' reimaging
2026-02-24T09:28:32.864 INFO:teuthology.lock.ops:Updating [trial155.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T09:28:32.864 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server
2026-02-24T09:28:33.111 DEBUG:teuthology.provision.fog.trial155:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T09:28:33.115 DEBUG:teuthology.provision.fog.trial104:Requesting image trial_centos_9.stream (ID 3)
2026-02-24T09:28:33.158 INFO:teuthology.provision.fog.trial104:Scheduling deploy of centos 9.stream
2026-02-24T09:28:33.162 INFO:teuthology.provision.fog.trial155:Scheduling deploy of centos 9.stream
2026-02-24T09:28:35.539 INFO:teuthology.orchestra.console.trial104:Power off
2026-02-24T09:28:35.539 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T09:28:35.558 INFO:teuthology.orchestra.console.trial155:Power off
2026-02-24T09:28:35.558 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T09:28:35.579 DEBUG:teuthology.orchestra.console.trial104:power off output: Chassis Power Control: Down/Off
2026-02-24T09:28:35.596 DEBUG:teuthology.orchestra.console.trial155:power off output: Chassis Power Control: Down/Off
2026-02-24T09:28:39.583 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T09:28:39.597 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T09:28:39.693 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is off
2026-02-24T09:28:39.694 INFO:teuthology.orchestra.console.trial104:Power off completed
2026-02-24T09:28:39.706 DEBUG:teuthology.orchestra.console.trial155:check power output: Chassis Power is off
2026-02-24T09:28:39.707 INFO:teuthology.orchestra.console.trial155:Power off completed
2026-02-24T09:28:39.794 INFO:teuthology.orchestra.console.trial104:Power on
2026-02-24T09:28:39.794 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T09:28:39.807 INFO:teuthology.orchestra.console.trial155:Power on
2026-02-24T09:28:39.808 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T09:28:39.839 DEBUG:teuthology.orchestra.console.trial104:power on output: Chassis Power Control: Up/On
2026-02-24T09:28:39.848 DEBUG:teuthology.orchestra.console.trial155:power on output: Chassis Power Control: Up/On
2026-02-24T09:28:43.844 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T09:28:43.853 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T09:28:43.956 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is on
2026-02-24T09:28:43.957 INFO:teuthology.orchestra.console.trial104:Power on completed
2026-02-24T09:28:43.963 DEBUG:teuthology.orchestra.console.trial155:check power output: Chassis Power is on
2026-02-24T09:28:43.963 INFO:teuthology.orchestra.console.trial155:Power on completed
2026-02-24T09:28:44.058 INFO:teuthology.provision.fog.trial104:Waiting for deploy to finish
2026-02-24T09:28:44.063 INFO:teuthology.provision.fog.trial155:Waiting for deploy to finish
2026-02-24T09:30:33.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T09:30:33.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T09:30:33.246 ERROR:teuthology.orchestra.connection:Error authenticating with trial104.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-24T09:31:33.093 WARNING:teuthology.provision.fog.trial155:timed out
2026-02-24T09:31:37.249 WARNING:teuthology.provision.fog.trial104:timed out
2026-02-24T09:31:39.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T09:31:43.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T09:31:45.421 ERROR:teuthology.orchestra.connection:Error authenticating with trial104.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-24T09:31:46.445 ERROR:teuthology.orchestra.connection:Error authenticating with trial155.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-24T09:31:49.545 ERROR:teuthology.orchestra.connection:Error authenticating with trial104.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-24T09:31:50.554 ERROR:teuthology.orchestra.connection:Error authenticating with trial155.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-24T09:31:56.649 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T09:31:56.649 DEBUG:teuthology.orchestra.run.trial104:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T09:31:56.938 INFO:teuthology.provision.fog.trial104:Node is ready
2026-02-24T09:31:56.939 DEBUG:teuthology.orchestra.run.trial104:> hostname
2026-02-24T09:31:56.994 INFO:teuthology.orchestra.run.trial104.stdout:trial104.front.sepia.ceph.com
2026-02-24T09:31:56.995 DEBUG:teuthology.orchestra.run.trial104:> grep trial104.front.sepia.ceph.com /etc/hosts
2026-02-24T09:31:57.051 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104 trial104.front.sepia.ceph.com trial104
2026-02-24T09:31:57.052 DEBUG:teuthology.orchestra.run.trial104:> sudo hostname trial104
2026-02-24T09:31:57.123 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/trial104.front.sepia.ceph.com/trial104/g' /etc/hosts
2026-02-24T09:31:57.190 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/10.20.193.104/10.20.193.104/g' /etc/hosts
2026-02-24T09:31:57.257 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/trial104.front.sepia.ceph.com/trial104/g' /etc/hostname
2026-02-24T09:31:57.322 DEBUG:teuthology.orchestra.run.trial104:> sudo hostname trial104
2026-02-24T09:31:57.387 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release
2026-02-24T09:31:57.444 INFO:teuthology.orchestra.run.trial104.stdout:NAME="CentOS Stream"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="9"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:ID="centos"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE="rhel fedora"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="9"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:PLATFORM_ID="platform:el9"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:ANSI_COLOR="0;31"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:LOGO="fedora-logo-icon"
2026-02-24T09:31:57.445 INFO:teuthology.orchestra.run.trial104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T09:31:57.446 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://centos.org/"
2026-02-24T09:31:57.446 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T09:31:57.446 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T09:31:57.446 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T09:31:57.447 INFO:teuthology.provision.fog.trial104:Deploy complete!
2026-02-24T09:31:57.449 DEBUG:teuthology.parallel:result is None
2026-02-24T09:31:57.663 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T09:31:57.663 DEBUG:teuthology.orchestra.run.trial155:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T09:31:57.864 INFO:teuthology.provision.fog.trial155:Node is ready
2026-02-24T09:31:57.864 DEBUG:teuthology.orchestra.run.trial155:> hostname
2026-02-24T09:31:57.920 INFO:teuthology.orchestra.run.trial155.stdout:trial155.front.sepia.ceph.com
2026-02-24T09:31:57.921 DEBUG:teuthology.orchestra.run.trial155:> grep trial155.front.sepia.ceph.com /etc/hosts
2026-02-24T09:31:57.977 INFO:teuthology.orchestra.run.trial155.stdout:10.20.193.155 trial155.front.sepia.ceph.com trial155
2026-02-24T09:31:57.977 DEBUG:teuthology.orchestra.run.trial155:> sudo hostname trial155
2026-02-24T09:31:58.047 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i -e 's/trial155.front.sepia.ceph.com/trial155/g' /etc/hosts
2026-02-24T09:31:58.112 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i -e 's/10.20.193.155/10.20.193.155/g' /etc/hosts
2026-02-24T09:31:58.177 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i -e 's/trial155.front.sepia.ceph.com/trial155/g' /etc/hostname
2026-02-24T09:31:58.241 DEBUG:teuthology.orchestra.run.trial155:> sudo hostname trial155
2026-02-24T09:31:58.305 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release
2026-02-24T09:31:58.361 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream"
2026-02-24T09:31:58.362 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9"
2026-02-24T09:31:58.362 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos"
2026-02-24T09:31:58.362 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora"
2026-02-24T09:31:58.362 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9"
2026-02-24T09:31:58.362 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9"
2026-02-24T09:31:58.362 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T09:31:58.362 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31"
2026-02-24T09:31:58.363 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon"
2026-02-24T09:31:58.363 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T09:31:58.363 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/"
2026-02-24T09:31:58.363 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T09:31:58.363 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T09:31:58.363 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T09:31:58.364 INFO:teuthology.provision.fog.trial155:Deploy complete!
2026-02-24T09:31:58.365 DEBUG:teuthology.parallel:result is None
2026-02-24T09:31:58.765 INFO:teuthology.lock.ops:Checking trial104.front.sepia.ceph.com
2026-02-24T09:31:58.765 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T09:31:58.860 INFO:teuthology.lock.ops:Checking trial155.front.sepia.ceph.com
2026-02-24T09:31:58.860 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T09:31:58.929 INFO:teuthology.lock.ops:Updating [trial104.front.sepia.ceph.com]: set os type and version on server
2026-02-24T09:31:58.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com'
2026-02-24T09:31:58.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T09:31:58.990 DEBUG:teuthology.orchestra.run.trial104:> true
2026-02-24T09:31:59.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com'
2026-02-24T09:31:59.064 DEBUG:teuthology.orchestra.run.trial104:> uname -m
2026-02-24T09:31:59.120 INFO:teuthology.orchestra.run.trial104.stdout:x86_64
2026-02-24T09:31:59.120 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release
2026-02-24T09:31:59.175 INFO:teuthology.orchestra.run.trial104.stdout:NAME="CentOS Stream"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="9"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:ID="centos"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE="rhel fedora"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="9"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:PLATFORM_ID="platform:el9"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:ANSI_COLOR="0;31"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:LOGO="fedora-logo-icon"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://centos.org/"
2026-02-24T09:31:59.176 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T09:31:59.177 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T09:31:59.177 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T09:31:59.177 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server
2026-02-24T09:31:59.277 INFO:teuthology.lock.ops:Updating [trial155.front.sepia.ceph.com]: set os type and version on server
2026-02-24T09:31:59.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com'
2026-02-24T09:31:59.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T09:31:59.341 DEBUG:teuthology.orchestra.run.trial155:> true
2026-02-24T09:31:59.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com'
2026-02-24T09:31:59.415 DEBUG:teuthology.orchestra.run.trial155:> uname -m
2026-02-24T09:31:59.471 INFO:teuthology.orchestra.run.trial155.stdout:x86_64
2026-02-24T09:31:59.471 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release
2026-02-24T09:31:59.527 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon"
2026-02-24T09:31:59.528 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-24T09:31:59.529 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/"
2026-02-24T09:31:59.529 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-24T09:31:59.529 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-24T09:31:59.529 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-24T09:31:59.530 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server
2026-02-24T09:31:59.631 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:31:59.718 INFO:teuthology.dispatcher.supervisor:Running job 67135
2026-02-24T09:31:59.718 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67135 --name vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/failover} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67135/orig.config.yaml
2026-02-24T09:31:59.719 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67135
2026-02-24T09:31:59.719 INFO:teuthology.dispatcher.supervisor:Job PID: 3583285
2026-02-24T09:31:59.719 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-24T09:33:59.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:35:59.990 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:38:00.079 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:40:00.157 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:42:00.280 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:44:00.402 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:46:00.521 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:48:00.600 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:50:00.725 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:52:00.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:54:00.956 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:56:01.045 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T09:58:01.161 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:00:01.281 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:02:01.402 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:04:01.526 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:06:01.598 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:08:01.716 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:10:01.837 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:12:01.958 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:14:02.073 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:16:02.197 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:18:02.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:20:02.459 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:22:02.581 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:24:02.711 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:26:02.827 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:28:02.929 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:30:03.048 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:32:03.169 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:34:03.293 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:36:03.416 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:38:03.544 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:40:03.675 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:42:03.795 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:44:03.918 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:46:03.987 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:48:04.082 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:50:04.204 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:52:04.324 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:54:04.397 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:56:04.486 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:58:04.609 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:00:04.750 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:02:04.871 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:04:04.994 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:04:05.118 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-24T11:04:05.243 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-24T11:04:05.745 INFO:teuthology.orchestra.console.trial155:Power off
2026-02-24T11:04:05.745 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T11:04:05.763 INFO:teuthology.orchestra.console.trial104:Power off
2026-02-24T11:04:05.763 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T11:04:05.783 DEBUG:teuthology.orchestra.console.trial155:power off output: Chassis Power Control: Down/Off
2026-02-24T11:04:05.800 DEBUG:teuthology.orchestra.console.trial104:power off output: Chassis Power Control: Down/Off
2026-02-24T11:04:09.784 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T11:04:09.801 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T11:04:09.893 DEBUG:teuthology.orchestra.console.trial155:check power output: Chassis Power is on
2026-02-24T11:04:09.909 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is on
2026-02-24T11:04:13.894 DEBUG:teuthology.orchestra.console.trial155:pexpect command: ipmitool -H trial155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T11:04:13.911 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T11:04:14.003 DEBUG:teuthology.orchestra.console.trial155:check power output: Chassis Power is off
2026-02-24T11:04:14.003 INFO:teuthology.orchestra.console.trial155:Power off completed
2026-02-24T11:04:14.019 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is off
2026-02-24T11:04:14.019 INFO:teuthology.orchestra.console.trial104:Power off completed
2026-02-24T11:04:14.249 INFO:teuthology.lock.ops:unlocked: trial155.front.sepia.ceph.com
2026-02-24T11:04:14.262 INFO:teuthology.lock.ops:unlocked: trial104.front.sepia.ceph.com