2026-02-17T05:13:43.758 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T05:13:43.758 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:13:43.872 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:13:44.183 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x78c2bf37a8d0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x78c2beb61c60>, signals=[15])
2026-02-17T05:13:44.184 INFO:teuthology.lock.ops:Start node 'trial057.front.sepia.ceph.com' reimaging
2026-02-17T05:13:44.184 INFO:teuthology.lock.ops:Updating [trial057.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T05:13:44.184 INFO:teuthology.lock.ops:Updating trial057.front.sepia.ceph.com on lock server
2026-02-17T05:13:44.243 INFO:teuthology.lock.ops:Start node 'trial111.front.sepia.ceph.com' reimaging
2026-02-17T05:13:44.243 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T05:13:44.243 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server
2026-02-17T05:13:44.301 INFO:teuthology.lock.ops:Start node 'trial195.front.sepia.ceph.com' reimaging
2026-02-17T05:13:44.301 INFO:teuthology.lock.ops:Updating [trial195.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T05:13:44.301 INFO:teuthology.lock.ops:Updating trial195.front.sepia.ceph.com on lock server
2026-02-17T05:13:44.554 DEBUG:teuthology.provision.fog.trial057:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T05:13:44.555 DEBUG:teuthology.provision.fog.trial111:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T05:13:44.586 INFO:teuthology.provision.fog.trial111:Scheduling deploy of centos 9.stream
2026-02-17T05:13:44.590 DEBUG:teuthology.provision.fog.trial195:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T05:13:44.616 INFO:teuthology.provision.fog.trial057:Scheduling deploy of centos 9.stream
2026-02-17T05:13:44.642 INFO:teuthology.provision.fog.trial195:Scheduling deploy of centos 9.stream
2026-02-17T05:13:45.829 INFO:teuthology.orchestra.console.trial057:Power off
2026-02-17T05:13:45.829 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:13:45.888 INFO:teuthology.orchestra.console.trial111:Power off
2026-02-17T05:13:45.888 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:13:45.893 DEBUG:teuthology.orchestra.console.trial057:power off output: Chassis Power Control: Down/Off
2026-02-17T05:13:45.908 INFO:teuthology.orchestra.console.trial195:Power off
2026-02-17T05:13:45.908 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:13:45.926 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off
2026-02-17T05:13:45.945 DEBUG:teuthology.orchestra.console.trial195:power off output: Chassis Power Control: Down/Off
2026-02-17T05:13:49.898 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:13:49.927 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:13:49.945 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:13:50.008 DEBUG:teuthology.orchestra.console.trial057:check power output: Chassis Power is off
2026-02-17T05:13:50.008 INFO:teuthology.orchestra.console.trial057:Power off completed
2026-02-17T05:13:50.036 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off
2026-02-17T05:13:50.036 INFO:teuthology.orchestra.console.trial111:Power off completed
2026-02-17T05:13:50.055 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is off
2026-02-17T05:13:50.055 INFO:teuthology.orchestra.console.trial195:Power off completed
2026-02-17T05:13:50.109 INFO:teuthology.orchestra.console.trial057:Power on
2026-02-17T05:13:50.109 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T05:13:50.137 INFO:teuthology.orchestra.console.trial111:Power on
2026-02-17T05:13:50.137 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T05:13:50.149 DEBUG:teuthology.orchestra.console.trial057:power on output: Chassis Power Control: Up/On
2026-02-17T05:13:50.155 INFO:teuthology.orchestra.console.trial195:Power on
2026-02-17T05:13:50.155 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T05:13:50.175 DEBUG:teuthology.orchestra.console.trial111:power on output: Chassis Power Control: Up/On
2026-02-17T05:13:50.193 DEBUG:teuthology.orchestra.console.trial195:power on output: Chassis Power Control: Up/On
2026-02-17T05:13:54.154 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:13:54.176 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:13:54.194 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:13:54.264 DEBUG:teuthology.orchestra.console.trial057:check power output: Chassis Power is on
2026-02-17T05:13:54.264 INFO:teuthology.orchestra.console.trial057:Power on completed
2026-02-17T05:13:54.285 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on
2026-02-17T05:13:54.285 INFO:teuthology.orchestra.console.trial111:Power on completed
2026-02-17T05:13:54.301 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is on
2026-02-17T05:13:54.301 INFO:teuthology.orchestra.console.trial195:Power on completed
2026-02-17T05:13:54.366 INFO:teuthology.provision.fog.trial057:Waiting for deploy to finish
2026-02-17T05:13:54.386 INFO:teuthology.provision.fog.trial111:Waiting for deploy to finish
2026-02-17T05:13:54.402 INFO:teuthology.provision.fog.trial195:Waiting for deploy to finish
2026-02-17T05:15:42.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:15:42.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:15:42.293 ERROR:teuthology.orchestra.connection:Error authenticating with trial195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T05:15:42.368 ERROR:teuthology.orchestra.connection:Error authenticating with trial057.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T05:15:57.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:16:00.512 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-17T05:16:06.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:16:09.600 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-17T05:16:15.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:16:18.688 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-17T05:16:24.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:16:27.776 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111
2026-02-17T05:16:33.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:16:46.296 WARNING:teuthology.provision.fog.trial195:timed out
2026-02-17T05:16:46.371 WARNING:teuthology.provision.fog.trial057:timed out
2026-02-17T05:16:52.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:16:52.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:16:55.556 ERROR:teuthology.orchestra.connection:Error authenticating with trial057.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T05:16:56.486 ERROR:teuthology.orchestra.connection:Error authenticating with trial195.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T05:16:59.685 ERROR:teuthology.orchestra.connection:Error authenticating with trial057.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T05:17:00.602 ERROR:teuthology.orchestra.connection:Error authenticating with trial195.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T05:17:06.777 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T05:17:06.778 DEBUG:teuthology.orchestra.run.trial057:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T05:17:06.984 INFO:teuthology.provision.fog.trial057:Node is ready
2026-02-17T05:17:06.984 DEBUG:teuthology.orchestra.run.trial057:> hostname
2026-02-17T05:17:07.037 INFO:teuthology.orchestra.run.trial057.stdout:trial057.front.sepia.ceph.com
2026-02-17T05:17:07.038 DEBUG:teuthology.orchestra.run.trial057:> grep trial057.front.sepia.ceph.com /etc/hosts
2026-02-17T05:17:07.091 INFO:teuthology.orchestra.run.trial057.stdout:10.20.193.57 trial057.front.sepia.ceph.com trial057
2026-02-17T05:17:07.091 DEBUG:teuthology.orchestra.run.trial057:> sudo hostname trial057
2026-02-17T05:17:07.159 DEBUG:teuthology.orchestra.run.trial057:> sudo sed -i -e 's/trial057.front.sepia.ceph.com/trial057/g' /etc/hosts
2026-02-17T05:17:07.223 DEBUG:teuthology.orchestra.run.trial057:> sudo sed -i -e 's/10.20.193.57/10.20.193.57/g' /etc/hosts
2026-02-17T05:17:07.286 DEBUG:teuthology.orchestra.run.trial057:> sudo sed -i -e 's/trial057.front.sepia.ceph.com/trial057/g' /etc/hostname
2026-02-17T05:17:07.347 DEBUG:teuthology.orchestra.run.trial057:> sudo hostname trial057
2026-02-17T05:17:07.409 DEBUG:teuthology.orchestra.run.trial057:> cat /etc/os-release
2026-02-17T05:17:07.466 INFO:teuthology.orchestra.run.trial057.stdout:NAME="CentOS Stream"
2026-02-17T05:17:07.466 INFO:teuthology.orchestra.run.trial057.stdout:VERSION="9"
2026-02-17T05:17:07.466 INFO:teuthology.orchestra.run.trial057.stdout:ID="centos"
2026-02-17T05:17:07.466 INFO:teuthology.orchestra.run.trial057.stdout:ID_LIKE="rhel fedora"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:VERSION_ID="9"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:PLATFORM_ID="platform:el9"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:ANSI_COLOR="0;31"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:LOGO="fedora-logo-icon"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:HOME_URL="https://centos.org/"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T05:17:07.467 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T05:17:07.469 INFO:teuthology.provision.fog.trial057:Deploy complete!
2026-02-17T05:17:07.470 DEBUG:teuthology.parallel:result is None
2026-02-17T05:17:07.716 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T05:17:07.716 DEBUG:teuthology.orchestra.run.trial195:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T05:17:07.883 INFO:teuthology.provision.fog.trial195:Node is ready
2026-02-17T05:17:07.884 DEBUG:teuthology.orchestra.run.trial195:> hostname
2026-02-17T05:17:07.936 INFO:teuthology.orchestra.run.trial195.stdout:trial195.front.sepia.ceph.com
2026-02-17T05:17:07.936 DEBUG:teuthology.orchestra.run.trial195:> grep trial195.front.sepia.ceph.com /etc/hosts
2026-02-17T05:17:07.992 INFO:teuthology.orchestra.run.trial195.stdout:10.20.193.195 trial195.front.sepia.ceph.com trial195
2026-02-17T05:17:07.992 DEBUG:teuthology.orchestra.run.trial195:> sudo hostname trial195
2026-02-17T05:17:08.060 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/trial195.front.sepia.ceph.com/trial195/g' /etc/hosts
2026-02-17T05:17:08.122 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/10.20.193.195/10.20.193.195/g' /etc/hosts
2026-02-17T05:17:08.185 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/trial195.front.sepia.ceph.com/trial195/g' /etc/hostname
2026-02-17T05:17:08.249 DEBUG:teuthology.orchestra.run.trial195:> sudo hostname trial195
2026-02-17T05:17:08.313 DEBUG:teuthology.orchestra.run.trial195:> cat /etc/os-release
2026-02-17T05:17:08.366 INFO:teuthology.orchestra.run.trial195.stdout:NAME="CentOS Stream"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:VERSION="9"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:ID="centos"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:ID_LIKE="rhel fedora"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_ID="9"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:PLATFORM_ID="platform:el9"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:ANSI_COLOR="0;31"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:LOGO="fedora-logo-icon"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T05:17:08.367 INFO:teuthology.orchestra.run.trial195.stdout:HOME_URL="https://centos.org/"
2026-02-17T05:17:08.368 INFO:teuthology.orchestra.run.trial195.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T05:17:08.368 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T05:17:08.368 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T05:17:08.368 INFO:teuthology.provision.fog.trial195:Deploy complete!
2026-02-17T05:17:08.369 DEBUG:teuthology.parallel:result is None
2026-02-17T05:17:10.020 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T05:17:10.020 DEBUG:teuthology.orchestra.run.trial111:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T05:17:10.178 INFO:teuthology.provision.fog.trial111:Node is ready
2026-02-17T05:17:10.179 DEBUG:teuthology.orchestra.run.trial111:> hostname
2026-02-17T05:17:10.234 INFO:teuthology.orchestra.run.trial111.stdout:trial111.front.sepia.ceph.com
2026-02-17T05:17:10.234 DEBUG:teuthology.orchestra.run.trial111:> grep trial111.front.sepia.ceph.com /etc/hosts
2026-02-17T05:17:10.291 INFO:teuthology.orchestra.run.trial111.stdout:10.20.193.111 trial111.front.sepia.ceph.com trial111
2026-02-17T05:17:10.292 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111
2026-02-17T05:17:10.361 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hosts
2026-02-17T05:17:10.425 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/10.20.193.111/10.20.193.111/g' /etc/hosts
2026-02-17T05:17:10.490 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hostname
2026-02-17T05:17:10.555 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111
2026-02-17T05:17:10.619 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release
2026-02-17T05:17:10.675 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream"
2026-02-17T05:17:10.675 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9"
2026-02-17T05:17:10.675 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos"
2026-02-17T05:17:10.675 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora"
2026-02-17T05:17:10.675 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9"
2026-02-17T05:17:10.675 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9"
2026-02-17T05:17:10.675 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T05:17:10.676 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31"
2026-02-17T05:17:10.676 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon"
2026-02-17T05:17:10.676 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T05:17:10.676 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/"
2026-02-17T05:17:10.676 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T05:17:10.676 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T05:17:10.676 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T05:17:10.677 INFO:teuthology.provision.fog.trial111:Deploy complete!
2026-02-17T05:17:10.677 DEBUG:teuthology.parallel:result is None
2026-02-17T05:17:11.208 INFO:teuthology.lock.ops:Checking trial057.front.sepia.ceph.com
2026-02-17T05:17:11.208 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T05:17:11.267 INFO:teuthology.lock.ops:Checking trial111.front.sepia.ceph.com
2026-02-17T05:17:11.267 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T05:17:11.362 INFO:teuthology.lock.ops:Checking trial195.front.sepia.ceph.com
2026-02-17T05:17:11.362 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T05:17:11.419 INFO:teuthology.lock.ops:Updating [trial057.front.sepia.ceph.com]: set os type and version on server
2026-02-17T05:17:11.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial057.front.sepia.ceph.com'
2026-02-17T05:17:11.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:17:11.481 DEBUG:teuthology.orchestra.run.trial057:> true
2026-02-17T05:17:11.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial057.front.sepia.ceph.com'
2026-02-17T05:17:11.556 DEBUG:teuthology.orchestra.run.trial057:> uname -m
2026-02-17T05:17:11.617 INFO:teuthology.orchestra.run.trial057.stdout:x86_64
2026-02-17T05:17:11.617 DEBUG:teuthology.orchestra.run.trial057:> cat /etc/os-release
2026-02-17T05:17:11.682 INFO:teuthology.orchestra.run.trial057.stdout:NAME="CentOS Stream"
2026-02-17T05:17:11.682 INFO:teuthology.orchestra.run.trial057.stdout:VERSION="9"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:ID="centos"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:ID_LIKE="rhel fedora"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:VERSION_ID="9"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:PLATFORM_ID="platform:el9"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:ANSI_COLOR="0;31"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:LOGO="fedora-logo-icon"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:HOME_URL="https://centos.org/"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T05:17:11.683 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T05:17:11.683 INFO:teuthology.lock.ops:Updating trial057.front.sepia.ceph.com on lock server
2026-02-17T05:17:11.750 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: set os type and version on server
2026-02-17T05:17:11.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com'
2026-02-17T05:17:11.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:17:11.813 DEBUG:teuthology.orchestra.run.trial111:> true
2026-02-17T05:17:11.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com'
2026-02-17T05:17:11.898 DEBUG:teuthology.orchestra.run.trial111:> uname -m
2026-02-17T05:17:11.954 INFO:teuthology.orchestra.run.trial111.stdout:x86_64
2026-02-17T05:17:11.954 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream"
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9"
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos"
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora"
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9"
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9"
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31"
2026-02-17T05:17:12.009 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon"
2026-02-17T05:17:12.010 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T05:17:12.010 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/"
2026-02-17T05:17:12.010 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T05:17:12.010 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T05:17:12.010 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T05:17:12.010 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server
2026-02-17T05:17:12.078 INFO:teuthology.lock.ops:Updating [trial195.front.sepia.ceph.com]: set os type and version on server
2026-02-17T05:17:12.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com'
2026-02-17T05:17:12.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T05:17:12.142 DEBUG:teuthology.orchestra.run.trial195:> true
2026-02-17T05:17:12.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial195.front.sepia.ceph.com'
2026-02-17T05:17:12.217 DEBUG:teuthology.orchestra.run.trial195:> uname -m
2026-02-17T05:17:12.273 INFO:teuthology.orchestra.run.trial195.stdout:x86_64
2026-02-17T05:17:12.273 DEBUG:teuthology.orchestra.run.trial195:> cat /etc/os-release
2026-02-17T05:17:12.329 INFO:teuthology.orchestra.run.trial195.stdout:NAME="CentOS Stream"
2026-02-17T05:17:12.329 INFO:teuthology.orchestra.run.trial195.stdout:VERSION="9"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:ID="centos"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:ID_LIKE="rhel fedora"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_ID="9"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:PLATFORM_ID="platform:el9"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:ANSI_COLOR="0;31"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:LOGO="fedora-logo-icon"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:HOME_URL="https://centos.org/"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T05:17:12.330 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T05:17:12.331 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T05:17:12.331 INFO:teuthology.lock.ops:Updating trial195.front.sepia.ceph.com on lock server
2026-02-17T05:17:12.435 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:17:12.535 INFO:teuthology.dispatcher.supervisor:Running job 50987
2026-02-17T05:17:12.535 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50987 --name skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds} ec_optimizations/ec_optimizations_off mon_election/connectivity msgr-failures/fastclose objectstore/{bluestore/{alloc$/{hybrid} base mem$/{low} onode-segment$/{256K} write$/{v1/{compr$/{no$/{no}} v1}}}} rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50987/orig.config.yaml
2026-02-17T05:17:12.535 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50987
2026-02-17T05:17:12.536 INFO:teuthology.dispatcher.supervisor:Job PID: 2103018
2026-02-17T05:17:12.536 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T05:19:12.536 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:21:12.658 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:23:12.778 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:25:12.900 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:27:13.028 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:29:13.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:31:13.266 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:31:13.345 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T05:31:13.520 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T05:31:14.253 INFO:teuthology.orchestra.console.trial111:Power off
2026-02-17T05:31:14.253 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:31:14.261 INFO:teuthology.orchestra.console.trial195:Power off
2026-02-17T05:31:14.261 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:31:14.278 INFO:teuthology.orchestra.console.trial057:Power off
2026-02-17T05:31:14.279 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:31:14.291 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off
2026-02-17T05:31:14.298 DEBUG:teuthology.orchestra.console.trial195:power off output: Chassis Power Control: Down/Off
2026-02-17T05:31:14.315 DEBUG:teuthology.orchestra.console.trial057:power off output: Chassis Power Control: Down/Off
2026-02-17T05:31:18.291 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:31:18.299 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:31:18.315 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:31:18.401 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on
2026-02-17T05:31:18.408 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is on
2026-02-17T05:31:18.426 DEBUG:teuthology.orchestra.console.trial057:check power output: Chassis Power is on
2026-02-17T05:31:22.402 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:31:22.410 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:31:22.426 DEBUG:teuthology.orchestra.console.trial057:pexpect command: ipmitool -H trial057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:31:22.513 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off
2026-02-17T05:31:22.513 INFO:teuthology.orchestra.console.trial111:Power off completed
2026-02-17T05:31:22.519 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is off
2026-02-17T05:31:22.519 INFO:teuthology.orchestra.console.trial195:Power off completed
2026-02-17T05:31:22.536 DEBUG:teuthology.orchestra.console.trial057:check power output: Chassis Power is off
2026-02-17T05:31:22.536 INFO:teuthology.orchestra.console.trial057:Power off completed
2026-02-17T05:31:22.801 INFO:teuthology.lock.ops:unlocked: trial111.front.sepia.ceph.com
2026-02-17T05:31:22.814 INFO:teuthology.lock.ops:unlocked: trial195.front.sepia.ceph.com
2026-02-17T05:31:22.819 INFO:teuthology.lock.ops:unlocked: trial057.front.sepia.ceph.com