2026-02-17T04:41:47.177 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T04:41:47.177 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:41:47.250 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:41:47.517 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x71d35fd7b470>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x71d35f572d40>, signals=[15])
2026-02-17T04:41:47.518 INFO:teuthology.lock.ops:Start node 'trial112.front.sepia.ceph.com' reimaging
2026-02-17T04:41:47.518 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T04:41:47.518 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server
2026-02-17T04:41:47.576 INFO:teuthology.lock.ops:Start node 'trial115.front.sepia.ceph.com' reimaging
2026-02-17T04:41:47.576 INFO:teuthology.lock.ops:Updating [trial115.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T04:41:47.576 INFO:teuthology.lock.ops:Updating trial115.front.sepia.ceph.com on lock server
2026-02-17T04:41:47.634 INFO:teuthology.lock.ops:Start node 'trial142.front.sepia.ceph.com' reimaging
2026-02-17T04:41:47.634 INFO:teuthology.lock.ops:Updating [trial142.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T04:41:47.634 INFO:teuthology.lock.ops:Updating trial142.front.sepia.ceph.com on lock server
2026-02-17T04:41:47.821 DEBUG:teuthology.provision.fog.trial112:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T04:41:47.871 DEBUG:teuthology.provision.fog.trial115:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T04:41:47.873 INFO:teuthology.provision.fog.trial112:Scheduling deploy of centos 9.stream
2026-02-17T04:41:47.925 INFO:teuthology.provision.fog.trial115:Scheduling deploy of centos 9.stream
2026-02-17T04:41:47.929 DEBUG:teuthology.provision.fog.trial142:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T04:41:47.981 INFO:teuthology.provision.fog.trial142:Scheduling deploy of centos 9.stream
2026-02-17T04:41:49.125 INFO:teuthology.orchestra.console.trial112:Power off
2026-02-17T04:41:49.125 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T04:41:49.137 INFO:teuthology.orchestra.console.trial142:Power off
2026-02-17T04:41:49.137 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T04:41:49.147 INFO:teuthology.orchestra.console.trial115:Power off
2026-02-17T04:41:49.147 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T04:41:49.163 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off
2026-02-17T04:41:49.178 DEBUG:teuthology.orchestra.console.trial142:power off output: Chassis Power Control: Down/Off
2026-02-17T04:41:49.184 DEBUG:teuthology.orchestra.console.trial115:power off output: Chassis Power Control: Down/Off
2026-02-17T04:41:53.167 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T04:41:53.178 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T04:41:53.185 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T04:41:53.277 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off
2026-02-17T04:41:53.278 INFO:teuthology.orchestra.console.trial112:Power off completed
2026-02-17T04:41:53.286 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is off
2026-02-17T04:41:53.286 INFO:teuthology.orchestra.console.trial142:Power off completed
2026-02-17T04:41:53.291 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is off
2026-02-17T04:41:53.292 INFO:teuthology.orchestra.console.trial115:Power off completed
2026-02-17T04:41:53.378 INFO:teuthology.orchestra.console.trial112:Power on
2026-02-17T04:41:53.379 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T04:41:53.386 INFO:teuthology.orchestra.console.trial142:Power on
2026-02-17T04:41:53.387 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T04:41:53.392 INFO:teuthology.orchestra.console.trial115:Power on
2026-02-17T04:41:53.392 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T04:41:53.420 DEBUG:teuthology.orchestra.console.trial112:power on output: Chassis Power Control: Up/On
2026-02-17T04:41:53.424 DEBUG:teuthology.orchestra.console.trial142:power on output: Chassis Power Control: Up/On
2026-02-17T04:41:53.430 DEBUG:teuthology.orchestra.console.trial115:power on output: Chassis Power Control: Up/On
2026-02-17T04:41:57.425 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T04:41:57.432 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T04:41:57.438 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T04:41:57.534 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on
2026-02-17T04:41:57.534 INFO:teuthology.orchestra.console.trial112:Power on completed
2026-02-17T04:41:57.539 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is on
2026-02-17T04:41:57.539 INFO:teuthology.orchestra.console.trial142:Power on completed
2026-02-17T04:41:57.545 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is off
2026-02-17T04:41:57.635 INFO:teuthology.provision.fog.trial112:Waiting for deploy to finish
2026-02-17T04:41:57.640 INFO:teuthology.provision.fog.trial142:Waiting for deploy to finish
2026-02-17T04:42:01.548 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T04:42:01.656 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is on
2026-02-17T04:42:01.656 INFO:teuthology.orchestra.console.trial115:Power on completed
2026-02-17T04:42:01.757 INFO:teuthology.provision.fog.trial115:Waiting for deploy to finish
2026-02-17T04:43:45.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:43:45.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:43:49.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:43:52.128 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-17T04:43:58.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:44:01.215 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-17T04:44:07.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:44:10.303 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-17T04:44:16.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:44:19.392 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-17T04:44:25.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:44:28.480 WARNING:teuthology.provision.fog.trial115:[Errno None] Unable to connect to port 22 on 10.20.193.115
2026-02-17T04:44:34.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:44:45.080 WARNING:teuthology.provision.fog.trial112:timed out
2026-02-17T04:44:45.080 WARNING:teuthology.provision.fog.trial142:timed out
2026-02-17T04:44:51.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:44:51.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:44:59.389 ERROR:teuthology.orchestra.connection:Error authenticating with trial142.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T04:45:02.382 ERROR:teuthology.orchestra.connection:Error authenticating with trial112.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T04:45:03.490 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T04:45:03.490 DEBUG:teuthology.orchestra.run.trial142:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T04:45:06.550 ERROR:teuthology.orchestra.connection:Error authenticating with trial112.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T04:45:08.796 INFO:teuthology.provision.fog.trial142:Node is ready
2026-02-17T04:45:08.796 DEBUG:teuthology.orchestra.run.trial142:> hostname
2026-02-17T04:45:08.813 INFO:teuthology.orchestra.run.trial142.stdout:trial142.front.sepia.ceph.com
2026-02-17T04:45:08.813 DEBUG:teuthology.orchestra.run.trial142:> grep trial142.front.sepia.ceph.com /etc/hosts
2026-02-17T04:45:08.870 INFO:teuthology.orchestra.run.trial142.stdout:10.20.193.142 trial142.front.sepia.ceph.com trial142
2026-02-17T04:45:08.870 DEBUG:teuthology.orchestra.run.trial142:> sudo hostname trial142
2026-02-17T04:45:08.940 DEBUG:teuthology.orchestra.run.trial142:> sudo sed -i -e 's/trial142.front.sepia.ceph.com/trial142/g' /etc/hosts
2026-02-17T04:45:09.006 DEBUG:teuthology.orchestra.run.trial142:> sudo sed -i -e 's/10.20.193.142/10.20.193.142/g' /etc/hosts
2026-02-17T04:45:09.071 DEBUG:teuthology.orchestra.run.trial142:> sudo sed -i -e 's/trial142.front.sepia.ceph.com/trial142/g' /etc/hostname
2026-02-17T04:45:09.138 DEBUG:teuthology.orchestra.run.trial142:> sudo hostname trial142
2026-02-17T04:45:09.202 DEBUG:teuthology.orchestra.run.trial142:> cat /etc/os-release
2026-02-17T04:45:09.258 INFO:teuthology.orchestra.run.trial142.stdout:NAME="CentOS Stream"
2026-02-17T04:45:09.258 INFO:teuthology.orchestra.run.trial142.stdout:VERSION="9"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:ID="centos"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:ID_LIKE="rhel fedora"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:VERSION_ID="9"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:PLATFORM_ID="platform:el9"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:ANSI_COLOR="0;31"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:LOGO="fedora-logo-icon"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:HOME_URL="https://centos.org/"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T04:45:09.259 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T04:45:09.260 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T04:45:09.261 INFO:teuthology.provision.fog.trial142:Deploy complete!
2026-02-17T04:45:09.262 DEBUG:teuthology.parallel:result is None
2026-02-17T04:45:10.535 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T04:45:10.535 DEBUG:teuthology.orchestra.run.trial115:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T04:45:10.685 INFO:teuthology.provision.fog.trial115:Node is ready
2026-02-17T04:45:10.685 DEBUG:teuthology.orchestra.run.trial115:> hostname
2026-02-17T04:45:10.740 INFO:teuthology.orchestra.run.trial115.stdout:trial115.front.sepia.ceph.com
2026-02-17T04:45:10.741 DEBUG:teuthology.orchestra.run.trial115:> grep trial115.front.sepia.ceph.com /etc/hosts
2026-02-17T04:45:10.798 INFO:teuthology.orchestra.run.trial115.stdout:10.20.193.115 trial115.front.sepia.ceph.com trial115
2026-02-17T04:45:10.798 DEBUG:teuthology.orchestra.run.trial115:> sudo hostname trial115
2026-02-17T04:45:10.865 DEBUG:teuthology.orchestra.run.trial115:> sudo sed -i -e 's/trial115.front.sepia.ceph.com/trial115/g' /etc/hosts
2026-02-17T04:45:10.930 DEBUG:teuthology.orchestra.run.trial115:> sudo sed -i -e 's/10.20.193.115/10.20.193.115/g' /etc/hosts
2026-02-17T04:45:10.994 DEBUG:teuthology.orchestra.run.trial115:> sudo sed -i -e 's/trial115.front.sepia.ceph.com/trial115/g' /etc/hostname
2026-02-17T04:45:11.059 DEBUG:teuthology.orchestra.run.trial115:> sudo hostname trial115
2026-02-17T04:45:11.122 DEBUG:teuthology.orchestra.run.trial115:> cat /etc/os-release
2026-02-17T04:45:11.177 INFO:teuthology.orchestra.run.trial115.stdout:NAME="CentOS Stream"
2026-02-17T04:45:11.177 INFO:teuthology.orchestra.run.trial115.stdout:VERSION="9"
2026-02-17T04:45:11.177 INFO:teuthology.orchestra.run.trial115.stdout:ID="centos"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:ID_LIKE="rhel fedora"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:VERSION_ID="9"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:PLATFORM_ID="platform:el9"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:ANSI_COLOR="0;31"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:LOGO="fedora-logo-icon"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:HOME_URL="https://centos.org/"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T04:45:11.178 INFO:teuthology.orchestra.run.trial115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T04:45:11.178 INFO:teuthology.provision.fog.trial115:Deploy complete!
2026-02-17T04:45:11.179 DEBUG:teuthology.parallel:result is None
2026-02-17T04:45:13.666 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T04:45:13.666 DEBUG:teuthology.orchestra.run.trial112:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T04:45:13.819 INFO:teuthology.provision.fog.trial112:Node is ready
2026-02-17T04:45:13.819 DEBUG:teuthology.orchestra.run.trial112:> hostname
2026-02-17T04:45:13.875 INFO:teuthology.orchestra.run.trial112.stdout:trial112.front.sepia.ceph.com
2026-02-17T04:45:13.876 DEBUG:teuthology.orchestra.run.trial112:> grep trial112.front.sepia.ceph.com /etc/hosts
2026-02-17T04:45:13.931 INFO:teuthology.orchestra.run.trial112.stdout:10.20.193.112 trial112.front.sepia.ceph.com trial112
2026-02-17T04:45:13.932 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112
2026-02-17T04:45:14.002 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hosts
2026-02-17T04:45:14.067 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/10.20.193.112/10.20.193.112/g' /etc/hosts
2026-02-17T04:45:14.131 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hostname
2026-02-17T04:45:14.195 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112
2026-02-17T04:45:14.259 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release
2026-02-17T04:45:14.315 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream"
2026-02-17T04:45:14.315 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/"
2026-02-17T04:45:14.316 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T04:45:14.317 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T04:45:14.317 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T04:45:14.317 INFO:teuthology.provision.fog.trial112:Deploy complete!
2026-02-17T04:45:14.318 DEBUG:teuthology.parallel:result is None
2026-02-17T04:45:14.836 INFO:teuthology.lock.ops:Checking trial112.front.sepia.ceph.com
2026-02-17T04:45:14.836 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T04:45:14.946 INFO:teuthology.lock.ops:Checking trial115.front.sepia.ceph.com
2026-02-17T04:45:14.946 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T04:45:15.009 INFO:teuthology.lock.ops:Checking trial142.front.sepia.ceph.com
2026-02-17T04:45:15.009 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T04:45:15.067 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: set os type and version on server
2026-02-17T04:45:15.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com'
2026-02-17T04:45:15.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:45:15.130 DEBUG:teuthology.orchestra.run.trial112:> true
2026-02-17T04:45:15.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com'
2026-02-17T04:45:15.205 DEBUG:teuthology.orchestra.run.trial112:> uname -m
2026-02-17T04:45:15.260 INFO:teuthology.orchestra.run.trial112.stdout:x86_64
2026-02-17T04:45:15.260 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release
2026-02-17T04:45:15.316 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream"
2026-02-17T04:45:15.317 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9"
2026-02-17T04:45:15.317 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos"
2026-02-17T04:45:15.317 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora"
2026-02-17T04:45:15.317 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9"
2026-02-17T04:45:15.317 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9"
2026-02-17T04:45:15.317 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T04:45:15.317 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31"
2026-02-17T04:45:15.317 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon"
2026-02-17T04:45:15.318 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T04:45:15.318 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/"
2026-02-17T04:45:15.318 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T04:45:15.318 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T04:45:15.318 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T04:45:15.319 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server
2026-02-17T04:45:15.424 INFO:teuthology.lock.ops:Updating [trial115.front.sepia.ceph.com]: set os type and version on server
2026-02-17T04:45:15.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial115.front.sepia.ceph.com'
2026-02-17T04:45:15.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:45:15.494 DEBUG:teuthology.orchestra.run.trial115:> true
2026-02-17T04:45:15.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial115.front.sepia.ceph.com'
2026-02-17T04:45:15.565 DEBUG:teuthology.orchestra.run.trial115:> uname -m
2026-02-17T04:45:15.620 INFO:teuthology.orchestra.run.trial115.stdout:x86_64
2026-02-17T04:45:15.621 DEBUG:teuthology.orchestra.run.trial115:> cat /etc/os-release
2026-02-17T04:45:15.678 INFO:teuthology.orchestra.run.trial115.stdout:NAME="CentOS Stream"
2026-02-17T04:45:15.678 INFO:teuthology.orchestra.run.trial115.stdout:VERSION="9"
2026-02-17T04:45:15.679 INFO:teuthology.orchestra.run.trial115.stdout:ID="centos"
2026-02-17T04:45:15.679 INFO:teuthology.orchestra.run.trial115.stdout:ID_LIKE="rhel fedora"
2026-02-17T04:45:15.679 INFO:teuthology.orchestra.run.trial115.stdout:VERSION_ID="9"
2026-02-17T04:45:15.679 INFO:teuthology.orchestra.run.trial115.stdout:PLATFORM_ID="platform:el9"
2026-02-17T04:45:15.679 INFO:teuthology.orchestra.run.trial115.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T04:45:15.679 INFO:teuthology.orchestra.run.trial115.stdout:ANSI_COLOR="0;31"
2026-02-17T04:45:15.680 INFO:teuthology.orchestra.run.trial115.stdout:LOGO="fedora-logo-icon"
2026-02-17T04:45:15.680 INFO:teuthology.orchestra.run.trial115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T04:45:15.680 INFO:teuthology.orchestra.run.trial115.stdout:HOME_URL="https://centos.org/"
2026-02-17T04:45:15.680 INFO:teuthology.orchestra.run.trial115.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T04:45:15.680 INFO:teuthology.orchestra.run.trial115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T04:45:15.681 INFO:teuthology.orchestra.run.trial115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T04:45:15.682 INFO:teuthology.lock.ops:Updating trial115.front.sepia.ceph.com on lock server
2026-02-17T04:45:15.783 INFO:teuthology.lock.ops:Updating [trial142.front.sepia.ceph.com]: set os type and version on server
2026-02-17T04:45:15.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial142.front.sepia.ceph.com'
2026-02-17T04:45:15.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T04:45:15.854 DEBUG:teuthology.orchestra.run.trial142:> true
2026-02-17T04:45:15.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial142.front.sepia.ceph.com'
2026-02-17T04:45:15.930 DEBUG:teuthology.orchestra.run.trial142:> uname -m
2026-02-17T04:45:15.986 INFO:teuthology.orchestra.run.trial142.stdout:x86_64
2026-02-17T04:45:15.987 DEBUG:teuthology.orchestra.run.trial142:> cat /etc/os-release
2026-02-17T04:45:16.043 INFO:teuthology.orchestra.run.trial142.stdout:NAME="CentOS Stream"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:VERSION="9"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:ID="centos"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:ID_LIKE="rhel fedora"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:VERSION_ID="9"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:PLATFORM_ID="platform:el9"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:ANSI_COLOR="0;31"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:LOGO="fedora-logo-icon"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T04:45:16.044 INFO:teuthology.orchestra.run.trial142.stdout:HOME_URL="https://centos.org/"
2026-02-17T04:45:16.045 INFO:teuthology.orchestra.run.trial142.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T04:45:16.045 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T04:45:16.045 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T04:45:16.045 INFO:teuthology.lock.ops:Updating trial142.front.sepia.ceph.com on lock server
2026-02-17T04:45:16.152 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:45:16.254 INFO:teuthology.dispatcher.supervisor:Running job 50909
2026-02-17T04:45:16.255 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50909 --name skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds} ec_optimizations/ec_optimizations_off mon_election/connectivity msgr-failures/osd-delay objectstore/{bluestore/{alloc$/{stupid} base mem$/{low} onode-segment$/{512K-onoff} write$/{v2/{compr$/{yes$/{snappy}} v2}}}} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2-technique=cauchy} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50909/orig.config.yaml
2026-02-17T04:45:16.255 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_03:53:03-rados-wip-bharath18-testing-2026-02-13-0856-distro-default-trial/50909
2026-02-17T04:45:16.255 INFO:teuthology.dispatcher.supervisor:Job PID: 1872100
2026-02-17T04:45:16.255 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T04:47:16.355 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:49:16.555 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:51:16.717 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:53:16.841 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:55:17.016 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:57:17.209 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T04:59:17.421 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:01:17.611 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:03:17.809 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:05:17.949 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:07:18.139 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:09:18.279 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T05:09:18.359 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T05:09:18.532 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T05:09:19.320 INFO:teuthology.orchestra.console.trial115:Power off
2026-02-17T05:09:19.321 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:09:19.335 INFO:teuthology.orchestra.console.trial112:Power off
2026-02-17T05:09:19.335 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:09:19.345 INFO:teuthology.orchestra.console.trial142:Power off
2026-02-17T05:09:19.345 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T05:09:19.359 DEBUG:teuthology.orchestra.console.trial115:power off output: Chassis Power Control: Down/Off
2026-02-17T05:09:19.372 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off
2026-02-17T05:09:19.383 DEBUG:teuthology.orchestra.console.trial142:power off output: Chassis Power Control: Down/Off
2026-02-17T05:09:23.363 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:09:23.373 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:09:23.384 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:09:23.473 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is on
2026-02-17T05:09:23.482 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on
2026-02-17T05:09:23.494 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is on
2026-02-17T05:09:27.477 DEBUG:teuthology.orchestra.console.trial115:pexpect command: ipmitool -H trial115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:09:27.487 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:09:27.495 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T05:09:27.589 DEBUG:teuthology.orchestra.console.trial115:check power output: Chassis Power is off
2026-02-17T05:09:27.589 INFO:teuthology.orchestra.console.trial115:Power off completed
2026-02-17T05:09:27.596 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off
2026-02-17T05:09:27.596 INFO:teuthology.orchestra.console.trial112:Power off completed
2026-02-17T05:09:27.604 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is off
2026-02-17T05:09:27.604 INFO:teuthology.orchestra.console.trial142:Power off completed
2026-02-17T05:09:27.882 INFO:teuthology.lock.ops:unlocked: trial115.front.sepia.ceph.com
2026-02-17T05:09:27.891 INFO:teuthology.lock.ops:unlocked: trial112.front.sepia.ceph.com
2026-02-17T05:09:27.896 INFO:teuthology.lock.ops:unlocked: trial142.front.sepia.ceph.com