2026-02-19T12:25:24.716 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-19T12:25:24.717 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T12:25:24.790 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T12:25:25.041 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ae195b8dda0>, signals=[15]) 2026-02-19T12:25:25.042 INFO:teuthology.lock.ops:Start node 'trial007.front.sepia.ceph.com' reimaging 2026-02-19T12:25:25.042 INFO:teuthology.lock.ops:Updating [trial007.front.sepia.ceph.com]: reset os type and version on server 2026-02-19T12:25:25.042 INFO:teuthology.lock.ops:Updating trial007.front.sepia.ceph.com on lock server 2026-02-19T12:25:25.098 INFO:teuthology.lock.ops:Start node 'trial051.front.sepia.ceph.com' reimaging 2026-02-19T12:25:25.098 INFO:teuthology.lock.ops:Updating [trial051.front.sepia.ceph.com]: reset os type and version on server 2026-02-19T12:25:25.098 INFO:teuthology.lock.ops:Updating trial051.front.sepia.ceph.com on lock server 2026-02-19T12:25:25.156 INFO:teuthology.lock.ops:Start node 'trial120.front.sepia.ceph.com' reimaging 2026-02-19T12:25:25.156 INFO:teuthology.lock.ops:Updating [trial120.front.sepia.ceph.com]: reset os type and version on server 2026-02-19T12:25:25.156 INFO:teuthology.lock.ops:Updating trial120.front.sepia.ceph.com on lock server 2026-02-19T12:25:25.385 DEBUG:teuthology.provision.fog.trial051:Requesting image trial_rocky_10.1 (ID 4) 2026-02-19T12:25:25.385 DEBUG:teuthology.provision.fog.trial007:Requesting image trial_rocky_10.1 (ID 4) 2026-02-19T12:25:25.409 INFO:teuthology.provision.fog.trial051:Scheduling deploy of rocky 10.1 2026-02-19T12:25:25.433 INFO:teuthology.provision.fog.trial007:Scheduling deploy of rocky 10.1 2026-02-19T12:25:25.440 DEBUG:teuthology.provision.fog.trial120:Requesting image trial_rocky_10.1 (ID 4) 2026-02-19T12:25:25.494 INFO:teuthology.provision.fog.trial120:Scheduling deploy of rocky 10.1 2026-02-19T12:25:26.770 INFO:teuthology.orchestra.console.trial051:Power off 2026-02-19T12:25:26.770 DEBUG:teuthology.orchestra.console.trial051:pexpect command: ipmitool -H trial051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T12:25:26.827 INFO:teuthology.orchestra.console.trial120:Power off 2026-02-19T12:25:26.827 DEBUG:teuthology.orchestra.console.trial120:pexpect command: ipmitool -H trial120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T12:25:26.834 DEBUG:teuthology.orchestra.console.trial051:power off output: Chassis Power Control: Down/Off 2026-02-19T12:25:26.848 INFO:teuthology.orchestra.console.trial007:Power off 2026-02-19T12:25:26.848 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T12:25:26.867 DEBUG:teuthology.orchestra.console.trial120:power off output: Chassis Power Control: Down/Off 2026-02-19T12:25:26.886 DEBUG:teuthology.orchestra.console.trial007:power off output: Chassis Power Control: Down/Off 2026-02-19T12:25:30.839 DEBUG:teuthology.orchestra.console.trial051:pexpect command: ipmitool -H trial051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:25:30.868 DEBUG:teuthology.orchestra.console.trial120:pexpect command: ipmitool -H trial120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:25:30.886 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:25:30.948 DEBUG:teuthology.orchestra.console.trial051:check power output: Chassis Power is off 2026-02-19T12:25:30.949 INFO:teuthology.orchestra.console.trial051:Power off completed 2026-02-19T12:25:30.976 DEBUG:teuthology.orchestra.console.trial120:check power output: Chassis Power is off 2026-02-19T12:25:30.977 INFO:teuthology.orchestra.console.trial120:Power off completed 2026-02-19T12:25:30.994 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is off 2026-02-19T12:25:30.994 INFO:teuthology.orchestra.console.trial007:Power off completed 2026-02-19T12:25:31.050 INFO:teuthology.orchestra.console.trial051:Power on 2026-02-19T12:25:31.050 DEBUG:teuthology.orchestra.console.trial051:pexpect command: ipmitool -H trial051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-19T12:25:31.078 INFO:teuthology.orchestra.console.trial120:Power on 2026-02-19T12:25:31.078 DEBUG:teuthology.orchestra.console.trial120:pexpect command: ipmitool -H trial120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-19T12:25:31.091 DEBUG:teuthology.orchestra.console.trial051:power on output: Chassis Power Control: Up/On 2026-02-19T12:25:31.096 INFO:teuthology.orchestra.console.trial007:Power on 2026-02-19T12:25:31.096 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-19T12:25:31.121 DEBUG:teuthology.orchestra.console.trial120:power on output: Chassis Power Control: Up/On 2026-02-19T12:25:31.143 DEBUG:teuthology.orchestra.console.trial007:power on output: Chassis Power Control: Up/On 2026-02-19T12:25:35.092 DEBUG:teuthology.orchestra.console.trial051:pexpect command: ipmitool -H trial051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:25:35.121 DEBUG:teuthology.orchestra.console.trial120:pexpect command: ipmitool -H trial120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:25:35.143 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:25:35.201 DEBUG:teuthology.orchestra.console.trial051:check power output: Chassis Power is off 2026-02-19T12:25:35.228 DEBUG:teuthology.orchestra.console.trial120:check power output: Chassis Power is on 2026-02-19T12:25:35.228 INFO:teuthology.orchestra.console.trial120:Power on completed 2026-02-19T12:25:35.249 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is on 2026-02-19T12:25:35.249 INFO:teuthology.orchestra.console.trial007:Power on completed 2026-02-19T12:25:35.329 INFO:teuthology.provision.fog.trial120:Waiting for deploy to finish 2026-02-19T12:25:35.350 INFO:teuthology.provision.fog.trial007:Waiting for deploy to finish 2026-02-19T12:25:39.204 DEBUG:teuthology.orchestra.console.trial051:pexpect command: ipmitool -H trial051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:25:39.315 DEBUG:teuthology.orchestra.console.trial051:check power output: Chassis Power is on 2026-02-19T12:25:39.315 INFO:teuthology.orchestra.console.trial051:Power on completed 2026-02-19T12:25:39.416 INFO:teuthology.provision.fog.trial051:Waiting for deploy to finish 2026-02-19T12:27:23.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:23.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:26.336 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7 2026-02-19T12:27:26.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:29.856 WARNING:teuthology.provision.fog.trial051:[Errno None] Unable to connect to port 22 on 10.20.193.51 2026-02-19T12:27:32.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:35.424 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7 2026-02-19T12:27:35.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:37.536 WARNING:teuthology.provision.fog.trial120:[Errno None] Unable to connect to port 22 on 10.20.193.120 2026-02-19T12:27:38.944 WARNING:teuthology.provision.fog.trial051:[Errno None] Unable to connect to port 22 on 10.20.193.51 2026-02-19T12:27:41.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:43.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:44.512 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7 2026-02-19T12:27:44.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:46.624 WARNING:teuthology.provision.fog.trial120:[Errno None] Unable to connect to port 22 on 10.20.193.120 2026-02-19T12:27:48.032 WARNING:teuthology.provision.fog.trial051:[Errno None] Unable to connect to port 22 on 10.20.193.51 2026-02-19T12:27:50.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:52.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:53.600 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7 2026-02-19T12:27:54.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:27:55.712 WARNING:teuthology.provision.fog.trial120:[Errno None] Unable to connect to port 22 on 10.20.193.120 2026-02-19T12:27:57.120 WARNING:teuthology.provision.fog.trial051:[Errno None] Unable to connect to port 22 on 10.20.193.51 2026-02-19T12:27:59.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:01.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:02.688 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7 2026-02-19T12:28:03.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:04.800 WARNING:teuthology.provision.fog.trial120:[Errno None] Unable to connect to port 22 on 10.20.193.120 2026-02-19T12:28:06.207 WARNING:teuthology.provision.fog.trial051:[Errno None] Unable to connect to port 22 on 10.20.193.51 2026-02-19T12:28:08.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:10.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:12.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:44.951 ERROR:teuthology.orchestra.connection:Error authenticating with trial007.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-19T12:28:46.952 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-19T12:28:46.952 DEBUG:teuthology.orchestra.run.trial120:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-19T12:28:47.988 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-19T12:28:47.988 DEBUG:teuthology.orchestra.run.trial051:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-19T12:28:49.062 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-19T12:28:49.062 DEBUG:teuthology.orchestra.run.trial007:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-19T12:28:49.259 INFO:teuthology.provision.fog.trial007:Node is ready 2026-02-19T12:28:49.259 DEBUG:teuthology.orchestra.run.trial007:> hostname 2026-02-19T12:28:49.318 INFO:teuthology.orchestra.run.trial007.stdout:trial007.front.sepia.ceph.com 2026-02-19T12:28:49.318 DEBUG:teuthology.orchestra.run.trial007:> grep trial007.front.sepia.ceph.com /etc/hosts 2026-02-19T12:28:49.376 INFO:teuthology.orchestra.run.trial007.stdout:10.20.193.7 trial007.front.sepia.ceph.com trial007 2026-02-19T12:28:49.377 DEBUG:teuthology.orchestra.run.trial007:> sudo hostname trial007 2026-02-19T12:28:49.448 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/trial007.front.sepia.ceph.com/trial007/g' /etc/hosts 2026-02-19T12:28:49.516 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/10.20.193.7/10.20.193.7/g' /etc/hosts 2026-02-19T12:28:49.583 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/trial007.front.sepia.ceph.com/trial007/g' /etc/hostname 2026-02-19T12:28:49.651 DEBUG:teuthology.orchestra.run.trial007:> sudo hostname trial007 2026-02-19T12:28:49.719 DEBUG:teuthology.orchestra.run.trial007:> cat /etc/os-release 2026-02-19T12:28:49.776 INFO:teuthology.orchestra.run.trial007.stdout:NAME="Rocky Linux" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:ID="rocky" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:VERSION_ID="10.1" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:PLATFORM_ID="platform:el10" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:ANSI_COLOR="0;32" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:LOGO="fedora-logo-icon" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T12:28:49.777 INFO:teuthology.orchestra.run.trial007.stdout:VENDOR_NAME="RESF" 2026-02-19T12:28:49.778 INFO:teuthology.orchestra.run.trial007.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T12:28:49.778 INFO:teuthology.orchestra.run.trial007.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T12:28:49.778 INFO:teuthology.orchestra.run.trial007.stdout:SUPPORT_END="2035-05-31" 2026-02-19T12:28:49.778 INFO:teuthology.orchestra.run.trial007.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T12:28:49.778 INFO:teuthology.orchestra.run.trial007.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:49.778 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T12:28:49.778 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:49.779 INFO:teuthology.provision.fog.trial007:Deploy complete! 2026-02-19T12:28:49.780 DEBUG:teuthology.parallel:result is None 2026-02-19T12:28:51.853 INFO:teuthology.provision.fog.trial120:Node is ready 2026-02-19T12:28:51.853 DEBUG:teuthology.orchestra.run.trial120:> hostname 2026-02-19T12:28:51.872 INFO:teuthology.orchestra.run.trial120.stdout:trial120.front.sepia.ceph.com 2026-02-19T12:28:51.872 DEBUG:teuthology.orchestra.run.trial120:> grep trial120.front.sepia.ceph.com /etc/hosts 2026-02-19T12:28:51.927 INFO:teuthology.orchestra.run.trial120.stdout:10.20.193.120 trial120.front.sepia.ceph.com trial120 2026-02-19T12:28:51.928 DEBUG:teuthology.orchestra.run.trial120:> sudo hostname trial120 2026-02-19T12:28:51.997 DEBUG:teuthology.orchestra.run.trial120:> sudo sed -i -e 's/trial120.front.sepia.ceph.com/trial120/g' /etc/hosts 2026-02-19T12:28:52.062 DEBUG:teuthology.orchestra.run.trial120:> sudo sed -i -e 's/10.20.193.120/10.20.193.120/g' /etc/hosts 2026-02-19T12:28:52.126 DEBUG:teuthology.orchestra.run.trial120:> sudo sed -i -e 's/trial120.front.sepia.ceph.com/trial120/g' /etc/hostname 2026-02-19T12:28:52.189 DEBUG:teuthology.orchestra.run.trial120:> sudo hostname trial120 2026-02-19T12:28:52.255 DEBUG:teuthology.orchestra.run.trial120:> cat /etc/os-release 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:NAME="Rocky Linux" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:ID="rocky" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:VERSION_ID="10.1" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:PLATFORM_ID="platform:el10" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:ANSI_COLOR="0;32" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:LOGO="fedora-logo-icon" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:VENDOR_NAME="RESF" 2026-02-19T12:28:52.312 INFO:teuthology.orchestra.run.trial120.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T12:28:52.313 INFO:teuthology.orchestra.run.trial120.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T12:28:52.313 INFO:teuthology.orchestra.run.trial120.stdout:SUPPORT_END="2035-05-31" 2026-02-19T12:28:52.313 INFO:teuthology.orchestra.run.trial120.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T12:28:52.313 INFO:teuthology.orchestra.run.trial120.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:52.313 INFO:teuthology.orchestra.run.trial120.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T12:28:52.313 INFO:teuthology.orchestra.run.trial120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:52.313 INFO:teuthology.provision.fog.trial120:Deploy complete! 2026-02-19T12:28:52.313 DEBUG:teuthology.parallel:result is None 2026-02-19T12:28:53.005 INFO:teuthology.provision.fog.trial051:Node is ready 2026-02-19T12:28:53.005 DEBUG:teuthology.orchestra.run.trial051:> hostname 2026-02-19T12:28:53.022 INFO:teuthology.orchestra.run.trial051.stdout:trial051.front.sepia.ceph.com 2026-02-19T12:28:53.022 DEBUG:teuthology.orchestra.run.trial051:> grep trial051.front.sepia.ceph.com /etc/hosts 2026-02-19T12:28:53.079 INFO:teuthology.orchestra.run.trial051.stdout:10.20.193.51 trial051.front.sepia.ceph.com trial051 2026-02-19T12:28:53.080 DEBUG:teuthology.orchestra.run.trial051:> sudo hostname trial051 2026-02-19T12:28:53.153 DEBUG:teuthology.orchestra.run.trial051:> sudo sed -i -e 's/trial051.front.sepia.ceph.com/trial051/g' /etc/hosts 2026-02-19T12:28:53.219 DEBUG:teuthology.orchestra.run.trial051:> sudo sed -i -e 's/10.20.193.51/10.20.193.51/g' /etc/hosts 2026-02-19T12:28:53.287 DEBUG:teuthology.orchestra.run.trial051:> sudo sed -i -e 's/trial051.front.sepia.ceph.com/trial051/g' /etc/hostname 2026-02-19T12:28:53.355 DEBUG:teuthology.orchestra.run.trial051:> sudo hostname trial051 2026-02-19T12:28:53.420 DEBUG:teuthology.orchestra.run.trial051:> cat /etc/os-release 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:NAME="Rocky Linux" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:ID="rocky" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:VERSION_ID="10.1" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:PLATFORM_ID="platform:el10" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:ANSI_COLOR="0;32" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:LOGO="fedora-logo-icon" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T12:28:53.479 INFO:teuthology.orchestra.run.trial051.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T12:28:53.480 INFO:teuthology.orchestra.run.trial051.stdout:VENDOR_NAME="RESF" 2026-02-19T12:28:53.480 INFO:teuthology.orchestra.run.trial051.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T12:28:53.480 INFO:teuthology.orchestra.run.trial051.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T12:28:53.480 INFO:teuthology.orchestra.run.trial051.stdout:SUPPORT_END="2035-05-31" 2026-02-19T12:28:53.480 INFO:teuthology.orchestra.run.trial051.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T12:28:53.480 INFO:teuthology.orchestra.run.trial051.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:53.480 INFO:teuthology.orchestra.run.trial051.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T12:28:53.480 INFO:teuthology.orchestra.run.trial051.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:53.480 INFO:teuthology.provision.fog.trial051:Deploy complete! 2026-02-19T12:28:53.481 DEBUG:teuthology.parallel:result is None 2026-02-19T12:28:53.997 INFO:teuthology.lock.ops:Checking trial007.front.sepia.ceph.com 2026-02-19T12:28:53.997 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-19T12:28:54.064 INFO:teuthology.lock.ops:Checking trial051.front.sepia.ceph.com 2026-02-19T12:28:54.064 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-19T12:28:54.122 INFO:teuthology.lock.ops:Checking trial120.front.sepia.ceph.com 2026-02-19T12:28:54.122 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-19T12:28:54.178 INFO:teuthology.lock.ops:Updating [trial007.front.sepia.ceph.com]: set os type and version on server 2026-02-19T12:28:54.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial007.front.sepia.ceph.com' 2026-02-19T12:28:54.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:54.240 DEBUG:teuthology.orchestra.run.trial007:> true 2026-02-19T12:28:54.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial007.front.sepia.ceph.com' 2026-02-19T12:28:54.323 DEBUG:teuthology.orchestra.run.trial007:> uname -m 2026-02-19T12:28:54.381 INFO:teuthology.orchestra.run.trial007.stdout:x86_64 2026-02-19T12:28:54.381 DEBUG:teuthology.orchestra.run.trial007:> cat /etc/os-release 2026-02-19T12:28:54.438 INFO:teuthology.orchestra.run.trial007.stdout:NAME="Rocky Linux" 2026-02-19T12:28:54.438 INFO:teuthology.orchestra.run.trial007.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T12:28:54.438 INFO:teuthology.orchestra.run.trial007.stdout:ID="rocky" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:VERSION_ID="10.1" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:PLATFORM_ID="platform:el10" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:ANSI_COLOR="0;32" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:LOGO="fedora-logo-icon" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:VENDOR_NAME="RESF" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T12:28:54.439 INFO:teuthology.orchestra.run.trial007.stdout:SUPPORT_END="2035-05-31" 2026-02-19T12:28:54.440 INFO:teuthology.orchestra.run.trial007.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T12:28:54.440 INFO:teuthology.orchestra.run.trial007.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:54.440 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T12:28:54.440 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:54.440 INFO:teuthology.lock.ops:Updating trial007.front.sepia.ceph.com on lock server 2026-02-19T12:28:54.544 INFO:teuthology.lock.ops:Updating [trial051.front.sepia.ceph.com]: set os type and version on server 2026-02-19T12:28:54.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-19T12:28:54.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:54.613 DEBUG:teuthology.orchestra.run.trial051:> true 2026-02-19T12:28:54.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial051.front.sepia.ceph.com' 2026-02-19T12:28:54.686 DEBUG:teuthology.orchestra.run.trial051:> uname -m 2026-02-19T12:28:54.743 INFO:teuthology.orchestra.run.trial051.stdout:x86_64 2026-02-19T12:28:54.743 DEBUG:teuthology.orchestra.run.trial051:> cat /etc/os-release 2026-02-19T12:28:54.800 INFO:teuthology.orchestra.run.trial051.stdout:NAME="Rocky Linux" 2026-02-19T12:28:54.800 INFO:teuthology.orchestra.run.trial051.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T12:28:54.800 INFO:teuthology.orchestra.run.trial051.stdout:ID="rocky" 2026-02-19T12:28:54.800 INFO:teuthology.orchestra.run.trial051.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:VERSION_ID="10.1" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:PLATFORM_ID="platform:el10" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:ANSI_COLOR="0;32" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:LOGO="fedora-logo-icon" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:VENDOR_NAME="RESF" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T12:28:54.801 INFO:teuthology.orchestra.run.trial051.stdout:SUPPORT_END="2035-05-31" 2026-02-19T12:28:54.802 INFO:teuthology.orchestra.run.trial051.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T12:28:54.802 INFO:teuthology.orchestra.run.trial051.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:54.802 INFO:teuthology.orchestra.run.trial051.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T12:28:54.802 INFO:teuthology.orchestra.run.trial051.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:54.802 INFO:teuthology.lock.ops:Updating trial051.front.sepia.ceph.com on lock server 2026-02-19T12:28:54.914 INFO:teuthology.lock.ops:Updating [trial120.front.sepia.ceph.com]: set os type and version on server 2026-02-19T12:28:54.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial120.front.sepia.ceph.com' 2026-02-19T12:28:54.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:28:54.982 DEBUG:teuthology.orchestra.run.trial120:> true 2026-02-19T12:28:55.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial120.front.sepia.ceph.com' 2026-02-19T12:28:55.057 DEBUG:teuthology.orchestra.run.trial120:> uname -m 2026-02-19T12:28:55.115 INFO:teuthology.orchestra.run.trial120.stdout:x86_64 2026-02-19T12:28:55.116 DEBUG:teuthology.orchestra.run.trial120:> cat /etc/os-release 2026-02-19T12:28:55.173 INFO:teuthology.orchestra.run.trial120.stdout:NAME="Rocky Linux" 2026-02-19T12:28:55.173 INFO:teuthology.orchestra.run.trial120.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T12:28:55.173 INFO:teuthology.orchestra.run.trial120.stdout:ID="rocky" 2026-02-19T12:28:55.173 INFO:teuthology.orchestra.run.trial120.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T12:28:55.173 INFO:teuthology.orchestra.run.trial120.stdout:VERSION_ID="10.1" 2026-02-19T12:28:55.173 INFO:teuthology.orchestra.run.trial120.stdout:PLATFORM_ID="platform:el10" 2026-02-19T12:28:55.173 INFO:teuthology.orchestra.run.trial120.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:ANSI_COLOR="0;32" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:LOGO="fedora-logo-icon" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:VENDOR_NAME="RESF" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:SUPPORT_END="2035-05-31" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:55.174 INFO:teuthology.orchestra.run.trial120.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T12:28:55.175 INFO:teuthology.orchestra.run.trial120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T12:28:55.175 INFO:teuthology.lock.ops:Updating trial120.front.sepia.ceph.com on lock server 2026-02-19T12:28:55.426 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T12:28:55.547 INFO:teuthology.dispatcher.supervisor:Running job 58574 2026-02-19T12:28:55.547 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58574 --name nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds} ec_optimizations/ec_optimizations_on mon_election/classic msgr-failures/osd-delay objectstore/{bluestore/{alloc$/{bitmap} base mem$/{low} onode-segment$/{512K} write$/{random/{compr$/{no$/{no}} random}}}} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rpm_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58574/orig.config.yaml 2026-02-19T12:28:55.548 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58574 2026-02-19T12:28:55.548 INFO:teuthology.dispatcher.supervisor:Job PID: 2461850 2026-02-19T12:28:55.548 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-19T12:30:55.622 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T12:32:55.834 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T12:34:56.043 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T12:34:56.131 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-19T12:34:56.304 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-19T12:34:57.026 INFO:teuthology.orchestra.console.trial051:Power off 2026-02-19T12:34:57.026 DEBUG:teuthology.orchestra.console.trial051:pexpect command: ipmitool -H trial051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T12:34:57.038 INFO:teuthology.orchestra.console.trial120:Power off 2026-02-19T12:34:57.038 DEBUG:teuthology.orchestra.console.trial120:pexpect command: ipmitool -H trial120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T12:34:57.049 INFO:teuthology.orchestra.console.trial007:Power off 2026-02-19T12:34:57.049 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T12:34:57.065 DEBUG:teuthology.orchestra.console.trial051:power off output: Chassis Power Control: Down/Off 2026-02-19T12:34:57.078 DEBUG:teuthology.orchestra.console.trial120:power off output: Chassis Power Control: Down/Off 2026-02-19T12:34:57.086 DEBUG:teuthology.orchestra.console.trial007:power off output: Chassis Power Control: Down/Off 2026-02-19T12:35:01.069 DEBUG:teuthology.orchestra.console.trial051:pexpect command: ipmitool -H trial051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:35:01.079 DEBUG:teuthology.orchestra.console.trial120:pexpect command: ipmitool -H trial120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:35:01.087 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:35:01.179 DEBUG:teuthology.orchestra.console.trial051:check power output: Chassis Power is on 2026-02-19T12:35:01.187 DEBUG:teuthology.orchestra.console.trial120:check power output: Chassis Power is on 2026-02-19T12:35:01.196 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is on 2026-02-19T12:35:05.183 DEBUG:teuthology.orchestra.console.trial051:pexpect command: ipmitool -H trial051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:35:05.193 DEBUG:teuthology.orchestra.console.trial120:pexpect command: ipmitool -H trial120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:35:05.200 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T12:35:05.294 DEBUG:teuthology.orchestra.console.trial051:check power output: Chassis Power is off 2026-02-19T12:35:05.295 INFO:teuthology.orchestra.console.trial051:Power off completed 2026-02-19T12:35:05.302 DEBUG:teuthology.orchestra.console.trial120:check power output: Chassis Power is off 2026-02-19T12:35:05.302 INFO:teuthology.orchestra.console.trial120:Power off completed 2026-02-19T12:35:05.310 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is off 2026-02-19T12:35:05.310 INFO:teuthology.orchestra.console.trial007:Power off completed 2026-02-19T12:35:05.587 INFO:teuthology.lock.ops:unlocked: trial051.front.sepia.ceph.com 2026-02-19T12:35:05.596 INFO:teuthology.lock.ops:unlocked: trial120.front.sepia.ceph.com 2026-02-19T12:35:05.600 INFO:teuthology.lock.ops:unlocked: trial007.front.sepia.ceph.com