2026-02-12T15:51:31.165 INFO:root:teuthology version: 1.2.4.dev6+g96afe742a 2026-02-12T15:51:31.165 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:51:31.236 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:51:31.422 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7c2df6c4fe20>, signals=[15]) 2026-02-12T15:51:31.422 INFO:teuthology.lock.ops:Start node 'trial125.front.sepia.ceph.com' reimaging 2026-02-12T15:51:31.422 INFO:teuthology.lock.ops:Updating [trial125.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T15:51:31.422 INFO:teuthology.lock.ops:Updating trial125.front.sepia.ceph.com on lock server 2026-02-12T15:51:31.478 INFO:teuthology.lock.ops:Start node 'trial174.front.sepia.ceph.com' reimaging 2026-02-12T15:51:31.479 INFO:teuthology.lock.ops:Updating [trial174.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T15:51:31.479 INFO:teuthology.lock.ops:Updating trial174.front.sepia.ceph.com on lock server 2026-02-12T15:51:31.691 DEBUG:teuthology.provision.fog.trial174:Requesting image trial_rocky_10.1 (ID 4) 2026-02-12T15:51:31.700 DEBUG:teuthology.provision.fog.trial125:Requesting image trial_rocky_10.1 (ID 4) 2026-02-12T15:51:31.723 INFO:teuthology.provision.fog.trial125:Scheduling deploy of rocky 10.1 2026-02-12T15:51:31.744 INFO:teuthology.provision.fog.trial174:Scheduling deploy of rocky 10.1 2026-02-12T15:51:32.986 INFO:teuthology.orchestra.console.trial174:Power off 2026-02-12T15:51:32.986 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T15:51:33.002 INFO:teuthology.orchestra.console.trial125:Power off 2026-02-12T15:51:33.002 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T15:51:33.023 DEBUG:teuthology.orchestra.console.trial174:power off output: Chassis Power Control: Down/Off 2026-02-12T15:51:33.037 DEBUG:teuthology.orchestra.console.trial125:power off output: Chassis Power Control: Down/Off 2026-02-12T15:51:37.028 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T15:51:37.038 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T15:51:37.136 DEBUG:teuthology.orchestra.console.trial174:check power output: Chassis Power is off 2026-02-12T15:51:37.137 INFO:teuthology.orchestra.console.trial174:Power off completed 2026-02-12T15:51:37.146 DEBUG:teuthology.orchestra.console.trial125:check power output: Chassis Power is off 2026-02-12T15:51:37.147 INFO:teuthology.orchestra.console.trial125:Power off completed 2026-02-12T15:51:37.238 INFO:teuthology.orchestra.console.trial174:Power on 2026-02-12T15:51:37.238 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T15:51:37.248 INFO:teuthology.orchestra.console.trial125:Power on 2026-02-12T15:51:37.248 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T15:51:37.276 DEBUG:teuthology.orchestra.console.trial174:power on output: Chassis Power Control: Up/On 2026-02-12T15:51:37.286 DEBUG:teuthology.orchestra.console.trial125:power on output: Chassis Power Control: Up/On 2026-02-12T15:51:41.281 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T15:51:41.289 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T15:51:41.391 DEBUG:teuthology.orchestra.console.trial174:check power output: Chassis Power is on 2026-02-12T15:51:41.391 INFO:teuthology.orchestra.console.trial174:Power on completed 2026-02-12T15:51:41.398 DEBUG:teuthology.orchestra.console.trial125:check power output: Chassis Power is on 2026-02-12T15:51:41.398 INFO:teuthology.orchestra.console.trial125:Power on completed 2026-02-12T15:51:41.493 INFO:teuthology.provision.fog.trial174:Waiting for deploy to finish 2026-02-12T15:51:41.499 INFO:teuthology.provision.fog.trial125:Waiting for deploy to finish 2026-02-12T15:53:29.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:53:29.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:53:32.382 WARNING:teuthology.provision.fog.trial174:[Errno None] Unable to connect to port 22 on 10.20.193.174 2026-02-12T15:53:38.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:53:41.469 WARNING:teuthology.provision.fog.trial174:[Errno None] Unable to connect to port 22 on 10.20.193.174 2026-02-12T15:53:43.453 WARNING:teuthology.provision.fog.trial125:[Errno None] Unable to connect to port 22 on 10.20.193.125 2026-02-12T15:53:47.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:53:49.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:53:50.557 WARNING:teuthology.provision.fog.trial174:[Errno None] Unable to connect to port 22 on 10.20.193.174 2026-02-12T15:53:52.542 WARNING:teuthology.provision.fog.trial125:[Errno None] Unable to connect to port 22 on 10.20.193.125 2026-02-12T15:53:56.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:53:58.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:53:59.646 WARNING:teuthology.provision.fog.trial174:[Errno None] Unable to connect to port 22 on 10.20.193.174 2026-02-12T15:54:01.629 WARNING:teuthology.provision.fog.trial125:[Errno None] Unable to connect to port 22 on 10.20.193.125 2026-02-12T15:54:05.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:54:07.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:54:41.819 ERROR:teuthology.orchestra.connection:Error authenticating with trial174.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-12T15:54:43.850 ERROR:teuthology.orchestra.connection:Error authenticating with trial125.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-12T15:54:45.907 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T15:54:45.908 DEBUG:teuthology.orchestra.run.trial174:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T15:54:47.957 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T15:54:47.957 DEBUG:teuthology.orchestra.run.trial125:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T15:54:50.703 INFO:teuthology.provision.fog.trial174:Node is ready 2026-02-12T15:54:50.703 DEBUG:teuthology.orchestra.run.trial174:> hostname 2026-02-12T15:54:50.721 INFO:teuthology.orchestra.run.trial174.stdout:trial174.front.sepia.ceph.com 2026-02-12T15:54:50.721 DEBUG:teuthology.orchestra.run.trial174:> grep trial174.front.sepia.ceph.com /etc/hosts 2026-02-12T15:54:50.776 INFO:teuthology.orchestra.run.trial174.stdout:10.20.193.174 trial174.front.sepia.ceph.com trial174 2026-02-12T15:54:50.776 DEBUG:teuthology.orchestra.run.trial174:> sudo hostname trial174 2026-02-12T15:54:50.847 DEBUG:teuthology.orchestra.run.trial174:> sudo sed -i -e 's/trial174.front.sepia.ceph.com/trial174/g' /etc/hosts 2026-02-12T15:54:50.911 DEBUG:teuthology.orchestra.run.trial174:> sudo sed -i -e 's/10.20.193.174/10.20.193.174/g' /etc/hosts 2026-02-12T15:54:50.975 DEBUG:teuthology.orchestra.run.trial174:> sudo sed -i -e 's/trial174.front.sepia.ceph.com/trial174/g' /etc/hostname 2026-02-12T15:54:51.039 DEBUG:teuthology.orchestra.run.trial174:> sudo hostname trial174 2026-02-12T15:54:51.103 DEBUG:teuthology.orchestra.run.trial174:> cat /etc/os-release 2026-02-12T15:54:51.158 INFO:teuthology.orchestra.run.trial174.stdout:NAME="Rocky Linux" 2026-02-12T15:54:51.158 INFO:teuthology.orchestra.run.trial174.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T15:54:51.158 INFO:teuthology.orchestra.run.trial174.stdout:ID="rocky" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:VERSION_ID="10.1" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:PLATFORM_ID="platform:el10" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:ANSI_COLOR="0;32" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:LOGO="fedora-logo-icon" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:VENDOR_NAME="RESF" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T15:54:51.159 INFO:teuthology.orchestra.run.trial174.stdout:SUPPORT_END="2035-05-31" 2026-02-12T15:54:51.160 INFO:teuthology.orchestra.run.trial174.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T15:54:51.160 INFO:teuthology.orchestra.run.trial174.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T15:54:51.160 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T15:54:51.160 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T15:54:51.161 INFO:teuthology.provision.fog.trial174:Deploy complete! 2026-02-12T15:54:51.162 DEBUG:teuthology.parallel:result is None 2026-02-12T15:54:53.256 INFO:teuthology.provision.fog.trial125:Node is ready 2026-02-12T15:54:53.256 DEBUG:teuthology.orchestra.run.trial125:> hostname 2026-02-12T15:54:53.274 INFO:teuthology.orchestra.run.trial125.stdout:trial125.front.sepia.ceph.com 2026-02-12T15:54:53.274 DEBUG:teuthology.orchestra.run.trial125:> grep trial125.front.sepia.ceph.com /etc/hosts 2026-02-12T15:54:53.332 INFO:teuthology.orchestra.run.trial125.stdout:10.20.193.125 trial125.front.sepia.ceph.com trial125 2026-02-12T15:54:53.332 DEBUG:teuthology.orchestra.run.trial125:> sudo hostname trial125 2026-02-12T15:54:53.405 DEBUG:teuthology.orchestra.run.trial125:> sudo sed -i -e 's/trial125.front.sepia.ceph.com/trial125/g' /etc/hosts 2026-02-12T15:54:53.472 DEBUG:teuthology.orchestra.run.trial125:> sudo sed -i -e 's/10.20.193.125/10.20.193.125/g' /etc/hosts 2026-02-12T15:54:53.539 DEBUG:teuthology.orchestra.run.trial125:> sudo sed -i -e 's/trial125.front.sepia.ceph.com/trial125/g' /etc/hostname 2026-02-12T15:54:53.606 DEBUG:teuthology.orchestra.run.trial125:> sudo hostname trial125 2026-02-12T15:54:53.673 DEBUG:teuthology.orchestra.run.trial125:> cat /etc/os-release 2026-02-12T15:54:53.731 INFO:teuthology.orchestra.run.trial125.stdout:NAME="Rocky Linux" 2026-02-12T15:54:53.732 INFO:teuthology.orchestra.run.trial125.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T15:54:53.732 INFO:teuthology.orchestra.run.trial125.stdout:ID="rocky" 2026-02-12T15:54:53.732 INFO:teuthology.orchestra.run.trial125.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T15:54:53.732 INFO:teuthology.orchestra.run.trial125.stdout:VERSION_ID="10.1" 2026-02-12T15:54:53.732 INFO:teuthology.orchestra.run.trial125.stdout:PLATFORM_ID="platform:el10" 2026-02-12T15:54:53.732 INFO:teuthology.orchestra.run.trial125.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T15:54:53.732 INFO:teuthology.orchestra.run.trial125.stdout:ANSI_COLOR="0;32" 2026-02-12T15:54:53.732 INFO:teuthology.orchestra.run.trial125.stdout:LOGO="fedora-logo-icon" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:VENDOR_NAME="RESF" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:SUPPORT_END="2035-05-31" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T15:54:53.733 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T15:54:53.734 INFO:teuthology.provision.fog.trial125:Deploy complete! 2026-02-12T15:54:53.735 DEBUG:teuthology.parallel:result is None 2026-02-12T15:54:54.145 INFO:teuthology.lock.ops:Checking trial125.front.sepia.ceph.com 2026-02-12T15:54:54.145 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T15:54:54.251 INFO:teuthology.lock.ops:Checking trial174.front.sepia.ceph.com 2026-02-12T15:54:54.252 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T15:54:54.316 INFO:teuthology.lock.ops:Updating [trial125.front.sepia.ceph.com]: set os type and version on server 2026-02-12T15:54:54.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial125.front.sepia.ceph.com' 2026-02-12T15:54:54.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:54:54.375 DEBUG:teuthology.orchestra.run.trial125:> true 2026-02-12T15:54:54.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial125.front.sepia.ceph.com' 2026-02-12T15:54:54.457 DEBUG:teuthology.orchestra.run.trial125:> uname -m 2026-02-12T15:54:54.514 INFO:teuthology.orchestra.run.trial125.stdout:x86_64 2026-02-12T15:54:54.515 DEBUG:teuthology.orchestra.run.trial125:> cat /etc/os-release 2026-02-12T15:54:54.572 INFO:teuthology.orchestra.run.trial125.stdout:NAME="Rocky Linux" 2026-02-12T15:54:54.572 INFO:teuthology.orchestra.run.trial125.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T15:54:54.572 INFO:teuthology.orchestra.run.trial125.stdout:ID="rocky" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:VERSION_ID="10.1" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:PLATFORM_ID="platform:el10" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:ANSI_COLOR="0;32" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:LOGO="fedora-logo-icon" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:VENDOR_NAME="RESF" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T15:54:54.573 INFO:teuthology.orchestra.run.trial125.stdout:SUPPORT_END="2035-05-31" 2026-02-12T15:54:54.574 INFO:teuthology.orchestra.run.trial125.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T15:54:54.574 INFO:teuthology.orchestra.run.trial125.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T15:54:54.574 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T15:54:54.574 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T15:54:54.574 INFO:teuthology.lock.ops:Updating trial125.front.sepia.ceph.com on lock server 2026-02-12T15:54:54.675 INFO:teuthology.lock.ops:Updating [trial174.front.sepia.ceph.com]: set os type and version on server 2026-02-12T15:54:54.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-12T15:54:54.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T15:54:54.743 DEBUG:teuthology.orchestra.run.trial174:> true 2026-02-12T15:54:54.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial174.front.sepia.ceph.com' 2026-02-12T15:54:54.815 DEBUG:teuthology.orchestra.run.trial174:> uname -m 2026-02-12T15:54:54.873 INFO:teuthology.orchestra.run.trial174.stdout:x86_64 2026-02-12T15:54:54.873 DEBUG:teuthology.orchestra.run.trial174:> cat /etc/os-release 2026-02-12T15:54:54.930 INFO:teuthology.orchestra.run.trial174.stdout:NAME="Rocky Linux" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:ID="rocky" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:VERSION_ID="10.1" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:PLATFORM_ID="platform:el10" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:ANSI_COLOR="0;32" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:LOGO="fedora-logo-icon" 2026-02-12T15:54:54.931 INFO:teuthology.orchestra.run.trial174.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:VENDOR_NAME="RESF" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:SUPPORT_END="2035-05-31" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T15:54:54.932 INFO:teuthology.orchestra.run.trial174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T15:54:54.933 INFO:teuthology.lock.ops:Updating trial174.front.sepia.ceph.com on lock server 2026-02-12T15:54:55.035 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:54:55.129 INFO:teuthology.dispatcher.supervisor:Running job 46746 2026-02-12T15:54:55.129 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_15:50:32-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/46746 --name pdonnell-2026-02-12_15:50:32-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_15:50:32-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/46746/orig.config.yaml 2026-02-12T15:54:55.130 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_15:50:32-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/46746 2026-02-12T15:54:55.130 INFO:teuthology.dispatcher.supervisor:Job PID: 4071016 2026-02-12T15:54:55.130 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T15:56:55.230 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T15:58:55.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:00:55.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:02:55.817 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:04:56.022 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:06:56.222 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:08:56.425 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:10:56.631 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:12:56.852 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:14:57.065 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:16:57.234 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:18:57.424 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:20:57.545 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:22:57.643 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:24:57.737 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:26:57.943 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:28:58.044 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:30:58.259 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:32:58.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:34:58.588 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:36:58.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:38:59.011 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:40:59.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:42:59.331 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:44:59.521 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:46:59.692 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:48:59.888 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:51:00.088 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:53:00.279 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:55:00.454 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:57:00.602 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:59:00.716 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:01:00.905 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:03:01.106 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:05:01.276 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:07:01.605 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:09:01.758 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:11:01.895 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:13:02.065 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:15:02.222 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:17:02.392 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:19:02.562 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:21:02.718 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:23:02.905 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:25:03.007 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:27:03.173 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:29:03.317 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:31:03.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:33:03.754 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:35:03.936 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:37:04.127 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:39:04.318 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:41:04.439 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:43:04.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:45:04.737 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:47:04.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:49:05.079 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:51:05.284 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:53:05.480 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:55:05.684 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:57:05.790 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:59:05.917 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:01:06.117 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:03:06.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:05:06.404 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:07:06.623 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:09:06.741 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:11:06.885 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:13:07.054 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:15:07.262 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:17:07.473 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:19:07.659 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:21:07.844 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:23:07.992 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:25:08.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:27:08.282 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:29:08.469 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:31:08.653 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:33:08.880 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:35:09.074 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:37:09.282 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:39:09.470 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:41:09.682 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:43:09.869 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:45:10.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:47:10.268 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:49:10.485 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:51:10.693 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:53:10.905 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:55:11.112 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:57:11.307 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:59:11.453 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T19:01:11.667 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T19:03:11.858 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T19:05:12.060 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T19:07:12.247 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T19:09:12.440 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T19:11:12.628 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T19:11:12.719 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2026-02-12T19:11:12.836 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T19:11:13.395 INFO:teuthology.orchestra.console.trial125:Power off 2026-02-12T19:11:13.395 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T19:11:13.413 INFO:teuthology.orchestra.console.trial174:Power off 2026-02-12T19:11:13.413 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T19:11:13.434 DEBUG:teuthology.orchestra.console.trial125:power off output: Chassis Power Control: Down/Off 2026-02-12T19:11:13.452 DEBUG:teuthology.orchestra.console.trial174:power off output: Chassis Power Control: Down/Off 2026-02-12T19:11:17.438 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T19:11:17.452 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T19:11:17.547 DEBUG:teuthology.orchestra.console.trial125:check power output: Chassis Power is on 2026-02-12T19:11:17.561 DEBUG:teuthology.orchestra.console.trial174:check power output: Chassis Power is on 2026-02-12T19:11:21.549 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T19:11:21.561 DEBUG:teuthology.orchestra.console.trial174:pexpect command: ipmitool -H trial174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T19:11:21.659 DEBUG:teuthology.orchestra.console.trial125:check power output: Chassis Power is off 2026-02-12T19:11:21.660 INFO:teuthology.orchestra.console.trial125:Power off completed 2026-02-12T19:11:21.671 DEBUG:teuthology.orchestra.console.trial174:check power output: Chassis Power is off 2026-02-12T19:11:21.671 INFO:teuthology.orchestra.console.trial174:Power off completed 2026-02-12T19:11:21.905 INFO:teuthology.lock.ops:unlocked: trial125.front.sepia.ceph.com 2026-02-12T19:11:21.918 INFO:teuthology.lock.ops:unlocked: trial174.front.sepia.ceph.com