2026-02-13T23:32:04.462 INFO:root:teuthology version: 1.2.4.dev6+g76f36e686 2026-02-13T23:32:04.462 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:32:04.537 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:32:04.793 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x70d93ca9c900>, signals=[15]) 2026-02-13T23:32:04.793 INFO:teuthology.lock.ops:Start node 'trial088.front.sepia.ceph.com' reimaging 2026-02-13T23:32:04.793 INFO:teuthology.lock.ops:Updating [trial088.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T23:32:04.793 INFO:teuthology.lock.ops:Updating trial088.front.sepia.ceph.com on lock server 2026-02-13T23:32:04.852 INFO:teuthology.lock.ops:Start node 'trial181.front.sepia.ceph.com' reimaging 2026-02-13T23:32:04.852 INFO:teuthology.lock.ops:Updating [trial181.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T23:32:04.852 INFO:teuthology.lock.ops:Updating trial181.front.sepia.ceph.com on lock server 2026-02-13T23:32:04.911 INFO:teuthology.lock.ops:Start node 'trial191.front.sepia.ceph.com' reimaging 2026-02-13T23:32:04.911 INFO:teuthology.lock.ops:Updating [trial191.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T23:32:04.911 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server 2026-02-13T23:32:05.182 DEBUG:teuthology.provision.fog.trial088:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T23:32:05.182 DEBUG:teuthology.provision.fog.trial181:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T23:32:05.225 INFO:teuthology.provision.fog.trial181:Scheduling deploy of centos 9.stream 2026-02-13T23:32:05.235 INFO:teuthology.provision.fog.trial088:Scheduling deploy of centos 9.stream 2026-02-13T23:32:05.238 DEBUG:teuthology.provision.fog.trial191:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T23:32:05.288 INFO:teuthology.provision.fog.trial191:Scheduling deploy of centos 9.stream 2026-02-13T23:32:06.374 INFO:teuthology.orchestra.console.trial088:Power off 2026-02-13T23:32:06.374 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T23:32:06.386 INFO:teuthology.orchestra.console.trial191:Power off 2026-02-13T23:32:06.387 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T23:32:06.395 INFO:teuthology.orchestra.console.trial181:Power off 2026-02-13T23:32:06.395 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T23:32:06.412 DEBUG:teuthology.orchestra.console.trial088:power off output: Chassis Power Control: Down/Off 2026-02-13T23:32:06.424 DEBUG:teuthology.orchestra.console.trial191:power off output: Chassis Power Control: Down/Off 2026-02-13T23:32:06.432 DEBUG:teuthology.orchestra.console.trial181:power off output: Chassis Power Control: Down/Off 2026-02-13T23:32:10.416 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:32:10.425 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:32:10.433 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:32:10.525 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off 2026-02-13T23:32:10.525 INFO:teuthology.orchestra.console.trial088:Power off completed 2026-02-13T23:32:10.533 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off 2026-02-13T23:32:10.533 INFO:teuthology.orchestra.console.trial191:Power off completed 2026-02-13T23:32:10.541 DEBUG:teuthology.orchestra.console.trial181:check power output: Chassis Power is off 2026-02-13T23:32:10.542 INFO:teuthology.orchestra.console.trial181:Power off completed 2026-02-13T23:32:10.626 INFO:teuthology.orchestra.console.trial088:Power on 2026-02-13T23:32:10.627 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T23:32:10.636 INFO:teuthology.orchestra.console.trial191:Power on 2026-02-13T23:32:10.636 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T23:32:10.645 INFO:teuthology.orchestra.console.trial181:Power on 2026-02-13T23:32:10.645 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T23:32:10.667 DEBUG:teuthology.orchestra.console.trial088:power on output: Chassis Power Control: Up/On 2026-02-13T23:32:10.679 DEBUG:teuthology.orchestra.console.trial191:power on output: Chassis Power Control: Up/On 2026-02-13T23:32:10.685 DEBUG:teuthology.orchestra.console.trial181:power on output: Chassis Power Control: Up/On 2026-02-13T23:32:14.671 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:32:14.679 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:32:14.685 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:32:14.779 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is on 2026-02-13T23:32:14.779 INFO:teuthology.orchestra.console.trial088:Power on completed 2026-02-13T23:32:14.787 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is on 2026-02-13T23:32:14.787 INFO:teuthology.orchestra.console.trial191:Power on completed 2026-02-13T23:32:14.794 DEBUG:teuthology.orchestra.console.trial181:check power output: Chassis Power is on 2026-02-13T23:32:14.794 INFO:teuthology.orchestra.console.trial181:Power on completed 2026-02-13T23:32:14.880 INFO:teuthology.provision.fog.trial088:Waiting for deploy to finish 2026-02-13T23:32:14.888 INFO:teuthology.provision.fog.trial191:Waiting for deploy to finish 2026-02-13T23:32:14.895 INFO:teuthology.provision.fog.trial181:Waiting for deploy to finish 2026-02-13T23:34:02.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:34:02.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:34:02.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:34:02.482 ERROR:teuthology.orchestra.connection:Error authenticating with trial191.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-13T23:34:05.405 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88 2026-02-13T23:34:11.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:34:14.493 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88 2026-02-13T23:34:20.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:34:23.581 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88 2026-02-13T23:34:29.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:34:32.669 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88 2026-02-13T23:34:38.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:34:41.757 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88 2026-02-13T23:34:47.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:35:02.328 WARNING:teuthology.provision.fog.trial181:timed out 2026-02-13T23:35:06.485 WARNING:teuthology.provision.fog.trial191:timed out 2026-02-13T23:35:08.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:35:12.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:35:15.620 ERROR:teuthology.orchestra.connection:Error authenticating with trial181.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T23:35:19.762 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T23:35:19.763 DEBUG:teuthology.orchestra.run.trial181:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T23:35:19.784 ERROR:teuthology.orchestra.connection:Error authenticating with trial191.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T23:35:23.791 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T23:35:23.791 DEBUG:teuthology.orchestra.run.trial088:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T23:35:23.967 ERROR:teuthology.orchestra.connection:Error authenticating with trial191.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T23:35:24.045 INFO:teuthology.provision.fog.trial088:Node is ready 2026-02-13T23:35:24.045 DEBUG:teuthology.orchestra.run.trial088:> hostname 2026-02-13T23:35:24.101 INFO:teuthology.orchestra.run.trial088.stdout:trial088.front.sepia.ceph.com 2026-02-13T23:35:24.101 DEBUG:teuthology.orchestra.run.trial088:> grep trial088.front.sepia.ceph.com /etc/hosts 2026-02-13T23:35:24.159 INFO:teuthology.orchestra.run.trial088.stdout:10.20.193.88 trial088.front.sepia.ceph.com trial088 2026-02-13T23:35:24.159 DEBUG:teuthology.orchestra.run.trial088:> sudo hostname trial088 2026-02-13T23:35:24.229 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/trial088.front.sepia.ceph.com/trial088/g' /etc/hosts 2026-02-13T23:35:24.295 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/10.20.193.88/10.20.193.88/g' /etc/hosts 2026-02-13T23:35:24.360 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/trial088.front.sepia.ceph.com/trial088/g' /etc/hostname 2026-02-13T23:35:24.424 DEBUG:teuthology.orchestra.run.trial088:> sudo hostname trial088 2026-02-13T23:35:24.489 DEBUG:teuthology.orchestra.run.trial088:> cat /etc/os-release 2026-02-13T23:35:24.546 INFO:teuthology.orchestra.run.trial088.stdout:NAME="CentOS Stream" 2026-02-13T23:35:24.546 INFO:teuthology.orchestra.run.trial088.stdout:VERSION="9" 2026-02-13T23:35:24.546 INFO:teuthology.orchestra.run.trial088.stdout:ID="centos" 2026-02-13T23:35:24.546 INFO:teuthology.orchestra.run.trial088.stdout:ID_LIKE="rhel fedora" 2026-02-13T23:35:24.546 INFO:teuthology.orchestra.run.trial088.stdout:VERSION_ID="9" 2026-02-13T23:35:24.546 INFO:teuthology.orchestra.run.trial088.stdout:PLATFORM_ID="platform:el9" 2026-02-13T23:35:24.546 INFO:teuthology.orchestra.run.trial088.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T23:35:24.546 INFO:teuthology.orchestra.run.trial088.stdout:ANSI_COLOR="0;31" 2026-02-13T23:35:24.547 INFO:teuthology.orchestra.run.trial088.stdout:LOGO="fedora-logo-icon" 2026-02-13T23:35:24.547 INFO:teuthology.orchestra.run.trial088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T23:35:24.547 INFO:teuthology.orchestra.run.trial088.stdout:HOME_URL="https://centos.org/" 2026-02-13T23:35:24.547 INFO:teuthology.orchestra.run.trial088.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T23:35:24.547 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T23:35:24.547 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T23:35:24.548 INFO:teuthology.provision.fog.trial088:Deploy complete! 2026-02-13T23:35:24.549 DEBUG:teuthology.parallel:result is None 2026-02-13T23:35:24.903 INFO:teuthology.provision.fog.trial181:Node is ready 2026-02-13T23:35:24.904 DEBUG:teuthology.orchestra.run.trial181:> hostname 2026-02-13T23:35:24.922 INFO:teuthology.orchestra.run.trial181.stdout:trial181.front.sepia.ceph.com 2026-02-13T23:35:24.922 DEBUG:teuthology.orchestra.run.trial181:> grep trial181.front.sepia.ceph.com /etc/hosts 2026-02-13T23:35:24.978 INFO:teuthology.orchestra.run.trial181.stdout:10.20.193.181 trial181.front.sepia.ceph.com trial181 2026-02-13T23:35:24.979 DEBUG:teuthology.orchestra.run.trial181:> sudo hostname trial181 2026-02-13T23:35:25.054 DEBUG:teuthology.orchestra.run.trial181:> sudo sed -i -e 's/trial181.front.sepia.ceph.com/trial181/g' /etc/hosts 2026-02-13T23:35:25.122 DEBUG:teuthology.orchestra.run.trial181:> sudo sed -i -e 's/10.20.193.181/10.20.193.181/g' /etc/hosts 2026-02-13T23:35:25.188 DEBUG:teuthology.orchestra.run.trial181:> sudo sed -i -e 's/trial181.front.sepia.ceph.com/trial181/g' /etc/hostname 2026-02-13T23:35:25.254 DEBUG:teuthology.orchestra.run.trial181:> sudo hostname trial181 2026-02-13T23:35:25.319 DEBUG:teuthology.orchestra.run.trial181:> cat /etc/os-release 2026-02-13T23:35:25.375 INFO:teuthology.orchestra.run.trial181.stdout:NAME="CentOS Stream" 2026-02-13T23:35:25.375 INFO:teuthology.orchestra.run.trial181.stdout:VERSION="9" 2026-02-13T23:35:25.375 INFO:teuthology.orchestra.run.trial181.stdout:ID="centos" 2026-02-13T23:35:25.375 INFO:teuthology.orchestra.run.trial181.stdout:ID_LIKE="rhel fedora" 2026-02-13T23:35:25.375 INFO:teuthology.orchestra.run.trial181.stdout:VERSION_ID="9" 2026-02-13T23:35:25.375 INFO:teuthology.orchestra.run.trial181.stdout:PLATFORM_ID="platform:el9" 2026-02-13T23:35:25.375 INFO:teuthology.orchestra.run.trial181.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T23:35:25.375 INFO:teuthology.orchestra.run.trial181.stdout:ANSI_COLOR="0;31" 2026-02-13T23:35:25.376 INFO:teuthology.orchestra.run.trial181.stdout:LOGO="fedora-logo-icon" 2026-02-13T23:35:25.376 INFO:teuthology.orchestra.run.trial181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T23:35:25.376 INFO:teuthology.orchestra.run.trial181.stdout:HOME_URL="https://centos.org/" 2026-02-13T23:35:25.376 INFO:teuthology.orchestra.run.trial181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T23:35:25.376 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T23:35:25.376 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T23:35:25.377 INFO:teuthology.provision.fog.trial181:Deploy complete! 2026-02-13T23:35:25.377 DEBUG:teuthology.parallel:result is None 2026-02-13T23:35:31.083 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T23:35:31.083 DEBUG:teuthology.orchestra.run.trial191:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T23:35:31.232 INFO:teuthology.provision.fog.trial191:Node is ready 2026-02-13T23:35:31.232 DEBUG:teuthology.orchestra.run.trial191:> hostname 2026-02-13T23:35:31.291 INFO:teuthology.orchestra.run.trial191.stdout:trial191.front.sepia.ceph.com 2026-02-13T23:35:31.291 DEBUG:teuthology.orchestra.run.trial191:> grep trial191.front.sepia.ceph.com /etc/hosts 2026-02-13T23:35:31.352 INFO:teuthology.orchestra.run.trial191.stdout:10.20.193.191 trial191.front.sepia.ceph.com trial191 2026-02-13T23:35:31.352 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname trial191 2026-02-13T23:35:31.425 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/trial191.front.sepia.ceph.com/trial191/g' /etc/hosts 2026-02-13T23:35:31.493 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/10.20.193.191/10.20.193.191/g' /etc/hosts 2026-02-13T23:35:31.561 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/trial191.front.sepia.ceph.com/trial191/g' /etc/hostname 2026-02-13T23:35:31.629 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname trial191 2026-02-13T23:35:31.696 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release 2026-02-13T23:35:31.756 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream" 2026-02-13T23:35:31.757 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9" 2026-02-13T23:35:31.757 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos" 2026-02-13T23:35:31.757 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora" 2026-02-13T23:35:31.757 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9" 2026-02-13T23:35:31.757 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9" 2026-02-13T23:35:31.757 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T23:35:31.757 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31" 2026-02-13T23:35:31.758 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon" 2026-02-13T23:35:31.758 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T23:35:31.758 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/" 2026-02-13T23:35:31.758 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T23:35:31.758 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T23:35:31.758 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T23:35:31.759 INFO:teuthology.provision.fog.trial191:Deploy complete! 2026-02-13T23:35:31.759 DEBUG:teuthology.parallel:result is None 2026-02-13T23:35:32.304 INFO:teuthology.lock.ops:Checking trial088.front.sepia.ceph.com 2026-02-13T23:35:32.305 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T23:35:32.414 INFO:teuthology.lock.ops:Checking trial181.front.sepia.ceph.com 2026-02-13T23:35:32.414 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T23:35:32.482 INFO:teuthology.lock.ops:Checking trial191.front.sepia.ceph.com 2026-02-13T23:35:32.482 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T23:35:32.541 INFO:teuthology.lock.ops:Updating [trial088.front.sepia.ceph.com]: set os type and version on server 2026-02-13T23:35:32.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial088.front.sepia.ceph.com' 2026-02-13T23:35:32.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:35:32.604 DEBUG:teuthology.orchestra.run.trial088:> true 2026-02-13T23:35:32.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial088.front.sepia.ceph.com' 2026-02-13T23:35:32.679 DEBUG:teuthology.orchestra.run.trial088:> uname -m 2026-02-13T23:35:32.734 INFO:teuthology.orchestra.run.trial088.stdout:x86_64 2026-02-13T23:35:32.734 DEBUG:teuthology.orchestra.run.trial088:> cat /etc/os-release 2026-02-13T23:35:32.790 INFO:teuthology.orchestra.run.trial088.stdout:NAME="CentOS Stream" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:VERSION="9" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:ID="centos" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:ID_LIKE="rhel fedora" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:VERSION_ID="9" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:PLATFORM_ID="platform:el9" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:ANSI_COLOR="0;31" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:LOGO="fedora-logo-icon" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:HOME_URL="https://centos.org/" 2026-02-13T23:35:32.791 INFO:teuthology.orchestra.run.trial088.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T23:35:32.792 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T23:35:32.792 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T23:35:32.792 INFO:teuthology.lock.ops:Updating trial088.front.sepia.ceph.com on lock server 2026-02-13T23:35:32.896 INFO:teuthology.lock.ops:Updating [trial181.front.sepia.ceph.com]: set os type and version on server 2026-02-13T23:35:32.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-13T23:35:32.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:35:32.966 DEBUG:teuthology.orchestra.run.trial181:> true 2026-02-13T23:35:33.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-13T23:35:33.043 DEBUG:teuthology.orchestra.run.trial181:> uname -m 2026-02-13T23:35:33.100 INFO:teuthology.orchestra.run.trial181.stdout:x86_64 2026-02-13T23:35:33.100 DEBUG:teuthology.orchestra.run.trial181:> cat /etc/os-release 2026-02-13T23:35:33.156 INFO:teuthology.orchestra.run.trial181.stdout:NAME="CentOS Stream" 2026-02-13T23:35:33.156 INFO:teuthology.orchestra.run.trial181.stdout:VERSION="9" 2026-02-13T23:35:33.156 INFO:teuthology.orchestra.run.trial181.stdout:ID="centos" 2026-02-13T23:35:33.156 INFO:teuthology.orchestra.run.trial181.stdout:ID_LIKE="rhel fedora" 2026-02-13T23:35:33.156 INFO:teuthology.orchestra.run.trial181.stdout:VERSION_ID="9" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:PLATFORM_ID="platform:el9" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:ANSI_COLOR="0;31" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:LOGO="fedora-logo-icon" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:HOME_URL="https://centos.org/" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T23:35:33.157 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T23:35:33.158 INFO:teuthology.lock.ops:Updating trial181.front.sepia.ceph.com on lock server 2026-02-13T23:35:33.262 INFO:teuthology.lock.ops:Updating [trial191.front.sepia.ceph.com]: set os type and version on server 2026-02-13T23:35:33.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-13T23:35:33.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T23:35:33.333 DEBUG:teuthology.orchestra.run.trial191:> true 2026-02-13T23:35:33.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial191.front.sepia.ceph.com' 2026-02-13T23:35:33.409 DEBUG:teuthology.orchestra.run.trial191:> uname -m 2026-02-13T23:35:33.465 INFO:teuthology.orchestra.run.trial191.stdout:x86_64 2026-02-13T23:35:33.466 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release 2026-02-13T23:35:33.522 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream" 2026-02-13T23:35:33.522 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9" 2026-02-13T23:35:33.522 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos" 2026-02-13T23:35:33.522 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora" 2026-02-13T23:35:33.522 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9" 2026-02-13T23:35:33.522 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9" 2026-02-13T23:35:33.523 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T23:35:33.523 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31" 2026-02-13T23:35:33.523 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon" 2026-02-13T23:35:33.523 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T23:35:33.523 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/" 2026-02-13T23:35:33.523 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T23:35:33.523 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T23:35:33.523 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T23:35:33.524 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server 2026-02-13T23:35:33.629 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:35:33.870 INFO:teuthology.dispatcher.supervisor:Running job 50026 2026-02-13T23:35:33.870 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50026 --name pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50026/orig.config.yaml 2026-02-13T23:35:33.871 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50026 2026-02-13T23:35:33.871 INFO:teuthology.dispatcher.supervisor:Job PID: 784891 2026-02-13T23:35:33.871 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-13T23:37:33.872 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:39:33.992 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:41:34.114 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:43:34.235 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:45:34.361 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:47:34.486 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:49:34.611 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:51:34.739 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:53:34.852 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:55:34.985 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T23:55:35.076 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2026-02-13T23:55:35.253 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-13T23:55:36.025 INFO:teuthology.orchestra.console.trial181:Power off 2026-02-13T23:55:36.025 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T23:55:36.039 INFO:teuthology.orchestra.console.trial088:Power off 2026-02-13T23:55:36.039 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T23:55:36.046 INFO:teuthology.orchestra.console.trial191:Power off 2026-02-13T23:55:36.046 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T23:55:36.065 DEBUG:teuthology.orchestra.console.trial181:power off output: Chassis Power Control: Down/Off 2026-02-13T23:55:36.079 DEBUG:teuthology.orchestra.console.trial088:power off output: Chassis Power Control: Down/Off 2026-02-13T23:55:36.083 DEBUG:teuthology.orchestra.console.trial191:power off output: Chassis Power Control: Down/Off 2026-02-13T23:55:40.066 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:55:40.079 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:55:40.087 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:55:40.176 DEBUG:teuthology.orchestra.console.trial181:check power output: Chassis Power is on 2026-02-13T23:55:40.188 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is on 2026-02-13T23:55:40.196 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is on 2026-02-13T23:55:44.178 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:55:44.190 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:55:44.197 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T23:55:44.287 DEBUG:teuthology.orchestra.console.trial181:check power output: Chassis Power is off 2026-02-13T23:55:44.287 INFO:teuthology.orchestra.console.trial181:Power off completed 2026-02-13T23:55:44.297 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off 2026-02-13T23:55:44.298 INFO:teuthology.orchestra.console.trial088:Power off completed 2026-02-13T23:55:44.307 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off 2026-02-13T23:55:44.307 INFO:teuthology.orchestra.console.trial191:Power off completed 2026-02-13T23:55:44.590 INFO:teuthology.lock.ops:unlocked: trial181.front.sepia.ceph.com 2026-02-13T23:55:44.599 INFO:teuthology.lock.ops:unlocked: trial088.front.sepia.ceph.com 2026-02-13T23:55:44.604 INFO:teuthology.lock.ops:unlocked: trial191.front.sepia.ceph.com