2026-02-13T18:42:48.164 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T18:42:48.164 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T18:42:48.237 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T18:42:48.551 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72b5b7c20d60>, signals=[15]) 2026-02-13T18:42:48.551 INFO:teuthology.lock.ops:Start node 'trial003.front.sepia.ceph.com' reimaging 2026-02-13T18:42:48.551 INFO:teuthology.lock.ops:Updating [trial003.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T18:42:48.551 INFO:teuthology.lock.ops:Updating trial003.front.sepia.ceph.com on lock server 2026-02-13T18:42:48.608 INFO:teuthology.lock.ops:Start node 'trial010.front.sepia.ceph.com' reimaging 2026-02-13T18:42:48.608 INFO:teuthology.lock.ops:Updating [trial010.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T18:42:48.608 INFO:teuthology.lock.ops:Updating trial010.front.sepia.ceph.com on lock server 2026-02-13T18:42:48.666 INFO:teuthology.lock.ops:Start node 'trial095.front.sepia.ceph.com' reimaging 2026-02-13T18:42:48.667 INFO:teuthology.lock.ops:Updating [trial095.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T18:42:48.667 INFO:teuthology.lock.ops:Updating trial095.front.sepia.ceph.com on lock server 2026-02-13T18:42:48.761 INFO:teuthology.lock.ops:Start node 'trial149.front.sepia.ceph.com' reimaging 2026-02-13T18:42:48.762 INFO:teuthology.lock.ops:Updating [trial149.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T18:42:48.762 INFO:teuthology.lock.ops:Updating trial149.front.sepia.ceph.com on lock server 2026-02-13T18:42:48.943 DEBUG:teuthology.provision.fog.trial003:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T18:42:48.943 DEBUG:teuthology.provision.fog.trial010:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T18:42:49.041 INFO:teuthology.provision.fog.trial003:Scheduling deploy of centos 9.stream 2026-02-13T18:42:49.046 DEBUG:teuthology.provision.fog.trial149:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T18:42:49.048 DEBUG:teuthology.provision.fog.trial095:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T18:42:49.049 INFO:teuthology.provision.fog.trial010:Scheduling deploy of centos 9.stream 2026-02-13T18:42:49.089 INFO:teuthology.provision.fog.trial149:Scheduling deploy of centos 9.stream 2026-02-13T18:42:49.102 INFO:teuthology.provision.fog.trial095:Scheduling deploy of centos 9.stream 2026-02-13T18:42:50.515 INFO:teuthology.orchestra.console.trial010:Power off 2026-02-13T18:42:50.515 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T18:42:50.618 INFO:teuthology.orchestra.console.trial003:Power off 2026-02-13T18:42:50.618 DEBUG:teuthology.orchestra.console.trial003:pexpect command: ipmitool -H trial003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T18:42:50.624 DEBUG:teuthology.orchestra.console.trial010:power off output: Chassis Power Control: Down/Off 2026-02-13T18:42:50.637 INFO:teuthology.orchestra.console.trial149:Power off 2026-02-13T18:42:50.637 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T18:42:50.647 INFO:teuthology.orchestra.console.trial095:Power off 2026-02-13T18:42:50.647 DEBUG:teuthology.orchestra.console.trial095:pexpect command: ipmitool -H trial095.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T18:42:50.657 DEBUG:teuthology.orchestra.console.trial003:power off output: Chassis Power Control: Down/Off 2026-02-13T18:42:50.675 DEBUG:teuthology.orchestra.console.trial149:power off output: Chassis Power Control: Down/Off 2026-02-13T18:42:50.685 DEBUG:teuthology.orchestra.console.trial095:power off output: Chassis Power Control: Down/Off 2026-02-13T18:42:54.629 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:42:54.657 DEBUG:teuthology.orchestra.console.trial003:pexpect command: ipmitool -H trial003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:42:54.676 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:42:54.686 DEBUG:teuthology.orchestra.console.trial095:pexpect command: ipmitool -H trial095.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:42:54.737 DEBUG:teuthology.orchestra.console.trial010:check power output: Chassis Power is off 2026-02-13T18:42:54.738 INFO:teuthology.orchestra.console.trial010:Power off completed 2026-02-13T18:42:54.767 DEBUG:teuthology.orchestra.console.trial003:check power output: Chassis Power is off 2026-02-13T18:42:54.767 INFO:teuthology.orchestra.console.trial003:Power off completed 2026-02-13T18:42:54.784 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is off 2026-02-13T18:42:54.785 INFO:teuthology.orchestra.console.trial149:Power off completed 2026-02-13T18:42:54.793 DEBUG:teuthology.orchestra.console.trial095:check power output: Chassis Power is off 2026-02-13T18:42:54.793 INFO:teuthology.orchestra.console.trial095:Power off completed 2026-02-13T18:42:54.838 INFO:teuthology.orchestra.console.trial010:Power on 2026-02-13T18:42:54.839 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T18:42:54.868 INFO:teuthology.orchestra.console.trial003:Power on 2026-02-13T18:42:54.868 DEBUG:teuthology.orchestra.console.trial003:pexpect command: ipmitool -H trial003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T18:42:54.876 DEBUG:teuthology.orchestra.console.trial010:power on output: Chassis Power Control: Up/On 2026-02-13T18:42:54.885 INFO:teuthology.orchestra.console.trial149:Power on 2026-02-13T18:42:54.886 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T18:42:54.894 INFO:teuthology.orchestra.console.trial095:Power on 2026-02-13T18:42:54.894 DEBUG:teuthology.orchestra.console.trial095:pexpect command: ipmitool -H trial095.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T18:42:54.903 DEBUG:teuthology.orchestra.console.trial003:power on output: Chassis Power Control: Up/On 2026-02-13T18:42:54.923 DEBUG:teuthology.orchestra.console.trial149:power on output: Chassis Power Control: Up/On 2026-02-13T18:42:54.931 DEBUG:teuthology.orchestra.console.trial095:power on output: Chassis Power Control: Up/On 2026-02-13T18:42:58.881 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:42:58.904 DEBUG:teuthology.orchestra.console.trial003:pexpect command: ipmitool -H trial003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:42:58.924 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:42:58.931 DEBUG:teuthology.orchestra.console.trial095:pexpect command: ipmitool -H trial095.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:42:58.991 DEBUG:teuthology.orchestra.console.trial010:check power output: Chassis Power is on 2026-02-13T18:42:58.991 INFO:teuthology.orchestra.console.trial010:Power on completed 2026-02-13T18:42:59.013 DEBUG:teuthology.orchestra.console.trial003:check power output: Chassis Power is on 2026-02-13T18:42:59.013 INFO:teuthology.orchestra.console.trial003:Power on completed 2026-02-13T18:42:59.033 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is on 2026-02-13T18:42:59.033 INFO:teuthology.orchestra.console.trial149:Power on completed 2026-02-13T18:42:59.041 DEBUG:teuthology.orchestra.console.trial095:check power output: Chassis Power is on 2026-02-13T18:42:59.041 INFO:teuthology.orchestra.console.trial095:Power on completed 2026-02-13T18:42:59.092 INFO:teuthology.provision.fog.trial010:Waiting for deploy to finish 2026-02-13T18:42:59.114 INFO:teuthology.provision.fog.trial003:Waiting for deploy to finish 2026-02-13T18:42:59.134 INFO:teuthology.provision.fog.trial149:Waiting for deploy to finish 2026-02-13T18:42:59.142 INFO:teuthology.provision.fog.trial095:Waiting for deploy to finish 2026-02-13T18:44:47.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:44:47.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial095.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:44:47.483 ERROR:teuthology.orchestra.connection:Error authenticating with trial010.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-13T18:45:01.726 WARNING:teuthology.provision.fog.trial095:[Errno None] Unable to connect to port 22 on 10.20.193.95 2026-02-13T18:45:02.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:07.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial095.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:10.813 WARNING:teuthology.provision.fog.trial095:[Errno None] Unable to connect to port 22 on 10.20.193.95 2026-02-13T18:45:16.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial095.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:16.893 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149 2026-02-13T18:45:19.901 WARNING:teuthology.provision.fog.trial095:[Errno None] Unable to connect to port 22 on 10.20.193.95 2026-02-13T18:45:22.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:25.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial095.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:25.981 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149 2026-02-13T18:45:28.989 WARNING:teuthology.provision.fog.trial095:[Errno None] Unable to connect to port 22 on 10.20.193.95 2026-02-13T18:45:31.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:34.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial095.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:35.069 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149 2026-02-13T18:45:41.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:44.157 WARNING:teuthology.provision.fog.trial149:[Errno None] Unable to connect to port 22 on 10.20.193.149 2026-02-13T18:45:50.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:51.484 WARNING:teuthology.provision.fog.trial010:timed out 2026-02-13T18:45:57.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T18:45:59.654 ERROR:teuthology.orchestra.connection:Error authenticating with trial010.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T18:46:03.755 ERROR:teuthology.orchestra.connection:Error authenticating with trial010.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T18:46:10.861 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T18:46:10.862 DEBUG:teuthology.orchestra.run.trial010:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T18:46:10.935 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T18:46:10.935 DEBUG:teuthology.orchestra.run.trial095:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T18:46:11.035 INFO:teuthology.provision.fog.trial010:Node is ready 2026-02-13T18:46:11.035 DEBUG:teuthology.orchestra.run.trial010:> hostname 2026-02-13T18:46:11.091 INFO:teuthology.orchestra.run.trial010.stdout:trial010.front.sepia.ceph.com 2026-02-13T18:46:11.091 DEBUG:teuthology.orchestra.run.trial010:> grep trial010.front.sepia.ceph.com /etc/hosts 2026-02-13T18:46:11.095 INFO:teuthology.provision.fog.trial095:Node is ready 2026-02-13T18:46:11.095 DEBUG:teuthology.orchestra.run.trial095:> hostname 2026-02-13T18:46:11.149 INFO:teuthology.orchestra.run.trial010.stdout:10.20.193.10 trial010.front.sepia.ceph.com trial010 2026-02-13T18:46:11.150 DEBUG:teuthology.orchestra.run.trial010:> sudo hostname trial010 2026-02-13T18:46:11.151 INFO:teuthology.orchestra.run.trial095.stdout:trial095.front.sepia.ceph.com 2026-02-13T18:46:11.152 DEBUG:teuthology.orchestra.run.trial095:> grep trial095.front.sepia.ceph.com /etc/hosts 2026-02-13T18:46:11.208 INFO:teuthology.orchestra.run.trial095.stdout:10.20.193.95 trial095.front.sepia.ceph.com trial095 2026-02-13T18:46:11.208 DEBUG:teuthology.orchestra.run.trial095:> sudo hostname trial095 2026-02-13T18:46:11.222 DEBUG:teuthology.orchestra.run.trial010:> sudo sed -i -e 's/trial010.front.sepia.ceph.com/trial010/g' /etc/hosts 2026-02-13T18:46:11.276 DEBUG:teuthology.orchestra.run.trial095:> sudo sed -i -e 's/trial095.front.sepia.ceph.com/trial095/g' /etc/hosts 2026-02-13T18:46:11.285 DEBUG:teuthology.orchestra.run.trial010:> sudo sed -i -e 's/10.20.193.10/10.20.193.10/g' /etc/hosts 2026-02-13T18:46:11.342 DEBUG:teuthology.orchestra.run.trial095:> sudo sed -i -e 's/10.20.193.95/10.20.193.95/g' /etc/hosts 2026-02-13T18:46:11.350 DEBUG:teuthology.orchestra.run.trial010:> sudo sed -i -e 's/trial010.front.sepia.ceph.com/trial010/g' /etc/hostname 2026-02-13T18:46:11.406 DEBUG:teuthology.orchestra.run.trial095:> sudo sed -i -e 's/trial095.front.sepia.ceph.com/trial095/g' /etc/hostname 2026-02-13T18:46:11.413 DEBUG:teuthology.orchestra.run.trial010:> sudo hostname trial010 2026-02-13T18:46:11.471 DEBUG:teuthology.orchestra.run.trial095:> sudo hostname trial095 2026-02-13T18:46:11.478 DEBUG:teuthology.orchestra.run.trial010:> cat /etc/os-release 2026-02-13T18:46:11.534 INFO:teuthology.orchestra.run.trial010.stdout:NAME="CentOS Stream" 2026-02-13T18:46:11.534 INFO:teuthology.orchestra.run.trial010.stdout:VERSION="9" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:ID="centos" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:ID_LIKE="rhel fedora" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:VERSION_ID="9" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:PLATFORM_ID="platform:el9" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:ANSI_COLOR="0;31" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:LOGO="fedora-logo-icon" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T18:46:11.535 INFO:teuthology.orchestra.run.trial010.stdout:HOME_URL="https://centos.org/" 2026-02-13T18:46:11.536 INFO:teuthology.orchestra.run.trial010.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T18:46:11.536 INFO:teuthology.orchestra.run.trial010.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T18:46:11.536 INFO:teuthology.orchestra.run.trial010.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T18:46:11.537 INFO:teuthology.provision.fog.trial010:Deploy complete! 2026-02-13T18:46:11.538 DEBUG:teuthology.parallel:result is None 2026-02-13T18:46:11.540 DEBUG:teuthology.orchestra.run.trial095:> cat /etc/os-release 2026-02-13T18:46:11.595 INFO:teuthology.orchestra.run.trial095.stdout:NAME="CentOS Stream" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:VERSION="9" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:ID="centos" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:ID_LIKE="rhel fedora" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:VERSION_ID="9" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:PLATFORM_ID="platform:el9" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:ANSI_COLOR="0;31" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:LOGO="fedora-logo-icon" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T18:46:11.596 INFO:teuthology.orchestra.run.trial095.stdout:HOME_URL="https://centos.org/" 2026-02-13T18:46:11.597 INFO:teuthology.orchestra.run.trial095.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T18:46:11.597 INFO:teuthology.orchestra.run.trial095.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T18:46:11.597 INFO:teuthology.orchestra.run.trial095.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T18:46:11.597 INFO:teuthology.provision.fog.trial095:Deploy complete! 2026-02-13T18:46:11.598 DEBUG:teuthology.parallel:result is None 2026-02-13T18:46:26.333 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T18:46:26.334 DEBUG:teuthology.orchestra.run.trial149:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T18:46:26.491 INFO:teuthology.provision.fog.trial149:Node is ready 2026-02-13T18:46:26.492 DEBUG:teuthology.orchestra.run.trial149:> hostname 2026-02-13T18:46:26.547 INFO:teuthology.orchestra.run.trial149.stdout:trial149.front.sepia.ceph.com 2026-02-13T18:46:26.547 DEBUG:teuthology.orchestra.run.trial149:> grep trial149.front.sepia.ceph.com /etc/hosts 2026-02-13T18:46:26.603 INFO:teuthology.orchestra.run.trial149.stdout:10.20.193.149 trial149.front.sepia.ceph.com trial149 2026-02-13T18:46:26.603 DEBUG:teuthology.orchestra.run.trial149:> sudo hostname trial149 2026-02-13T18:46:26.673 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/trial149.front.sepia.ceph.com/trial149/g' /etc/hosts 2026-02-13T18:46:26.737 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/10.20.193.149/10.20.193.149/g' /etc/hosts 2026-02-13T18:46:26.802 DEBUG:teuthology.orchestra.run.trial149:> sudo sed -i -e 's/trial149.front.sepia.ceph.com/trial149/g' /etc/hostname 2026-02-13T18:46:26.866 DEBUG:teuthology.orchestra.run.trial149:> sudo hostname trial149 2026-02-13T18:46:26.930 DEBUG:teuthology.orchestra.run.trial149:> cat /etc/os-release 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:NAME="CentOS Stream" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:VERSION="9" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:ID="centos" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:ID_LIKE="rhel fedora" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:VERSION_ID="9" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:PLATFORM_ID="platform:el9" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:ANSI_COLOR="0;31" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:LOGO="fedora-logo-icon" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:HOME_URL="https://centos.org/" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T18:46:26.985 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T18:46:26.985 INFO:teuthology.provision.fog.trial149:Deploy complete! 2026-02-13T18:46:26.986 DEBUG:teuthology.parallel:result is None 2026-02-13T19:13:15.112 DEBUG:teuthology.provision.fog.trial003:Canceling deploy task with ID 5692585 2026-02-13T19:13:15.183 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Unlocking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/dispatcher/supervisor.py", line 233, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/lock/ops.py", line 366, in reimage_machines with teuthology.parallel.parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/__init__.py", line 49, in reimage result = obj.create() ^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/fog.py", line 87, in create self.wait_for_deploy_task(task_id) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/fog.py", line 269, in wait_for_deploy_task while proceed(): ^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (120) after waiting for 1800 seconds 2026-02-13T19:13:15.461 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-13T19:13:16.380 INFO:teuthology.orchestra.console.trial010:Power off 2026-02-13T19:13:16.380 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T19:13:16.436 INFO:teuthology.orchestra.console.trial003:Power off 2026-02-13T19:13:16.437 DEBUG:teuthology.orchestra.console.trial003:pexpect command: ipmitool -H trial003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T19:13:16.444 INFO:teuthology.orchestra.console.trial149:Power off 2026-02-13T19:13:16.444 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T19:13:16.453 DEBUG:teuthology.orchestra.console.trial010:power off output: Chassis Power Control: Down/Off 2026-02-13T19:13:16.462 INFO:teuthology.orchestra.console.trial095:Power off 2026-02-13T19:13:16.462 DEBUG:teuthology.orchestra.console.trial095:pexpect command: ipmitool -H trial095.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T19:13:16.475 DEBUG:teuthology.orchestra.console.trial003:power off output: Chassis Power Control: Down/Off 2026-02-13T19:13:16.482 DEBUG:teuthology.orchestra.console.trial149:power off output: Chassis Power Control: Down/Off 2026-02-13T19:13:16.500 DEBUG:teuthology.orchestra.console.trial095:power off output: Chassis Power Control: Down/Off 2026-02-13T19:13:20.454 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:20.476 DEBUG:teuthology.orchestra.console.trial003:pexpect command: ipmitool -H trial003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:20.484 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:20.501 DEBUG:teuthology.orchestra.console.trial095:pexpect command: ipmitool -H trial095.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:20.566 DEBUG:teuthology.orchestra.console.trial010:check power output: Chassis Power is on 2026-02-13T19:13:20.586 DEBUG:teuthology.orchestra.console.trial003:check power output: Chassis Power is on 2026-02-13T19:13:20.594 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is on 2026-02-13T19:13:20.612 DEBUG:teuthology.orchestra.console.trial095:check power output: Chassis Power is on 2026-02-13T19:13:24.567 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:24.587 DEBUG:teuthology.orchestra.console.trial003:pexpect command: ipmitool -H trial003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:24.595 DEBUG:teuthology.orchestra.console.trial149:pexpect command: ipmitool -H trial149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:24.612 DEBUG:teuthology.orchestra.console.trial095:pexpect command: ipmitool -H trial095.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:24.678 DEBUG:teuthology.orchestra.console.trial010:check power output: Chassis Power is off 2026-02-13T19:13:24.678 INFO:teuthology.orchestra.console.trial010:Power off completed 2026-02-13T19:13:24.697 DEBUG:teuthology.orchestra.console.trial003:check power output: Chassis Power is off 2026-02-13T19:13:24.697 INFO:teuthology.orchestra.console.trial003:Power off completed 2026-02-13T19:13:24.705 DEBUG:teuthology.orchestra.console.trial149:check power output: Chassis Power is off 2026-02-13T19:13:24.705 INFO:teuthology.orchestra.console.trial149:Power off completed 2026-02-13T19:13:24.723 DEBUG:teuthology.orchestra.console.trial095:check power output: Chassis Power is off 2026-02-13T19:13:24.723 INFO:teuthology.orchestra.console.trial095:Power off completed 2026-02-13T19:13:25.015 INFO:teuthology.lock.ops:unlocked: trial010.front.sepia.ceph.com 2026-02-13T19:13:25.023 INFO:teuthology.lock.ops:unlocked: trial149.front.sepia.ceph.com 2026-02-13T19:13:25.028 INFO:teuthology.lock.ops:unlocked: trial003.front.sepia.ceph.com 2026-02-13T19:13:25.036 INFO:teuthology.lock.ops:unlocked: trial095.front.sepia.ceph.com 2026-02-13T19:13:25.037 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T19:13:25.550 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology-supervisor", line 6, in sys.exit(main()) ^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/scripts/supervisor.py", line 40, in main sys.exit(teuthology.dispatcher.supervisor.main(parse_args(sys.argv[1:]))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/dispatcher/supervisor.py", line 62, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/dispatcher/supervisor.py", line 233, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/lock/ops.py", line 366, in reimage_machines with teuthology.parallel.parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/__init__.py", line 49, in reimage result = obj.create() ^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/fog.py", line 87, in create self.wait_for_deploy_task(task_id) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/provision/fog.py", line 269, in wait_for_deploy_task while proceed(): ^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (120) after waiting for 1800 seconds