2026-02-13T21:59:11.005 INFO:root:teuthology version: 1.2.4.dev6+g76f36e686 2026-02-13T21:59:11.005 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T21:59:11.079 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T21:59:11.339 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7503313a5260>, signals=[15]) 2026-02-13T21:59:11.340 INFO:teuthology.lock.ops:Start node 'trial012.front.sepia.ceph.com' reimaging 2026-02-13T21:59:11.340 INFO:teuthology.lock.ops:Updating [trial012.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T21:59:11.340 INFO:teuthology.lock.ops:Updating trial012.front.sepia.ceph.com on lock server 2026-02-13T21:59:11.402 INFO:teuthology.lock.ops:Start node 'trial143.front.sepia.ceph.com' reimaging 2026-02-13T21:59:11.402 INFO:teuthology.lock.ops:Updating [trial143.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T21:59:11.402 INFO:teuthology.lock.ops:Updating trial143.front.sepia.ceph.com on lock server 2026-02-13T21:59:11.475 INFO:teuthology.lock.ops:Start node 'trial184.front.sepia.ceph.com' reimaging 2026-02-13T21:59:11.475 INFO:teuthology.lock.ops:Updating [trial184.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T21:59:11.475 INFO:teuthology.lock.ops:Updating trial184.front.sepia.ceph.com on lock server 2026-02-13T21:59:11.723 DEBUG:teuthology.provision.fog.trial012:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T21:59:11.723 DEBUG:teuthology.provision.fog.trial143:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T21:59:11.776 INFO:teuthology.provision.fog.trial012:Scheduling deploy of centos 9.stream 2026-02-13T21:59:11.779 INFO:teuthology.provision.fog.trial143:Scheduling deploy of centos 9.stream 2026-02-13T21:59:11.790 DEBUG:teuthology.provision.fog.trial184:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T21:59:11.840 INFO:teuthology.provision.fog.trial184:Scheduling deploy of centos 9.stream 2026-02-13T21:59:13.141 INFO:teuthology.orchestra.console.trial012:Power off 2026-02-13T21:59:13.141 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T21:59:13.153 INFO:teuthology.orchestra.console.trial143:Power off 2026-02-13T21:59:13.154 DEBUG:teuthology.orchestra.console.trial143:pexpect command: ipmitool -H trial143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T21:59:13.165 INFO:teuthology.orchestra.console.trial184:Power off 2026-02-13T21:59:13.165 DEBUG:teuthology.orchestra.console.trial184:pexpect command: ipmitool -H trial184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T21:59:13.181 DEBUG:teuthology.orchestra.console.trial012:power off output: Chassis Power Control: Down/Off 2026-02-13T21:59:13.192 DEBUG:teuthology.orchestra.console.trial143:power off output: Chassis Power Control: Down/Off 2026-02-13T21:59:13.205 DEBUG:teuthology.orchestra.console.trial184:power off output: Chassis Power Control: Down/Off 2026-02-13T21:59:17.186 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T21:59:17.193 DEBUG:teuthology.orchestra.console.trial143:pexpect command: ipmitool -H trial143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T21:59:17.206 DEBUG:teuthology.orchestra.console.trial184:pexpect command: ipmitool -H trial184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T21:59:17.295 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is off 2026-02-13T21:59:17.295 INFO:teuthology.orchestra.console.trial012:Power off completed 2026-02-13T21:59:17.301 DEBUG:teuthology.orchestra.console.trial143:check power output: Chassis Power is off 2026-02-13T21:59:17.301 INFO:teuthology.orchestra.console.trial143:Power off completed 2026-02-13T21:59:17.315 DEBUG:teuthology.orchestra.console.trial184:check power output: Chassis Power is off 2026-02-13T21:59:17.315 INFO:teuthology.orchestra.console.trial184:Power off completed 2026-02-13T21:59:17.397 INFO:teuthology.orchestra.console.trial012:Power on 2026-02-13T21:59:17.397 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T21:59:17.404 INFO:teuthology.orchestra.console.trial143:Power on 2026-02-13T21:59:17.405 DEBUG:teuthology.orchestra.console.trial143:pexpect command: ipmitool -H trial143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T21:59:17.416 INFO:teuthology.orchestra.console.trial184:Power on 2026-02-13T21:59:17.416 DEBUG:teuthology.orchestra.console.trial184:pexpect command: ipmitool -H trial184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T21:59:17.437 DEBUG:teuthology.orchestra.console.trial012:power on output: Chassis Power Control: Up/On 2026-02-13T21:59:17.444 DEBUG:teuthology.orchestra.console.trial143:power on output: Chassis Power Control: Up/On 2026-02-13T21:59:17.456 DEBUG:teuthology.orchestra.console.trial184:power on output: Chassis Power Control: Up/On 2026-02-13T21:59:21.442 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T21:59:21.450 DEBUG:teuthology.orchestra.console.trial143:pexpect command: ipmitool -H trial143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T21:59:21.458 DEBUG:teuthology.orchestra.console.trial184:pexpect command: ipmitool -H trial184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T21:59:21.553 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is on 2026-02-13T21:59:21.553 INFO:teuthology.orchestra.console.trial012:Power on completed 2026-02-13T21:59:21.560 DEBUG:teuthology.orchestra.console.trial143:check power output: Chassis Power is on 2026-02-13T21:59:21.560 INFO:teuthology.orchestra.console.trial143:Power on completed 2026-02-13T21:59:21.568 DEBUG:teuthology.orchestra.console.trial184:check power output: Chassis Power is on 2026-02-13T21:59:21.569 INFO:teuthology.orchestra.console.trial184:Power on completed 2026-02-13T21:59:21.654 INFO:teuthology.provision.fog.trial012:Waiting for deploy to finish 2026-02-13T21:59:21.661 INFO:teuthology.provision.fog.trial143:Waiting for deploy to finish 2026-02-13T21:59:21.669 INFO:teuthology.provision.fog.trial184:Waiting for deploy to finish 2026-02-13T22:01:09.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:09.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:12.221 WARNING:teuthology.provision.fog.trial143:[Errno None] Unable to connect to port 22 on 10.20.193.143 2026-02-13T22:01:18.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:21.309 WARNING:teuthology.provision.fog.trial143:[Errno None] Unable to connect to port 22 on 10.20.193.143 2026-02-13T22:01:24.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:27.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:27.517 WARNING:teuthology.provision.fog.trial184:[Errno None] Unable to connect to port 22 on 10.20.193.184 2026-02-13T22:01:30.397 WARNING:teuthology.provision.fog.trial143:[Errno None] Unable to connect to port 22 on 10.20.193.143 2026-02-13T22:01:33.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:36.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:36.605 WARNING:teuthology.provision.fog.trial184:[Errno None] Unable to connect to port 22 on 10.20.193.184 2026-02-13T22:01:39.486 WARNING:teuthology.provision.fog.trial143:[Errno None] Unable to connect to port 22 on 10.20.193.143 2026-02-13T22:01:42.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:45.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:45.693 WARNING:teuthology.provision.fog.trial184:[Errno None] Unable to connect to port 22 on 10.20.193.184 2026-02-13T22:01:48.573 WARNING:teuthology.provision.fog.trial143:[Errno None] Unable to connect to port 22 on 10.20.193.143 2026-02-13T22:01:51.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:54.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:01:54.781 WARNING:teuthology.provision.fog.trial184:[Errno None] Unable to connect to port 22 on 10.20.193.184 2026-02-13T22:02:00.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:02:03.869 WARNING:teuthology.provision.fog.trial184:[Errno None] Unable to connect to port 22 on 10.20.193.184 2026-02-13T22:02:09.151 WARNING:teuthology.provision.fog.trial012:timed out 2026-02-13T22:02:09.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:02:12.958 WARNING:teuthology.provision.fog.trial184:[Errno None] Unable to connect to port 22 on 10.20.193.184 2026-02-13T22:02:15.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:02:18.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:02:20.396 ERROR:teuthology.orchestra.connection:Error authenticating with trial012.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T22:02:22.045 WARNING:teuthology.provision.fog.trial184:[Errno None] Unable to connect to port 22 on 10.20.193.184 2026-02-13T22:02:24.477 ERROR:teuthology.orchestra.connection:Error authenticating with trial012.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-13T22:02:28.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:02:30.543 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T22:02:30.544 DEBUG:teuthology.orchestra.run.trial143:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T22:02:30.714 INFO:teuthology.provision.fog.trial143:Node is ready 2026-02-13T22:02:30.714 DEBUG:teuthology.orchestra.run.trial143:> hostname 2026-02-13T22:02:30.771 INFO:teuthology.orchestra.run.trial143.stdout:trial143.front.sepia.ceph.com 2026-02-13T22:02:30.772 DEBUG:teuthology.orchestra.run.trial143:> grep trial143.front.sepia.ceph.com /etc/hosts 2026-02-13T22:02:30.829 INFO:teuthology.orchestra.run.trial143.stdout:10.20.193.143 trial143.front.sepia.ceph.com trial143 2026-02-13T22:02:30.830 DEBUG:teuthology.orchestra.run.trial143:> sudo hostname trial143 2026-02-13T22:02:30.900 DEBUG:teuthology.orchestra.run.trial143:> sudo sed -i -e 's/trial143.front.sepia.ceph.com/trial143/g' /etc/hosts 2026-02-13T22:02:30.970 DEBUG:teuthology.orchestra.run.trial143:> sudo sed -i -e 's/10.20.193.143/10.20.193.143/g' /etc/hosts 2026-02-13T22:02:31.035 DEBUG:teuthology.orchestra.run.trial143:> sudo sed -i -e 's/trial143.front.sepia.ceph.com/trial143/g' /etc/hostname 2026-02-13T22:02:31.101 DEBUG:teuthology.orchestra.run.trial143:> sudo hostname trial143 2026-02-13T22:02:31.168 DEBUG:teuthology.orchestra.run.trial143:> cat /etc/os-release 2026-02-13T22:02:31.227 INFO:teuthology.orchestra.run.trial143.stdout:NAME="CentOS Stream" 2026-02-13T22:02:31.227 INFO:teuthology.orchestra.run.trial143.stdout:VERSION="9" 2026-02-13T22:02:31.227 INFO:teuthology.orchestra.run.trial143.stdout:ID="centos" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:ID_LIKE="rhel fedora" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:VERSION_ID="9" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:PLATFORM_ID="platform:el9" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:ANSI_COLOR="0;31" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:LOGO="fedora-logo-icon" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:HOME_URL="https://centos.org/" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T22:02:31.228 INFO:teuthology.orchestra.run.trial143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T22:02:31.230 INFO:teuthology.provision.fog.trial143:Deploy complete! 2026-02-13T22:02:31.231 DEBUG:teuthology.parallel:result is None 2026-02-13T22:02:31.589 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T22:02:31.589 DEBUG:teuthology.orchestra.run.trial012:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T22:02:31.746 INFO:teuthology.provision.fog.trial012:Node is ready 2026-02-13T22:02:31.746 DEBUG:teuthology.orchestra.run.trial012:> hostname 2026-02-13T22:02:31.799 INFO:teuthology.orchestra.run.trial012.stdout:trial012.front.sepia.ceph.com 2026-02-13T22:02:31.800 DEBUG:teuthology.orchestra.run.trial012:> grep trial012.front.sepia.ceph.com /etc/hosts 2026-02-13T22:02:31.853 INFO:teuthology.orchestra.run.trial012.stdout:10.20.193.12 trial012.front.sepia.ceph.com trial012 2026-02-13T22:02:31.853 DEBUG:teuthology.orchestra.run.trial012:> sudo hostname trial012 2026-02-13T22:02:31.922 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/trial012.front.sepia.ceph.com/trial012/g' /etc/hosts 2026-02-13T22:02:31.987 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/10.20.193.12/10.20.193.12/g' /etc/hosts 2026-02-13T22:02:32.048 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/trial012.front.sepia.ceph.com/trial012/g' /etc/hostname 2026-02-13T22:02:32.112 DEBUG:teuthology.orchestra.run.trial012:> sudo hostname trial012 2026-02-13T22:02:32.173 DEBUG:teuthology.orchestra.run.trial012:> cat /etc/os-release 2026-02-13T22:02:32.228 INFO:teuthology.orchestra.run.trial012.stdout:NAME="CentOS Stream" 2026-02-13T22:02:32.228 INFO:teuthology.orchestra.run.trial012.stdout:VERSION="9" 2026-02-13T22:02:32.228 INFO:teuthology.orchestra.run.trial012.stdout:ID="centos" 2026-02-13T22:02:32.228 INFO:teuthology.orchestra.run.trial012.stdout:ID_LIKE="rhel fedora" 2026-02-13T22:02:32.228 INFO:teuthology.orchestra.run.trial012.stdout:VERSION_ID="9" 2026-02-13T22:02:32.228 INFO:teuthology.orchestra.run.trial012.stdout:PLATFORM_ID="platform:el9" 2026-02-13T22:02:32.228 INFO:teuthology.orchestra.run.trial012.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T22:02:32.229 INFO:teuthology.orchestra.run.trial012.stdout:ANSI_COLOR="0;31" 2026-02-13T22:02:32.229 INFO:teuthology.orchestra.run.trial012.stdout:LOGO="fedora-logo-icon" 2026-02-13T22:02:32.229 INFO:teuthology.orchestra.run.trial012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T22:02:32.229 INFO:teuthology.orchestra.run.trial012.stdout:HOME_URL="https://centos.org/" 2026-02-13T22:02:32.229 INFO:teuthology.orchestra.run.trial012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T22:02:32.229 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T22:02:32.229 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T22:02:32.229 INFO:teuthology.provision.fog.trial012:Deploy complete! 2026-02-13T22:02:32.229 DEBUG:teuthology.parallel:result is None 2026-02-13T22:03:03.839 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T22:03:03.840 DEBUG:teuthology.orchestra.run.trial184:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T22:03:03.994 INFO:teuthology.provision.fog.trial184:Node is ready 2026-02-13T22:03:03.994 DEBUG:teuthology.orchestra.run.trial184:> hostname 2026-02-13T22:03:04.050 INFO:teuthology.orchestra.run.trial184.stdout:trial184.front.sepia.ceph.com 2026-02-13T22:03:04.050 DEBUG:teuthology.orchestra.run.trial184:> grep trial184.front.sepia.ceph.com /etc/hosts 2026-02-13T22:03:04.106 INFO:teuthology.orchestra.run.trial184.stdout:10.20.193.184 trial184.front.sepia.ceph.com trial184 2026-02-13T22:03:04.107 DEBUG:teuthology.orchestra.run.trial184:> sudo hostname trial184 2026-02-13T22:03:04.177 DEBUG:teuthology.orchestra.run.trial184:> sudo sed -i -e 's/trial184.front.sepia.ceph.com/trial184/g' /etc/hosts 2026-02-13T22:03:04.241 DEBUG:teuthology.orchestra.run.trial184:> sudo sed -i -e 's/10.20.193.184/10.20.193.184/g' /etc/hosts 2026-02-13T22:03:04.306 DEBUG:teuthology.orchestra.run.trial184:> sudo sed -i -e 's/trial184.front.sepia.ceph.com/trial184/g' /etc/hostname 2026-02-13T22:03:04.371 DEBUG:teuthology.orchestra.run.trial184:> sudo hostname trial184 2026-02-13T22:03:04.434 DEBUG:teuthology.orchestra.run.trial184:> cat /etc/os-release 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:NAME="CentOS Stream" 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:VERSION="9" 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:ID="centos" 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:ID_LIKE="rhel fedora" 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:VERSION_ID="9" 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:PLATFORM_ID="platform:el9" 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:ANSI_COLOR="0;31" 2026-02-13T22:03:04.489 INFO:teuthology.orchestra.run.trial184.stdout:LOGO="fedora-logo-icon" 2026-02-13T22:03:04.490 INFO:teuthology.orchestra.run.trial184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T22:03:04.490 INFO:teuthology.orchestra.run.trial184.stdout:HOME_URL="https://centos.org/" 2026-02-13T22:03:04.490 INFO:teuthology.orchestra.run.trial184.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T22:03:04.490 INFO:teuthology.orchestra.run.trial184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T22:03:04.490 INFO:teuthology.orchestra.run.trial184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T22:03:04.490 INFO:teuthology.provision.fog.trial184:Deploy complete! 2026-02-13T22:03:04.490 DEBUG:teuthology.parallel:result is None 2026-02-13T22:03:05.015 INFO:teuthology.lock.ops:Checking trial012.front.sepia.ceph.com 2026-02-13T22:03:05.016 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T22:03:05.124 INFO:teuthology.lock.ops:Checking trial143.front.sepia.ceph.com 2026-02-13T22:03:05.124 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T22:03:05.191 INFO:teuthology.lock.ops:Checking trial184.front.sepia.ceph.com 2026-02-13T22:03:05.192 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T22:03:05.251 INFO:teuthology.lock.ops:Updating [trial012.front.sepia.ceph.com]: set os type and version on server 2026-02-13T22:03:05.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-13T22:03:05.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:03:05.314 DEBUG:teuthology.orchestra.run.trial012:> true 2026-02-13T22:03:05.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-13T22:03:05.395 DEBUG:teuthology.orchestra.run.trial012:> uname -m 2026-02-13T22:03:05.452 INFO:teuthology.orchestra.run.trial012.stdout:x86_64 2026-02-13T22:03:05.453 DEBUG:teuthology.orchestra.run.trial012:> cat /etc/os-release 2026-02-13T22:03:05.509 INFO:teuthology.orchestra.run.trial012.stdout:NAME="CentOS Stream" 2026-02-13T22:03:05.509 INFO:teuthology.orchestra.run.trial012.stdout:VERSION="9" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:ID="centos" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:ID_LIKE="rhel fedora" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:VERSION_ID="9" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:PLATFORM_ID="platform:el9" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:ANSI_COLOR="0;31" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:LOGO="fedora-logo-icon" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:HOME_URL="https://centos.org/" 2026-02-13T22:03:05.510 INFO:teuthology.orchestra.run.trial012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T22:03:05.511 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T22:03:05.511 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T22:03:05.511 INFO:teuthology.lock.ops:Updating trial012.front.sepia.ceph.com on lock server 2026-02-13T22:03:05.616 INFO:teuthology.lock.ops:Updating [trial143.front.sepia.ceph.com]: set os type and version on server 2026-02-13T22:03:05.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial143.front.sepia.ceph.com' 2026-02-13T22:03:05.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:03:05.688 DEBUG:teuthology.orchestra.run.trial143:> true 2026-02-13T22:03:05.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial143.front.sepia.ceph.com' 2026-02-13T22:03:05.828 DEBUG:teuthology.orchestra.run.trial143:> uname -m 2026-02-13T22:03:05.884 INFO:teuthology.orchestra.run.trial143.stdout:x86_64 2026-02-13T22:03:05.885 DEBUG:teuthology.orchestra.run.trial143:> cat /etc/os-release 2026-02-13T22:03:05.941 INFO:teuthology.orchestra.run.trial143.stdout:NAME="CentOS Stream" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:VERSION="9" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:ID="centos" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:ID_LIKE="rhel fedora" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:VERSION_ID="9" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:PLATFORM_ID="platform:el9" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:ANSI_COLOR="0;31" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:LOGO="fedora-logo-icon" 2026-02-13T22:03:05.942 INFO:teuthology.orchestra.run.trial143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T22:03:05.943 INFO:teuthology.orchestra.run.trial143.stdout:HOME_URL="https://centos.org/" 2026-02-13T22:03:05.943 INFO:teuthology.orchestra.run.trial143.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T22:03:05.943 INFO:teuthology.orchestra.run.trial143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T22:03:05.943 INFO:teuthology.orchestra.run.trial143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T22:03:05.943 INFO:teuthology.lock.ops:Updating trial143.front.sepia.ceph.com on lock server 2026-02-13T22:03:06.047 INFO:teuthology.lock.ops:Updating [trial184.front.sepia.ceph.com]: set os type and version on server 2026-02-13T22:03:06.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial184.front.sepia.ceph.com' 2026-02-13T22:03:06.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T22:03:06.115 DEBUG:teuthology.orchestra.run.trial184:> true 2026-02-13T22:03:06.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial184.front.sepia.ceph.com' 2026-02-13T22:03:06.190 DEBUG:teuthology.orchestra.run.trial184:> uname -m 2026-02-13T22:03:06.247 INFO:teuthology.orchestra.run.trial184.stdout:x86_64 2026-02-13T22:03:06.248 DEBUG:teuthology.orchestra.run.trial184:> cat /etc/os-release 2026-02-13T22:03:06.304 INFO:teuthology.orchestra.run.trial184.stdout:NAME="CentOS Stream" 2026-02-13T22:03:06.304 INFO:teuthology.orchestra.run.trial184.stdout:VERSION="9" 2026-02-13T22:03:06.304 INFO:teuthology.orchestra.run.trial184.stdout:ID="centos" 2026-02-13T22:03:06.304 INFO:teuthology.orchestra.run.trial184.stdout:ID_LIKE="rhel fedora" 2026-02-13T22:03:06.304 INFO:teuthology.orchestra.run.trial184.stdout:VERSION_ID="9" 2026-02-13T22:03:06.304 INFO:teuthology.orchestra.run.trial184.stdout:PLATFORM_ID="platform:el9" 2026-02-13T22:03:06.305 INFO:teuthology.orchestra.run.trial184.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T22:03:06.305 INFO:teuthology.orchestra.run.trial184.stdout:ANSI_COLOR="0;31" 2026-02-13T22:03:06.305 INFO:teuthology.orchestra.run.trial184.stdout:LOGO="fedora-logo-icon" 2026-02-13T22:03:06.305 INFO:teuthology.orchestra.run.trial184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T22:03:06.305 INFO:teuthology.orchestra.run.trial184.stdout:HOME_URL="https://centos.org/" 2026-02-13T22:03:06.305 INFO:teuthology.orchestra.run.trial184.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T22:03:06.305 INFO:teuthology.orchestra.run.trial184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T22:03:06.305 INFO:teuthology.orchestra.run.trial184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T22:03:06.306 INFO:teuthology.lock.ops:Updating trial184.front.sepia.ceph.com on lock server 2026-02-13T22:03:06.410 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:03:06.516 INFO:teuthology.dispatcher.supervisor:Running job 50178 2026-02-13T22:03:06.516 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50178 --name pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50178/orig.config.yaml 2026-02-13T22:03:06.516 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50178 2026-02-13T22:03:06.516 INFO:teuthology.dispatcher.supervisor:Job PID: 265593 2026-02-13T22:03:06.516 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-13T22:05:06.517 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:05:58.813 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-13T22:07:06.702 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:09:06.924 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:11:07.115 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:13:07.301 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:15:07.475 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:17:07.629 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:19:07.807 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T22:19:07.900 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-13T22:19:08.093 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-13T22:19:08.855 INFO:teuthology.orchestra.console.trial012:Power off 2026-02-13T22:19:08.855 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T22:19:08.866 INFO:teuthology.orchestra.console.trial184:Power off 2026-02-13T22:19:08.867 DEBUG:teuthology.orchestra.console.trial184:pexpect command: ipmitool -H trial184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T22:19:08.878 INFO:teuthology.orchestra.console.trial143:Power off 2026-02-13T22:19:08.878 DEBUG:teuthology.orchestra.console.trial143:pexpect command: ipmitool -H trial143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T22:19:08.893 DEBUG:teuthology.orchestra.console.trial012:power off output: Chassis Power Control: Down/Off 2026-02-13T22:19:08.908 DEBUG:teuthology.orchestra.console.trial184:power off output: Chassis Power Control: Down/Off 2026-02-13T22:19:08.916 DEBUG:teuthology.orchestra.console.trial143:power off output: Chassis Power Control: Down/Off 2026-02-13T22:19:12.897 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T22:19:12.909 DEBUG:teuthology.orchestra.console.trial184:pexpect command: ipmitool -H trial184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T22:19:12.916 DEBUG:teuthology.orchestra.console.trial143:pexpect command: ipmitool -H trial143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T22:19:13.006 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is on 2026-02-13T22:19:13.017 DEBUG:teuthology.orchestra.console.trial184:check power output: Chassis Power is on 2026-02-13T22:19:13.022 DEBUG:teuthology.orchestra.console.trial143:check power output: Chassis Power is on 2026-02-13T22:19:17.011 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T22:19:17.018 DEBUG:teuthology.orchestra.console.trial184:pexpect command: ipmitool -H trial184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T22:19:17.024 DEBUG:teuthology.orchestra.console.trial143:pexpect command: ipmitool -H trial143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T22:19:17.120 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is off 2026-02-13T22:19:17.121 INFO:teuthology.orchestra.console.trial012:Power off completed 2026-02-13T22:19:17.126 DEBUG:teuthology.orchestra.console.trial184:check power output: Chassis Power is off 2026-02-13T22:19:17.127 INFO:teuthology.orchestra.console.trial184:Power off completed 2026-02-13T22:19:17.132 DEBUG:teuthology.orchestra.console.trial143:check power output: Chassis Power is off 2026-02-13T22:19:17.133 INFO:teuthology.orchestra.console.trial143:Power off completed 2026-02-13T22:19:17.418 INFO:teuthology.lock.ops:unlocked: trial012.front.sepia.ceph.com 2026-02-13T22:19:17.428 INFO:teuthology.lock.ops:unlocked: trial184.front.sepia.ceph.com 2026-02-13T22:19:17.432 INFO:teuthology.lock.ops:unlocked: trial143.front.sepia.ceph.com