2026-02-19T21:21:03.012 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-19T21:21:03.013 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T21:21:03.086 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T21:21:03.343 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ab14a098f40>, signals=[15]) 2026-02-19T21:21:03.343 INFO:teuthology.lock.ops:Start node 'trial105.front.sepia.ceph.com' reimaging 2026-02-19T21:21:03.343 INFO:teuthology.lock.ops:Updating [trial105.front.sepia.ceph.com]: reset os type and version on server 2026-02-19T21:21:03.343 INFO:teuthology.lock.ops:Updating trial105.front.sepia.ceph.com on lock server 2026-02-19T21:21:03.547 INFO:teuthology.lock.ops:Start node 'trial133.front.sepia.ceph.com' reimaging 2026-02-19T21:21:03.548 INFO:teuthology.lock.ops:Updating [trial133.front.sepia.ceph.com]: reset os type and version on server 2026-02-19T21:21:03.548 INFO:teuthology.lock.ops:Updating trial133.front.sepia.ceph.com on lock server 2026-02-19T21:21:03.607 INFO:teuthology.lock.ops:Start node 'trial151.front.sepia.ceph.com' reimaging 2026-02-19T21:21:03.607 INFO:teuthology.lock.ops:Updating [trial151.front.sepia.ceph.com]: reset os type and version on server 2026-02-19T21:21:03.607 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server 2026-02-19T21:21:03.845 DEBUG:teuthology.provision.fog.trial105:Requesting image trial_rocky_10.1 (ID 4) 2026-02-19T21:21:03.845 DEBUG:teuthology.provision.fog.trial133:Requesting image trial_rocky_10.1 (ID 4) 2026-02-19T21:21:03.899 INFO:teuthology.provision.fog.trial133:Scheduling deploy of rocky 10.1 2026-02-19T21:21:03.901 DEBUG:teuthology.provision.fog.trial151:Requesting image trial_rocky_10.1 (ID 4) 2026-02-19T21:21:03.902 INFO:teuthology.provision.fog.trial105:Scheduling deploy of rocky 10.1 2026-02-19T21:21:03.955 INFO:teuthology.provision.fog.trial151:Scheduling deploy of rocky 10.1 2026-02-19T21:21:05.311 INFO:teuthology.orchestra.console.trial133:Power off 2026-02-19T21:21:05.311 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T21:21:05.323 INFO:teuthology.orchestra.console.trial105:Power off 2026-02-19T21:21:05.323 DEBUG:teuthology.orchestra.console.trial105:pexpect command: ipmitool -H trial105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T21:21:05.331 INFO:teuthology.orchestra.console.trial151:Power off 2026-02-19T21:21:05.331 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T21:21:05.349 DEBUG:teuthology.orchestra.console.trial133:power off output: Chassis Power Control: Down/Off 2026-02-19T21:21:05.358 DEBUG:teuthology.orchestra.console.trial105:power off output: Chassis Power Control: Down/Off 2026-02-19T21:21:05.368 DEBUG:teuthology.orchestra.console.trial151:power off output: Chassis Power Control: Down/Off 2026-02-19T21:21:09.354 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:21:09.360 DEBUG:teuthology.orchestra.console.trial105:pexpect command: ipmitool -H trial105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:21:09.369 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:21:09.463 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is off 2026-02-19T21:21:09.463 INFO:teuthology.orchestra.console.trial133:Power off completed 2026-02-19T21:21:09.467 DEBUG:teuthology.orchestra.console.trial105:check power output: Chassis Power is off 2026-02-19T21:21:09.467 INFO:teuthology.orchestra.console.trial105:Power off completed 2026-02-19T21:21:09.478 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is off 2026-02-19T21:21:09.478 INFO:teuthology.orchestra.console.trial151:Power off completed 2026-02-19T21:21:09.564 INFO:teuthology.orchestra.console.trial133:Power on 2026-02-19T21:21:09.565 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-19T21:21:09.575 INFO:teuthology.orchestra.console.trial105:Power on 2026-02-19T21:21:09.575 DEBUG:teuthology.orchestra.console.trial105:pexpect command: ipmitool -H trial105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-19T21:21:09.584 INFO:teuthology.orchestra.console.trial151:Power on 2026-02-19T21:21:09.585 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-19T21:21:09.609 DEBUG:teuthology.orchestra.console.trial133:power on output: Chassis Power Control: Up/On 2026-02-19T21:21:09.627 DEBUG:teuthology.orchestra.console.trial105:power on output: Chassis Power Control: Up/On 2026-02-19T21:21:09.698 DEBUG:teuthology.orchestra.console.trial151:power on output: Chassis Power Control: Up/On 2026-02-19T21:21:13.614 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:21:13.628 DEBUG:teuthology.orchestra.console.trial105:pexpect command: ipmitool -H trial105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:21:13.700 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:21:13.723 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is on 2026-02-19T21:21:13.724 INFO:teuthology.orchestra.console.trial133:Power on completed 2026-02-19T21:21:13.735 DEBUG:teuthology.orchestra.console.trial105:check power output: Chassis Power is on 2026-02-19T21:21:13.736 INFO:teuthology.orchestra.console.trial105:Power on completed 2026-02-19T21:21:13.808 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is on 2026-02-19T21:21:13.808 INFO:teuthology.orchestra.console.trial151:Power on completed 2026-02-19T21:21:13.824 INFO:teuthology.provision.fog.trial133:Waiting for deploy to finish 2026-02-19T21:21:13.837 INFO:teuthology.provision.fog.trial105:Waiting for deploy to finish 2026-02-19T21:21:13.909 INFO:teuthology.provision.fog.trial151:Waiting for deploy to finish 2026-02-19T21:23:01.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:01.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:01.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:01.842 ERROR:teuthology.orchestra.connection:Error authenticating with trial151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2026-02-19T21:23:04.768 WARNING:teuthology.provision.fog.trial105:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-19T21:23:04.768 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-19T21:23:10.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:10.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:13.856 WARNING:teuthology.provision.fog.trial105:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-19T21:23:13.856 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-19T21:23:19.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:19.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:22.944 WARNING:teuthology.provision.fog.trial105:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-19T21:23:22.944 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-19T21:23:28.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:28.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:32.032 WARNING:teuthology.provision.fog.trial105:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-19T21:23:32.032 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-19T21:23:38.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:38.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:41.120 WARNING:teuthology.provision.fog.trial105:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-19T21:23:41.120 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133 2026-02-19T21:23:47.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:23:47.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:24:05.847 WARNING:teuthology.provision.fog.trial151:timed out 2026-02-19T21:24:11.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:24:23.172 ERROR:teuthology.orchestra.connection:Error authenticating with trial133.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-19T21:24:23.194 ERROR:teuthology.orchestra.connection:Error authenticating with trial105.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-19T21:24:27.278 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-19T21:24:27.279 DEBUG:teuthology.orchestra.run.trial133:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-19T21:24:27.287 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-19T21:24:27.287 DEBUG:teuthology.orchestra.run.trial105:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-19T21:24:31.355 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-19T21:24:31.355 DEBUG:teuthology.orchestra.run.trial151:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-19T21:24:31.544 INFO:teuthology.provision.fog.trial151:Node is ready 2026-02-19T21:24:31.544 DEBUG:teuthology.orchestra.run.trial151:> hostname 2026-02-19T21:24:31.601 INFO:teuthology.orchestra.run.trial151.stdout:trial151.front.sepia.ceph.com 2026-02-19T21:24:31.601 DEBUG:teuthology.orchestra.run.trial151:> grep trial151.front.sepia.ceph.com /etc/hosts 2026-02-19T21:24:31.658 INFO:teuthology.orchestra.run.trial151.stdout:10.20.193.151 trial151.front.sepia.ceph.com trial151 2026-02-19T21:24:31.659 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname trial151 2026-02-19T21:24:31.732 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/trial151.front.sepia.ceph.com/trial151/g' /etc/hosts 2026-02-19T21:24:31.798 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/10.20.193.151/10.20.193.151/g' /etc/hosts 2026-02-19T21:24:31.864 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/trial151.front.sepia.ceph.com/trial151/g' /etc/hostname 2026-02-19T21:24:31.931 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname trial151 2026-02-19T21:24:31.997 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release 2026-02-19T21:24:32.053 INFO:teuthology.orchestra.run.trial151.stdout:NAME="Rocky Linux" 2026-02-19T21:24:32.054 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T21:24:32.054 INFO:teuthology.orchestra.run.trial151.stdout:ID="rocky" 2026-02-19T21:24:32.054 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T21:24:32.054 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="10.1" 2026-02-19T21:24:32.054 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el10" 2026-02-19T21:24:32.054 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T21:24:32.054 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;32" 2026-02-19T21:24:32.054 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:VENDOR_NAME="RESF" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:SUPPORT_END="2035-05-31" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T21:24:32.055 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:32.056 INFO:teuthology.provision.fog.trial151:Deploy complete! 2026-02-19T21:24:32.057 DEBUG:teuthology.parallel:result is None 2026-02-19T21:24:32.322 INFO:teuthology.provision.fog.trial105:Node is ready 2026-02-19T21:24:32.322 DEBUG:teuthology.orchestra.run.trial105:> hostname 2026-02-19T21:24:32.339 INFO:teuthology.orchestra.run.trial105.stdout:trial105.front.sepia.ceph.com 2026-02-19T21:24:32.339 DEBUG:teuthology.orchestra.run.trial105:> grep trial105.front.sepia.ceph.com /etc/hosts 2026-02-19T21:24:32.352 INFO:teuthology.provision.fog.trial133:Node is ready 2026-02-19T21:24:32.352 DEBUG:teuthology.orchestra.run.trial133:> hostname 2026-02-19T21:24:32.369 INFO:teuthology.orchestra.run.trial133.stdout:trial133.front.sepia.ceph.com 2026-02-19T21:24:32.369 DEBUG:teuthology.orchestra.run.trial133:> grep trial133.front.sepia.ceph.com /etc/hosts 2026-02-19T21:24:32.393 INFO:teuthology.orchestra.run.trial105.stdout:10.20.193.105 trial105.front.sepia.ceph.com trial105 2026-02-19T21:24:32.393 DEBUG:teuthology.orchestra.run.trial105:> sudo hostname trial105 2026-02-19T21:24:32.427 INFO:teuthology.orchestra.run.trial133.stdout:10.20.193.133 trial133.front.sepia.ceph.com trial133 2026-02-19T21:24:32.427 DEBUG:teuthology.orchestra.run.trial133:> sudo hostname trial133 2026-02-19T21:24:32.463 DEBUG:teuthology.orchestra.run.trial105:> sudo sed -i -e 's/trial105.front.sepia.ceph.com/trial105/g' /etc/hosts 2026-02-19T21:24:32.500 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/trial133.front.sepia.ceph.com/trial133/g' /etc/hosts 2026-02-19T21:24:32.527 DEBUG:teuthology.orchestra.run.trial105:> sudo sed -i -e 's/10.20.193.105/10.20.193.105/g' /etc/hosts 2026-02-19T21:24:32.567 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/10.20.193.133/10.20.193.133/g' /etc/hosts 2026-02-19T21:24:32.590 DEBUG:teuthology.orchestra.run.trial105:> sudo sed -i -e 's/trial105.front.sepia.ceph.com/trial105/g' /etc/hostname 2026-02-19T21:24:32.633 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/trial133.front.sepia.ceph.com/trial133/g' /etc/hostname 2026-02-19T21:24:32.654 DEBUG:teuthology.orchestra.run.trial105:> sudo hostname trial105 2026-02-19T21:24:32.702 DEBUG:teuthology.orchestra.run.trial133:> sudo hostname trial133 2026-02-19T21:24:32.717 DEBUG:teuthology.orchestra.run.trial105:> cat /etc/os-release 2026-02-19T21:24:32.768 DEBUG:teuthology.orchestra.run.trial133:> cat /etc/os-release 2026-02-19T21:24:32.771 INFO:teuthology.orchestra.run.trial105.stdout:NAME="Rocky Linux" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:ID="rocky" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:VERSION_ID="10.1" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:PLATFORM_ID="platform:el10" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:ANSI_COLOR="0;32" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:LOGO="fedora-logo-icon" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T21:24:32.772 INFO:teuthology.orchestra.run.trial105.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T21:24:32.773 INFO:teuthology.orchestra.run.trial105.stdout:VENDOR_NAME="RESF" 2026-02-19T21:24:32.773 INFO:teuthology.orchestra.run.trial105.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T21:24:32.773 INFO:teuthology.orchestra.run.trial105.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T21:24:32.773 INFO:teuthology.orchestra.run.trial105.stdout:SUPPORT_END="2035-05-31" 2026-02-19T21:24:32.773 INFO:teuthology.orchestra.run.trial105.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T21:24:32.773 INFO:teuthology.orchestra.run.trial105.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:32.773 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T21:24:32.773 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:32.774 INFO:teuthology.provision.fog.trial105:Deploy complete! 2026-02-19T21:24:32.774 DEBUG:teuthology.parallel:result is None 2026-02-19T21:24:32.827 INFO:teuthology.orchestra.run.trial133.stdout:NAME="Rocky Linux" 2026-02-19T21:24:32.827 INFO:teuthology.orchestra.run.trial133.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T21:24:32.827 INFO:teuthology.orchestra.run.trial133.stdout:ID="rocky" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:VERSION_ID="10.1" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:PLATFORM_ID="platform:el10" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:ANSI_COLOR="0;32" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:LOGO="fedora-logo-icon" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:VENDOR_NAME="RESF" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T21:24:32.828 INFO:teuthology.orchestra.run.trial133.stdout:SUPPORT_END="2035-05-31" 2026-02-19T21:24:32.829 INFO:teuthology.orchestra.run.trial133.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T21:24:32.829 INFO:teuthology.orchestra.run.trial133.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:32.829 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T21:24:32.829 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:32.829 INFO:teuthology.provision.fog.trial133:Deploy complete! 2026-02-19T21:24:32.830 DEBUG:teuthology.parallel:result is None 2026-02-19T21:24:33.347 INFO:teuthology.lock.ops:Checking trial105.front.sepia.ceph.com 2026-02-19T21:24:33.348 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-19T21:24:33.455 INFO:teuthology.lock.ops:Checking trial133.front.sepia.ceph.com 2026-02-19T21:24:33.455 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-19T21:24:33.521 INFO:teuthology.lock.ops:Checking trial151.front.sepia.ceph.com 2026-02-19T21:24:33.521 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-19T21:24:33.578 INFO:teuthology.lock.ops:Updating [trial105.front.sepia.ceph.com]: set os type and version on server 2026-02-19T21:24:33.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-19T21:24:33.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:24:33.638 DEBUG:teuthology.orchestra.run.trial105:> true 2026-02-19T21:24:33.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-19T21:24:33.717 DEBUG:teuthology.orchestra.run.trial105:> uname -m 2026-02-19T21:24:33.772 INFO:teuthology.orchestra.run.trial105.stdout:x86_64 2026-02-19T21:24:33.772 DEBUG:teuthology.orchestra.run.trial105:> cat /etc/os-release 2026-02-19T21:24:33.827 INFO:teuthology.orchestra.run.trial105.stdout:NAME="Rocky Linux" 2026-02-19T21:24:33.827 INFO:teuthology.orchestra.run.trial105.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T21:24:33.827 INFO:teuthology.orchestra.run.trial105.stdout:ID="rocky" 2026-02-19T21:24:33.827 INFO:teuthology.orchestra.run.trial105.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T21:24:33.827 INFO:teuthology.orchestra.run.trial105.stdout:VERSION_ID="10.1" 2026-02-19T21:24:33.827 INFO:teuthology.orchestra.run.trial105.stdout:PLATFORM_ID="platform:el10" 2026-02-19T21:24:33.827 INFO:teuthology.orchestra.run.trial105.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T21:24:33.827 INFO:teuthology.orchestra.run.trial105.stdout:ANSI_COLOR="0;32" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:LOGO="fedora-logo-icon" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:VENDOR_NAME="RESF" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:SUPPORT_END="2035-05-31" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T21:24:33.828 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:33.829 INFO:teuthology.lock.ops:Updating trial105.front.sepia.ceph.com on lock server 2026-02-19T21:24:33.933 INFO:teuthology.lock.ops:Updating [trial133.front.sepia.ceph.com]: set os type and version on server 2026-02-19T21:24:33.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-19T21:24:33.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:24:34.004 DEBUG:teuthology.orchestra.run.trial133:> true 2026-02-19T21:24:34.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com' 2026-02-19T21:24:34.082 DEBUG:teuthology.orchestra.run.trial133:> uname -m 2026-02-19T21:24:34.140 INFO:teuthology.orchestra.run.trial133.stdout:x86_64 2026-02-19T21:24:34.141 DEBUG:teuthology.orchestra.run.trial133:> cat /etc/os-release 2026-02-19T21:24:34.197 INFO:teuthology.orchestra.run.trial133.stdout:NAME="Rocky Linux" 2026-02-19T21:24:34.197 INFO:teuthology.orchestra.run.trial133.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T21:24:34.198 INFO:teuthology.orchestra.run.trial133.stdout:ID="rocky" 2026-02-19T21:24:34.198 INFO:teuthology.orchestra.run.trial133.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T21:24:34.198 INFO:teuthology.orchestra.run.trial133.stdout:VERSION_ID="10.1" 2026-02-19T21:24:34.198 INFO:teuthology.orchestra.run.trial133.stdout:PLATFORM_ID="platform:el10" 2026-02-19T21:24:34.198 INFO:teuthology.orchestra.run.trial133.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T21:24:34.198 INFO:teuthology.orchestra.run.trial133.stdout:ANSI_COLOR="0;32" 2026-02-19T21:24:34.198 INFO:teuthology.orchestra.run.trial133.stdout:LOGO="fedora-logo-icon" 2026-02-19T21:24:34.198 INFO:teuthology.orchestra.run.trial133.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:VENDOR_NAME="RESF" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:SUPPORT_END="2035-05-31" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T21:24:34.199 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:34.200 INFO:teuthology.lock.ops:Updating trial133.front.sepia.ceph.com on lock server 2026-02-19T21:24:34.311 INFO:teuthology.lock.ops:Updating [trial151.front.sepia.ceph.com]: set os type and version on server 2026-02-19T21:24:34.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial151.front.sepia.ceph.com' 2026-02-19T21:24:34.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:24:34.381 DEBUG:teuthology.orchestra.run.trial151:> true 2026-02-19T21:24:34.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial151.front.sepia.ceph.com' 2026-02-19T21:24:34.459 DEBUG:teuthology.orchestra.run.trial151:> uname -m 2026-02-19T21:24:34.516 INFO:teuthology.orchestra.run.trial151.stdout:x86_64 2026-02-19T21:24:34.516 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release 2026-02-19T21:24:34.574 INFO:teuthology.orchestra.run.trial151.stdout:NAME="Rocky Linux" 2026-02-19T21:24:34.575 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T21:24:34.575 INFO:teuthology.orchestra.run.trial151.stdout:ID="rocky" 2026-02-19T21:24:34.575 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T21:24:34.575 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="10.1" 2026-02-19T21:24:34.575 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el10" 2026-02-19T21:24:34.575 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T21:24:34.575 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;32" 2026-02-19T21:24:34.575 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:VENDOR_NAME="RESF" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:SUPPORT_END="2035-05-31" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T21:24:34.576 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T21:24:34.577 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server 2026-02-19T21:24:34.681 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T21:24:34.781 INFO:teuthology.dispatcher.supervisor:Running job 58428 2026-02-19T21:24:34.781 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58428 --name skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} distro kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58428/orig.config.yaml 2026-02-19T21:24:34.781 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58428 2026-02-19T21:24:34.781 INFO:teuthology.dispatcher.supervisor:Job PID: 1754066 2026-02-19T21:24:34.781 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-19T21:26:34.782 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T21:28:34.902 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T21:30:34.999 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T21:30:35.082 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2026-02-19T21:30:35.270 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-19T21:30:36.052 INFO:teuthology.orchestra.console.trial105:Power off 2026-02-19T21:30:36.052 DEBUG:teuthology.orchestra.console.trial105:pexpect command: ipmitool -H trial105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T21:30:36.068 INFO:teuthology.orchestra.console.trial133:Power off 2026-02-19T21:30:36.068 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T21:30:36.075 INFO:teuthology.orchestra.console.trial151:Power off 2026-02-19T21:30:36.076 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-19T21:30:36.096 DEBUG:teuthology.orchestra.console.trial105:power off output: Chassis Power Control: Down/Off 2026-02-19T21:30:36.107 DEBUG:teuthology.orchestra.console.trial133:power off output: Chassis Power Control: Down/Off 2026-02-19T21:30:36.117 DEBUG:teuthology.orchestra.console.trial151:power off output: Chassis Power Control: Down/Off 2026-02-19T21:30:40.097 DEBUG:teuthology.orchestra.console.trial105:pexpect command: ipmitool -H trial105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:30:40.108 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:30:40.118 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:30:40.208 DEBUG:teuthology.orchestra.console.trial105:check power output: Chassis Power is on 2026-02-19T21:30:40.218 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is on 2026-02-19T21:30:40.229 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is on 2026-02-19T21:30:44.208 DEBUG:teuthology.orchestra.console.trial105:pexpect command: ipmitool -H trial105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:30:44.219 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:30:44.230 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-19T21:30:44.317 DEBUG:teuthology.orchestra.console.trial105:check power output: Chassis Power is off 2026-02-19T21:30:44.318 INFO:teuthology.orchestra.console.trial105:Power off completed 2026-02-19T21:30:44.327 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is off 2026-02-19T21:30:44.327 INFO:teuthology.orchestra.console.trial133:Power off completed 2026-02-19T21:30:44.337 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is off 2026-02-19T21:30:44.337 INFO:teuthology.orchestra.console.trial151:Power off completed 2026-02-19T21:30:44.620 INFO:teuthology.lock.ops:unlocked: trial105.front.sepia.ceph.com 2026-02-19T21:30:44.628 INFO:teuthology.lock.ops:unlocked: trial133.front.sepia.ceph.com 2026-02-19T21:30:44.632 INFO:teuthology.lock.ops:unlocked: trial151.front.sepia.ceph.com