2026-02-25T15:12:37.757 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-25T15:12:37.757 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:12:37.829 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:12:40.601 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7edb10de3ad0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7edb10634d60>, signals=[15])
2026-02-25T15:12:40.601 INFO:teuthology.lock.ops:Start node 'trial021.front.sepia.ceph.com' reimaging
2026-02-25T15:12:40.601 INFO:teuthology.lock.ops:Updating [trial021.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T15:12:40.601 INFO:teuthology.lock.ops:Updating trial021.front.sepia.ceph.com on lock server
2026-02-25T15:12:40.657 INFO:teuthology.lock.ops:Start node 'trial123.front.sepia.ceph.com' reimaging
2026-02-25T15:12:40.657 INFO:teuthology.lock.ops:Updating [trial123.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T15:12:40.657 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server
2026-02-25T15:12:40.712 INFO:teuthology.lock.ops:Start node 'trial158.front.sepia.ceph.com' reimaging
2026-02-25T15:12:40.712 INFO:teuthology.lock.ops:Updating [trial158.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T15:12:40.712 INFO:teuthology.lock.ops:Updating trial158.front.sepia.ceph.com on lock server
2026-02-25T15:12:40.916 DEBUG:teuthology.provision.fog.trial021:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T15:12:40.951 DEBUG:teuthology.provision.fog.trial158:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T15:12:40.968 INFO:teuthology.provision.fog.trial021:Scheduling deploy of centos 9.stream
2026-02-25T15:12:41.002 INFO:teuthology.provision.fog.trial158:Scheduling deploy of centos 9.stream
2026-02-25T15:12:41.016 DEBUG:teuthology.provision.fog.trial123:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T15:12:41.074 INFO:teuthology.provision.fog.trial123:Scheduling deploy of centos 9.stream
2026-02-25T15:12:42.689 INFO:teuthology.orchestra.console.trial158:Power off
2026-02-25T15:12:42.689 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T15:12:42.709 INFO:teuthology.orchestra.console.trial123:Power off
2026-02-25T15:12:42.709 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T15:12:42.719 INFO:teuthology.orchestra.console.trial021:Power off
2026-02-25T15:12:42.719 DEBUG:teuthology.orchestra.console.trial021:pexpect command: ipmitool -H trial021.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T15:12:42.729 DEBUG:teuthology.orchestra.console.trial158:power off output: Chassis Power Control: Down/Off
2026-02-25T15:12:42.749 DEBUG:teuthology.orchestra.console.trial123:power off output: Chassis Power Control: Down/Off
2026-02-25T15:12:42.757 DEBUG:teuthology.orchestra.console.trial021:power off output: Chassis Power Control: Down/Off
2026-02-25T15:12:46.731 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:12:46.750 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:12:46.758 DEBUG:teuthology.orchestra.console.trial021:pexpect command: ipmitool -H trial021.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:12:46.841 DEBUG:teuthology.orchestra.console.trial158:check power output: Chassis Power is off
2026-02-25T15:12:46.842 INFO:teuthology.orchestra.console.trial158:Power off completed
2026-02-25T15:12:46.859 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is off
2026-02-25T15:12:46.860 INFO:teuthology.orchestra.console.trial123:Power off completed
2026-02-25T15:12:46.866 DEBUG:teuthology.orchestra.console.trial021:check power output: Chassis Power is off
2026-02-25T15:12:46.866 INFO:teuthology.orchestra.console.trial021:Power off completed
2026-02-25T15:12:46.943 INFO:teuthology.orchestra.console.trial158:Power on
2026-02-25T15:12:46.943 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T15:12:46.961 INFO:teuthology.orchestra.console.trial123:Power on
2026-02-25T15:12:46.961 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T15:12:46.970 INFO:teuthology.orchestra.console.trial021:Power on
2026-02-25T15:12:46.970 DEBUG:teuthology.orchestra.console.trial021:pexpect command: ipmitool -H trial021.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T15:12:46.985 DEBUG:teuthology.orchestra.console.trial158:power on output: Chassis Power Control: Up/On
2026-02-25T15:12:47.004 DEBUG:teuthology.orchestra.console.trial123:power on output: Chassis Power Control: Up/On
2026-02-25T15:12:47.013 DEBUG:teuthology.orchestra.console.trial021:power on output: Chassis Power Control: Up/On
2026-02-25T15:12:50.990 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:12:51.005 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:12:51.014 DEBUG:teuthology.orchestra.console.trial021:pexpect command: ipmitool -H trial021.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:12:51.102 DEBUG:teuthology.orchestra.console.trial158:check power output: Chassis Power is on
2026-02-25T15:12:51.102 INFO:teuthology.orchestra.console.trial158:Power on completed
2026-02-25T15:12:51.115 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is on
2026-02-25T15:12:51.115 INFO:teuthology.orchestra.console.trial123:Power on completed
2026-02-25T15:12:51.122 DEBUG:teuthology.orchestra.console.trial021:check power output: Chassis Power is on
2026-02-25T15:12:51.123 INFO:teuthology.orchestra.console.trial021:Power on completed
2026-02-25T15:12:51.203 INFO:teuthology.provision.fog.trial158:Waiting for deploy to finish
2026-02-25T15:12:51.216 INFO:teuthology.provision.fog.trial123:Waiting for deploy to finish
2026-02-25T15:12:51.223 INFO:teuthology.provision.fog.trial021:Waiting for deploy to finish
2026-02-25T15:14:39.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial021.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:14:39.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:14:39.906 ERROR:teuthology.orchestra.connection:Error authenticating with trial123.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-25T15:15:10.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:15:13.536 WARNING:teuthology.provision.fog.trial158:[Errno None] Unable to connect to port 22 on 10.20.193.158
2026-02-25T15:15:19.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:15:22.624 WARNING:teuthology.provision.fog.trial158:[Errno None] Unable to connect to port 22 on 10.20.193.158
2026-02-25T15:15:28.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:15:31.712 WARNING:teuthology.provision.fog.trial158:[Errno None] Unable to connect to port 22 on 10.20.193.158
2026-02-25T15:15:37.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:15:39.714 WARNING:teuthology.provision.fog.trial021:timed out
2026-02-25T15:15:40.800 WARNING:teuthology.provision.fog.trial158:[Errno None] Unable to connect to port 22 on 10.20.193.158
2026-02-25T15:15:43.908 WARNING:teuthology.provision.fog.trial123:timed out
2026-02-25T15:15:45.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial021.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:15:46.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:15:49.889 WARNING:teuthology.provision.fog.trial158:[Errno None] Unable to connect to port 22 on 10.20.193.158
2026-02-25T15:15:49.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:15:53.026 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T15:15:53.026 DEBUG:teuthology.orchestra.run.trial021:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T15:15:54.154 ERROR:teuthology.orchestra.connection:Error authenticating with trial123.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-25T15:15:55.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:15:58.270 ERROR:teuthology.orchestra.connection:Error authenticating with trial123.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-25T15:16:03.162 INFO:teuthology.provision.fog.trial021:Node is ready
2026-02-25T15:16:03.163 DEBUG:teuthology.orchestra.run.trial021:> hostname
2026-02-25T15:16:03.180 INFO:teuthology.orchestra.run.trial021.stdout:trial021.front.sepia.ceph.com
2026-02-25T15:16:03.181 DEBUG:teuthology.orchestra.run.trial021:> grep trial021.front.sepia.ceph.com /etc/hosts
2026-02-25T15:16:03.236 INFO:teuthology.orchestra.run.trial021.stdout:10.20.193.21 trial021.front.sepia.ceph.com trial021
2026-02-25T15:16:03.237 DEBUG:teuthology.orchestra.run.trial021:> sudo hostname trial021
2026-02-25T15:16:03.308 DEBUG:teuthology.orchestra.run.trial021:> sudo sed -i -e 's/trial021.front.sepia.ceph.com/trial021/g' /etc/hosts
2026-02-25T15:16:03.375 DEBUG:teuthology.orchestra.run.trial021:> sudo sed -i -e 's/10.20.193.21/10.20.193.21/g' /etc/hosts
2026-02-25T15:16:03.440 DEBUG:teuthology.orchestra.run.trial021:> sudo sed -i -e 's/trial021.front.sepia.ceph.com/trial021/g' /etc/hostname
2026-02-25T15:16:03.506 DEBUG:teuthology.orchestra.run.trial021:> sudo hostname trial021
2026-02-25T15:16:03.571 DEBUG:teuthology.orchestra.run.trial021:> cat /etc/os-release
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:NAME="CentOS Stream"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:VERSION="9"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:ID="centos"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:ID_LIKE="rhel fedora"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:VERSION_ID="9"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:PLATFORM_ID="platform:el9"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:ANSI_COLOR="0;31"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:LOGO="fedora-logo-icon"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:HOME_URL="https://centos.org/"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T15:16:03.626 INFO:teuthology.orchestra.run.trial021.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T15:16:03.627 INFO:teuthology.provision.fog.trial021:Deploy complete!
2026-02-25T15:16:03.627 DEBUG:teuthology.parallel:result is None
2026-02-25T15:16:05.383 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T15:16:05.383 DEBUG:teuthology.orchestra.run.trial123:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T15:16:05.546 INFO:teuthology.provision.fog.trial123:Node is ready
2026-02-25T15:16:05.546 DEBUG:teuthology.orchestra.run.trial123:> hostname
2026-02-25T15:16:05.603 INFO:teuthology.orchestra.run.trial123.stdout:trial123.front.sepia.ceph.com
2026-02-25T15:16:05.603 DEBUG:teuthology.orchestra.run.trial123:> grep trial123.front.sepia.ceph.com /etc/hosts
2026-02-25T15:16:05.660 INFO:teuthology.orchestra.run.trial123.stdout:10.20.193.123 trial123.front.sepia.ceph.com trial123
2026-02-25T15:16:05.660 DEBUG:teuthology.orchestra.run.trial123:> sudo hostname trial123
2026-02-25T15:16:05.730 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/trial123.front.sepia.ceph.com/trial123/g' /etc/hosts
2026-02-25T15:16:05.795 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/10.20.193.123/10.20.193.123/g' /etc/hosts
2026-02-25T15:16:05.859 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/trial123.front.sepia.ceph.com/trial123/g' /etc/hostname
2026-02-25T15:16:05.924 DEBUG:teuthology.orchestra.run.trial123:> sudo hostname trial123
2026-02-25T15:16:05.987 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release
2026-02-25T15:16:06.043 INFO:teuthology.orchestra.run.trial123.stdout:NAME="CentOS Stream"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="9"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:ID="centos"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel fedora"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="9"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el9"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;31"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T15:16:06.044 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://centos.org/"
2026-02-25T15:16:06.045 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T15:16:06.045 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T15:16:06.045 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T15:16:06.045 INFO:teuthology.provision.fog.trial123:Deploy complete!
2026-02-25T15:16:06.046 DEBUG:teuthology.parallel:result is None
2026-02-25T15:16:31.863 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T15:16:31.863 DEBUG:teuthology.orchestra.run.trial158:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T15:16:32.025 INFO:teuthology.provision.fog.trial158:Node is ready
2026-02-25T15:16:32.025 DEBUG:teuthology.orchestra.run.trial158:> hostname
2026-02-25T15:16:32.081 INFO:teuthology.orchestra.run.trial158.stdout:trial158.front.sepia.ceph.com
2026-02-25T15:16:32.081 DEBUG:teuthology.orchestra.run.trial158:> grep trial158.front.sepia.ceph.com /etc/hosts
2026-02-25T15:16:32.137 INFO:teuthology.orchestra.run.trial158.stdout:10.20.193.158 trial158.front.sepia.ceph.com trial158
2026-02-25T15:16:32.137 DEBUG:teuthology.orchestra.run.trial158:> sudo hostname trial158
2026-02-25T15:16:32.206 DEBUG:teuthology.orchestra.run.trial158:> sudo sed -i -e 's/trial158.front.sepia.ceph.com/trial158/g' /etc/hosts
2026-02-25T15:16:32.270 DEBUG:teuthology.orchestra.run.trial158:> sudo sed -i -e 's/10.20.193.158/10.20.193.158/g' /etc/hosts
2026-02-25T15:16:32.334 DEBUG:teuthology.orchestra.run.trial158:> sudo sed -i -e 's/trial158.front.sepia.ceph.com/trial158/g' /etc/hostname
2026-02-25T15:16:32.397 DEBUG:teuthology.orchestra.run.trial158:> sudo hostname trial158
2026-02-25T15:16:32.460 DEBUG:teuthology.orchestra.run.trial158:> cat /etc/os-release
2026-02-25T15:16:32.515 INFO:teuthology.orchestra.run.trial158.stdout:NAME="CentOS Stream"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:VERSION="9"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:ID="centos"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:ID_LIKE="rhel fedora"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:VERSION_ID="9"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:PLATFORM_ID="platform:el9"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:ANSI_COLOR="0;31"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:LOGO="fedora-logo-icon"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:HOME_URL="https://centos.org/"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T15:16:32.516 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T15:16:32.516 INFO:teuthology.provision.fog.trial158:Deploy complete!
2026-02-25T15:16:32.517 DEBUG:teuthology.parallel:result is None
2026-02-25T15:16:33.161 INFO:teuthology.lock.ops:Checking trial021.front.sepia.ceph.com
2026-02-25T15:16:33.161 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T15:16:33.268 INFO:teuthology.lock.ops:Checking trial123.front.sepia.ceph.com
2026-02-25T15:16:33.268 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T15:16:33.339 INFO:teuthology.lock.ops:Checking trial158.front.sepia.ceph.com
2026-02-25T15:16:33.339 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T15:16:33.395 INFO:teuthology.lock.ops:Updating [trial021.front.sepia.ceph.com]: set os type and version on server
2026-02-25T15:16:33.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial021.front.sepia.ceph.com'
2026-02-25T15:16:33.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial021.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:16:33.456 DEBUG:teuthology.orchestra.run.trial021:> true
2026-02-25T15:16:33.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial021.front.sepia.ceph.com'
2026-02-25T15:16:33.599 DEBUG:teuthology.orchestra.run.trial021:> uname -m
2026-02-25T15:16:33.655 INFO:teuthology.orchestra.run.trial021.stdout:x86_64
2026-02-25T15:16:33.655 DEBUG:teuthology.orchestra.run.trial021:> cat /etc/os-release
2026-02-25T15:16:33.711 INFO:teuthology.orchestra.run.trial021.stdout:NAME="CentOS Stream"
2026-02-25T15:16:33.711 INFO:teuthology.orchestra.run.trial021.stdout:VERSION="9"
2026-02-25T15:16:33.711 INFO:teuthology.orchestra.run.trial021.stdout:ID="centos"
2026-02-25T15:16:33.711 INFO:teuthology.orchestra.run.trial021.stdout:ID_LIKE="rhel fedora"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:VERSION_ID="9"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:PLATFORM_ID="platform:el9"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:ANSI_COLOR="0;31"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:LOGO="fedora-logo-icon"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:HOME_URL="https://centos.org/"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T15:16:33.712 INFO:teuthology.orchestra.run.trial021.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T15:16:33.713 INFO:teuthology.lock.ops:Updating trial021.front.sepia.ceph.com on lock server
2026-02-25T15:16:33.816 INFO:teuthology.lock.ops:Updating [trial123.front.sepia.ceph.com]: set os type and version on server
2026-02-25T15:16:33.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com'
2026-02-25T15:16:33.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:16:33.888 DEBUG:teuthology.orchestra.run.trial123:> true
2026-02-25T15:16:34.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com'
2026-02-25T15:16:34.045 DEBUG:teuthology.orchestra.run.trial123:> uname -m
2026-02-25T15:16:34.104 INFO:teuthology.orchestra.run.trial123.stdout:x86_64
2026-02-25T15:16:34.104 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release
2026-02-25T15:16:34.159 INFO:teuthology.orchestra.run.trial123.stdout:NAME="CentOS Stream"
2026-02-25T15:16:34.160 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="9"
2026-02-25T15:16:34.160 INFO:teuthology.orchestra.run.trial123.stdout:ID="centos"
2026-02-25T15:16:34.160 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel fedora"
2026-02-25T15:16:34.160 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="9"
2026-02-25T15:16:34.160 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el9"
2026-02-25T15:16:34.160 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T15:16:34.160 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;31"
2026-02-25T15:16:34.160 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon"
2026-02-25T15:16:34.161 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T15:16:34.161 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://centos.org/"
2026-02-25T15:16:34.161 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T15:16:34.161 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T15:16:34.161 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T15:16:34.162 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server
2026-02-25T15:16:34.265 INFO:teuthology.lock.ops:Updating [trial158.front.sepia.ceph.com]: set os type and version on server
2026-02-25T15:16:34.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com'
2026-02-25T15:16:34.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T15:16:34.336 DEBUG:teuthology.orchestra.run.trial158:> true
2026-02-25T15:16:34.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com'
2026-02-25T15:16:34.408 DEBUG:teuthology.orchestra.run.trial158:> uname -m
2026-02-25T15:16:34.464 INFO:teuthology.orchestra.run.trial158.stdout:x86_64
2026-02-25T15:16:34.464 DEBUG:teuthology.orchestra.run.trial158:> cat /etc/os-release
2026-02-25T15:16:34.520 INFO:teuthology.orchestra.run.trial158.stdout:NAME="CentOS Stream"
2026-02-25T15:16:34.520 INFO:teuthology.orchestra.run.trial158.stdout:VERSION="9"
2026-02-25T15:16:34.520 INFO:teuthology.orchestra.run.trial158.stdout:ID="centos"
2026-02-25T15:16:34.520 INFO:teuthology.orchestra.run.trial158.stdout:ID_LIKE="rhel fedora"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:VERSION_ID="9"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:PLATFORM_ID="platform:el9"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:ANSI_COLOR="0;31"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:LOGO="fedora-logo-icon"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:HOME_URL="https://centos.org/"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T15:16:34.521 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T15:16:34.522 INFO:teuthology.lock.ops:Updating trial158.front.sepia.ceph.com on lock server
2026-02-25T15:16:34.628 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:16:34.725 INFO:teuthology.dispatcher.supervisor:Running job 69608
2026-02-25T15:16:34.725 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69608 --name vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-compat_client/no}} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69608/orig.config.yaml
2026-02-25T15:16:34.726 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69608
2026-02-25T15:16:34.726 INFO:teuthology.dispatcher.supervisor:Job PID: 2215228
2026-02-25T15:16:34.726 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-25T15:18:34.727 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:20:34.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:22:34.883 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:24:35.134 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:26:35.221 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:28:35.327 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:30:35.455 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:32:35.585 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:34:35.708 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T15:34:35.829 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-25T15:34:36.028 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-25T15:34:36.782 INFO:teuthology.orchestra.console.trial158:Power off
2026-02-25T15:34:36.782 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T15:34:36.790 INFO:teuthology.orchestra.console.trial123:Power off
2026-02-25T15:34:36.790 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T15:34:36.811 INFO:teuthology.orchestra.console.trial021:Power off
2026-02-25T15:34:36.811 DEBUG:teuthology.orchestra.console.trial021:pexpect command: ipmitool -H trial021.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T15:34:36.823 DEBUG:teuthology.orchestra.console.trial158:power off output: Chassis Power Control: Down/Off
2026-02-25T15:34:36.829 DEBUG:teuthology.orchestra.console.trial123:power off output: Chassis Power Control: Down/Off
2026-02-25T15:34:36.849 DEBUG:teuthology.orchestra.console.trial021:power off output: Chassis Power Control: Down/Off
2026-02-25T15:34:40.824 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:34:40.830 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:34:40.850 DEBUG:teuthology.orchestra.console.trial021:pexpect command: ipmitool -H trial021.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:34:40.932 DEBUG:teuthology.orchestra.console.trial158:check power output: Chassis Power is on
2026-02-25T15:34:40.936 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is on
2026-02-25T15:34:40.957 DEBUG:teuthology.orchestra.console.trial021:check power output: Chassis Power is on
2026-02-25T15:34:44.934 DEBUG:teuthology.orchestra.console.trial158:pexpect command: ipmitool -H trial158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:34:44.940 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:34:44.959 DEBUG:teuthology.orchestra.console.trial021:pexpect command: ipmitool -H trial021.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T15:34:45.043 DEBUG:teuthology.orchestra.console.trial158:check power output: Chassis Power is off
2026-02-25T15:34:45.043 INFO:teuthology.orchestra.console.trial158:Power off completed
2026-02-25T15:34:45.049 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is off
2026-02-25T15:34:45.049 INFO:teuthology.orchestra.console.trial123:Power off completed
2026-02-25T15:34:45.071 DEBUG:teuthology.orchestra.console.trial021:check power output: Chassis Power is off
2026-02-25T15:34:45.071 INFO:teuthology.orchestra.console.trial021:Power off completed
2026-02-25T15:34:45.319 INFO:teuthology.lock.ops:unlocked: trial158.front.sepia.ceph.com
2026-02-25T15:34:45.329 INFO:teuthology.lock.ops:unlocked: trial123.front.sepia.ceph.com
2026-02-25T15:34:45.333 INFO:teuthology.lock.ops:unlocked: trial021.front.sepia.ceph.com