2026-02-13T03:24:40.818 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T03:24:40.819 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:24:40.891 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:24:41.152 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ee242b03470>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ee242358220>, signals=[15])
2026-02-13T03:24:41.152 INFO:teuthology.lock.ops:Start node 'trial022.front.sepia.ceph.com' reimaging
2026-02-13T03:24:41.152 INFO:teuthology.lock.ops:Updating [trial022.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T03:24:41.152 INFO:teuthology.lock.ops:Updating trial022.front.sepia.ceph.com on lock server
2026-02-13T03:24:41.209 INFO:teuthology.lock.ops:Start node 'trial025.front.sepia.ceph.com' reimaging
2026-02-13T03:24:41.209 INFO:teuthology.lock.ops:Updating [trial025.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T03:24:41.209 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server
2026-02-13T03:24:41.266 INFO:teuthology.lock.ops:Start node 'trial191.front.sepia.ceph.com' reimaging
2026-02-13T03:24:41.266 INFO:teuthology.lock.ops:Updating [trial191.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T03:24:41.266 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server
2026-02-13T03:24:41.435 DEBUG:teuthology.provision.fog.trial025:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T03:24:41.496 INFO:teuthology.provision.fog.trial025:Scheduling deploy of centos 9.stream
2026-02-13T03:24:41.497 DEBUG:teuthology.provision.fog.trial022:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T03:24:41.549 INFO:teuthology.provision.fog.trial022:Scheduling deploy of centos 9.stream
2026-02-13T03:24:41.567 DEBUG:teuthology.provision.fog.trial191:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T03:24:41.619 INFO:teuthology.provision.fog.trial191:Scheduling deploy of centos 9.stream
2026-02-13T03:24:42.777 INFO:teuthology.orchestra.console.trial025:Power off
2026-02-13T03:24:42.777 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:24:42.789 INFO:teuthology.orchestra.console.trial191:Power off
2026-02-13T03:24:42.789 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:24:42.797 INFO:teuthology.orchestra.console.trial022:Power off
2026-02-13T03:24:42.797 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:24:42.815 DEBUG:teuthology.orchestra.console.trial025:power off output: Chassis Power Control: Down/Off
2026-02-13T03:24:42.826 DEBUG:teuthology.orchestra.console.trial191:power off output: Chassis Power Control: Down/Off
2026-02-13T03:24:42.836 DEBUG:teuthology.orchestra.console.trial022:power off output: Chassis Power Control: Down/Off
2026-02-13T03:24:46.819 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:24:46.826 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:24:46.837 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:24:46.928 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is off
2026-02-13T03:24:46.928 INFO:teuthology.orchestra.console.trial025:Power off completed
2026-02-13T03:24:46.932 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off
2026-02-13T03:24:46.932 INFO:teuthology.orchestra.console.trial191:Power off completed
2026-02-13T03:24:46.944 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is off
2026-02-13T03:24:46.944 INFO:teuthology.orchestra.console.trial022:Power off completed
2026-02-13T03:24:47.030 INFO:teuthology.orchestra.console.trial025:Power on
2026-02-13T03:24:47.030 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T03:24:47.038 INFO:teuthology.orchestra.console.trial191:Power on
2026-02-13T03:24:47.039 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T03:24:47.046 INFO:teuthology.orchestra.console.trial022:Power on
2026-02-13T03:24:47.046 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T03:24:47.070 DEBUG:teuthology.orchestra.console.trial025:power on output: Chassis Power Control: Up/On
2026-02-13T03:24:47.077 DEBUG:teuthology.orchestra.console.trial191:power on output: Chassis Power Control: Up/On
2026-02-13T03:24:47.084 DEBUG:teuthology.orchestra.console.trial022:power on output: Chassis Power Control: Up/On
2026-02-13T03:24:51.075 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:24:51.082 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:24:51.090 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:24:51.184 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is on
2026-02-13T03:24:51.185 INFO:teuthology.orchestra.console.trial025:Power on completed
2026-02-13T03:24:51.192 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off
2026-02-13T03:24:51.199 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is on
2026-02-13T03:24:51.200 INFO:teuthology.orchestra.console.trial022:Power on completed
2026-02-13T03:24:51.286 INFO:teuthology.provision.fog.trial025:Waiting for deploy to finish
2026-02-13T03:24:51.300 INFO:teuthology.provision.fog.trial022:Waiting for deploy to finish
2026-02-13T03:24:55.196 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:24:55.303 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is on
2026-02-13T03:24:55.303 INFO:teuthology.orchestra.console.trial191:Power on completed
2026-02-13T03:24:55.404 INFO:teuthology.provision.fog.trial191:Waiting for deploy to finish
2026-02-13T03:26:38.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:26:38.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:26:42.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:26:53.085 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-13T03:26:53.085 WARNING:teuthology.provision.fog.trial025:[Errno None] Unable to connect to port 22 on 10.20.193.25
2026-02-13T03:26:56.989 WARNING:teuthology.provision.fog.trial191:[Errno None] Unable to connect to port 22 on 10.20.193.191
2026-02-13T03:26:59.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:26:59.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:02.173 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-13T03:27:02.173 WARNING:teuthology.provision.fog.trial025:[Errno None] Unable to connect to port 22 on 10.20.193.25
2026-02-13T03:27:02.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:06.077 WARNING:teuthology.provision.fog.trial191:[Errno None] Unable to connect to port 22 on 10.20.193.191
2026-02-13T03:27:08.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:08.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:11.261 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-13T03:27:11.261 WARNING:teuthology.provision.fog.trial025:[Errno None] Unable to connect to port 22 on 10.20.193.25
2026-02-13T03:27:12.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:17.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:17.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:20.349 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-13T03:27:26.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:29.437 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-13T03:27:35.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:38.525 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-13T03:27:44.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:27:48.016 ERROR:teuthology.orchestra.connection:Error authenticating with trial191.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T03:27:52.127 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T03:27:52.127 DEBUG:teuthology.orchestra.run.trial191:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T03:27:53.125 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T03:27:53.125 DEBUG:teuthology.orchestra.run.trial025:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T03:27:53.278 INFO:teuthology.provision.fog.trial025:Node is ready
2026-02-13T03:27:53.279 DEBUG:teuthology.orchestra.run.trial025:> hostname
2026-02-13T03:27:53.333 INFO:teuthology.orchestra.run.trial025.stdout:trial025.front.sepia.ceph.com
2026-02-13T03:27:53.334 DEBUG:teuthology.orchestra.run.trial025:> grep trial025.front.sepia.ceph.com /etc/hosts
2026-02-13T03:27:53.390 INFO:teuthology.orchestra.run.trial025.stdout:10.20.193.25 trial025.front.sepia.ceph.com trial025
2026-02-13T03:27:53.390 DEBUG:teuthology.orchestra.run.trial025:> sudo hostname trial025
2026-02-13T03:27:53.459 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/trial025.front.sepia.ceph.com/trial025/g' /etc/hosts
2026-02-13T03:27:53.524 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/10.20.193.25/10.20.193.25/g' /etc/hosts
2026-02-13T03:27:53.588 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/trial025.front.sepia.ceph.com/trial025/g' /etc/hostname
2026-02-13T03:27:53.653 DEBUG:teuthology.orchestra.run.trial025:> sudo hostname trial025
2026-02-13T03:27:53.717 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release
2026-02-13T03:27:53.773 INFO:teuthology.orchestra.run.trial025.stdout:NAME="CentOS Stream"
2026-02-13T03:27:53.773 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="9"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:ID="centos"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE="rhel fedora"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="9"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:PLATFORM_ID="platform:el9"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:ANSI_COLOR="0;31"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:LOGO="fedora-logo-icon"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://centos.org/"
2026-02-13T03:27:53.774 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T03:27:53.775 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T03:27:53.775 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T03:27:53.776 INFO:teuthology.provision.fog.trial025:Deploy complete!
2026-02-13T03:27:53.777 DEBUG:teuthology.parallel:result is None
2026-02-13T03:27:57.353 INFO:teuthology.provision.fog.trial191:Node is ready
2026-02-13T03:27:57.353 DEBUG:teuthology.orchestra.run.trial191:> hostname
2026-02-13T03:27:57.410 INFO:teuthology.orchestra.run.trial191.stdout:trial191.front.sepia.ceph.com
2026-02-13T03:27:57.410 DEBUG:teuthology.orchestra.run.trial191:> grep trial191.front.sepia.ceph.com /etc/hosts
2026-02-13T03:27:57.467 INFO:teuthology.orchestra.run.trial191.stdout:10.20.193.191 trial191.front.sepia.ceph.com trial191
2026-02-13T03:27:57.468 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname trial191
2026-02-13T03:27:57.538 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/trial191.front.sepia.ceph.com/trial191/g' /etc/hosts
2026-02-13T03:27:57.604 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/10.20.193.191/10.20.193.191/g' /etc/hosts
2026-02-13T03:27:57.669 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/trial191.front.sepia.ceph.com/trial191/g' /etc/hostname
2026-02-13T03:27:57.734 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname trial191
2026-02-13T03:27:57.798 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release
2026-02-13T03:27:57.854 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream"
2026-02-13T03:27:57.854 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9"
2026-02-13T03:27:57.854 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos"
2026-02-13T03:27:57.854 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora"
2026-02-13T03:27:57.854 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9"
2026-02-13T03:27:57.854 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9"
2026-02-13T03:27:57.854 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T03:27:57.854 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31"
2026-02-13T03:27:57.855 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon"
2026-02-13T03:27:57.855 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T03:27:57.855 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/"
2026-02-13T03:27:57.855 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T03:27:57.855 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T03:27:57.855 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T03:27:57.855 INFO:teuthology.provision.fog.trial191:Deploy complete!
2026-02-13T03:27:57.856 DEBUG:teuthology.parallel:result is None
2026-02-13T03:28:20.770 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T03:28:20.770 DEBUG:teuthology.orchestra.run.trial022:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T03:28:20.930 INFO:teuthology.provision.fog.trial022:Node is ready
2026-02-13T03:28:20.930 DEBUG:teuthology.orchestra.run.trial022:> hostname
2026-02-13T03:28:20.986 INFO:teuthology.orchestra.run.trial022.stdout:trial022.front.sepia.ceph.com
2026-02-13T03:28:20.987 DEBUG:teuthology.orchestra.run.trial022:> grep trial022.front.sepia.ceph.com /etc/hosts
2026-02-13T03:28:21.044 INFO:teuthology.orchestra.run.trial022.stdout:10.20.193.22 trial022.front.sepia.ceph.com trial022
2026-02-13T03:28:21.044 DEBUG:teuthology.orchestra.run.trial022:> sudo hostname trial022
2026-02-13T03:28:21.113 DEBUG:teuthology.orchestra.run.trial022:> sudo sed -i -e 's/trial022.front.sepia.ceph.com/trial022/g' /etc/hosts
2026-02-13T03:28:21.177 DEBUG:teuthology.orchestra.run.trial022:> sudo sed -i -e 's/10.20.193.22/10.20.193.22/g' /etc/hosts
2026-02-13T03:28:21.241 DEBUG:teuthology.orchestra.run.trial022:> sudo sed -i -e 's/trial022.front.sepia.ceph.com/trial022/g' /etc/hostname
2026-02-13T03:28:21.305 DEBUG:teuthology.orchestra.run.trial022:> sudo hostname trial022
2026-02-13T03:28:21.370 DEBUG:teuthology.orchestra.run.trial022:> cat /etc/os-release
2026-02-13T03:28:21.426 INFO:teuthology.orchestra.run.trial022.stdout:NAME="CentOS Stream"
2026-02-13T03:28:21.426 INFO:teuthology.orchestra.run.trial022.stdout:VERSION="9"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:ID="centos"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:ID_LIKE="rhel fedora"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:VERSION_ID="9"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:PLATFORM_ID="platform:el9"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:ANSI_COLOR="0;31"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:LOGO="fedora-logo-icon"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:HOME_URL="https://centos.org/"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T03:28:21.427 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T03:28:21.428 INFO:teuthology.provision.fog.trial022:Deploy complete!
2026-02-13T03:28:21.429 DEBUG:teuthology.parallel:result is None
2026-02-13T03:28:21.980 INFO:teuthology.lock.ops:Checking trial022.front.sepia.ceph.com
2026-02-13T03:28:21.980 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T03:28:22.084 INFO:teuthology.lock.ops:Checking trial025.front.sepia.ceph.com
2026-02-13T03:28:22.084 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T03:28:22.148 INFO:teuthology.lock.ops:Checking trial191.front.sepia.ceph.com
2026-02-13T03:28:22.148 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T03:28:22.205 INFO:teuthology.lock.ops:Updating [trial022.front.sepia.ceph.com]: set os type and version on server
2026-02-13T03:28:22.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial022.front.sepia.ceph.com'
2026-02-13T03:28:22.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:28:22.266 DEBUG:teuthology.orchestra.run.trial022:> true
2026-02-13T03:28:22.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial022.front.sepia.ceph.com'
2026-02-13T03:28:22.344 DEBUG:teuthology.orchestra.run.trial022:> uname -m
2026-02-13T03:28:22.400 INFO:teuthology.orchestra.run.trial022.stdout:x86_64
2026-02-13T03:28:22.400 DEBUG:teuthology.orchestra.run.trial022:> cat /etc/os-release
2026-02-13T03:28:22.456 INFO:teuthology.orchestra.run.trial022.stdout:NAME="CentOS Stream"
2026-02-13T03:28:22.456 INFO:teuthology.orchestra.run.trial022.stdout:VERSION="9"
2026-02-13T03:28:22.456 INFO:teuthology.orchestra.run.trial022.stdout:ID="centos"
2026-02-13T03:28:22.456 INFO:teuthology.orchestra.run.trial022.stdout:ID_LIKE="rhel fedora"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:VERSION_ID="9"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:PLATFORM_ID="platform:el9"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:ANSI_COLOR="0;31"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:LOGO="fedora-logo-icon"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:HOME_URL="https://centos.org/"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T03:28:22.457 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T03:28:22.458 INFO:teuthology.lock.ops:Updating trial022.front.sepia.ceph.com on lock server
2026-02-13T03:28:22.559 INFO:teuthology.lock.ops:Updating [trial025.front.sepia.ceph.com]: set os type and version on server
2026-02-13T03:28:22.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com'
2026-02-13T03:28:22.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:28:22.625 DEBUG:teuthology.orchestra.run.trial025:> true
2026-02-13T03:28:22.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com'
2026-02-13T03:28:22.770 DEBUG:teuthology.orchestra.run.trial025:> uname -m
2026-02-13T03:28:22.826 INFO:teuthology.orchestra.run.trial025.stdout:x86_64
2026-02-13T03:28:22.826 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release
2026-02-13T03:28:22.882 INFO:teuthology.orchestra.run.trial025.stdout:NAME="CentOS Stream"
2026-02-13T03:28:22.882 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="9"
2026-02-13T03:28:22.882 INFO:teuthology.orchestra.run.trial025.stdout:ID="centos"
2026-02-13T03:28:22.882 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE="rhel fedora"
2026-02-13T03:28:22.882 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="9"
2026-02-13T03:28:22.882 INFO:teuthology.orchestra.run.trial025.stdout:PLATFORM_ID="platform:el9"
2026-02-13T03:28:22.882 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T03:28:22.882 INFO:teuthology.orchestra.run.trial025.stdout:ANSI_COLOR="0;31"
2026-02-13T03:28:22.883 INFO:teuthology.orchestra.run.trial025.stdout:LOGO="fedora-logo-icon"
2026-02-13T03:28:22.883 INFO:teuthology.orchestra.run.trial025.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T03:28:22.883 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://centos.org/"
2026-02-13T03:28:22.883 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T03:28:22.883 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T03:28:22.883 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T03:28:22.884 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server
2026-02-13T03:28:22.986 INFO:teuthology.lock.ops:Updating [trial191.front.sepia.ceph.com]: set os type and version on server
2026-02-13T03:28:22.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial191.front.sepia.ceph.com'
2026-02-13T03:28:22.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T03:28:23.057 DEBUG:teuthology.orchestra.run.trial191:> true
2026-02-13T03:28:23.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial191.front.sepia.ceph.com'
2026-02-13T03:28:23.132 DEBUG:teuthology.orchestra.run.trial191:> uname -m
2026-02-13T03:28:23.189 INFO:teuthology.orchestra.run.trial191.stdout:x86_64
2026-02-13T03:28:23.189 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream"
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9"
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos"
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora"
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9"
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9"
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31"
2026-02-13T03:28:23.247 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon"
2026-02-13T03:28:23.248 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T03:28:23.248 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/"
2026-02-13T03:28:23.248 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T03:28:23.248 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T03:28:23.248 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T03:28:23.249 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server
2026-02-13T03:28:23.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:28:23.413 INFO:teuthology.dispatcher.supervisor:Running job 48098
2026-02-13T03:28:23.413 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48098 --name pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-compat_client/yes}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48098/orig.config.yaml
2026-02-13T03:28:23.413 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48098
2026-02-13T03:28:23.413 INFO:teuthology.dispatcher.supervisor:Job PID: 1442286
2026-02-13T03:28:23.413 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T03:30:23.415 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:31:52.093 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2026-02-13T03:32:23.570 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:34:23.745 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:36:23.916 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:38:24.106 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:40:24.274 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:42:24.421 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T03:42:24.492 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-13T03:42:24.658 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T03:42:25.317 INFO:teuthology.orchestra.console.trial025:Power off
2026-02-13T03:42:25.318 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:42:25.378 INFO:teuthology.orchestra.console.trial191:Power off
2026-02-13T03:42:25.378 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:42:25.384 DEBUG:teuthology.orchestra.console.trial025:power off output: Chassis Power Control: Down/Off
2026-02-13T03:42:25.401 INFO:teuthology.orchestra.console.trial022:Power off
2026-02-13T03:42:25.401 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T03:42:25.424 DEBUG:teuthology.orchestra.console.trial191:power off output: Chassis Power Control: Down/Off
2026-02-13T03:42:25.440 DEBUG:teuthology.orchestra.console.trial022:power off output: Chassis Power Control: Down/Off
2026-02-13T03:42:29.389 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:42:29.426 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:42:29.441 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:42:29.498 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is on
2026-02-13T03:42:29.536 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is on
2026-02-13T03:42:29.550 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is on
2026-02-13T03:42:33.503 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:42:33.537 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:42:33.551 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T03:42:33.614 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is off
2026-02-13T03:42:33.614 INFO:teuthology.orchestra.console.trial025:Power off completed
2026-02-13T03:42:33.646 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off
2026-02-13T03:42:33.646 INFO:teuthology.orchestra.console.trial191:Power off completed
2026-02-13T03:42:33.661 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is off
2026-02-13T03:42:33.661 INFO:teuthology.orchestra.console.trial022:Power off completed
2026-02-13T03:42:33.907 INFO:teuthology.lock.ops:unlocked: trial025.front.sepia.ceph.com
2026-02-13T03:42:33.917 INFO:teuthology.lock.ops:unlocked: trial191.front.sepia.ceph.com
2026-02-13T03:42:33.921 INFO:teuthology.lock.ops:unlocked: trial022.front.sepia.ceph.com