2026-02-12T16:42:09.291 INFO:root:teuthology version: 1.2.4.dev6+g96afe742a
2026-02-12T16:42:09.291 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:42:09.365 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:42:09.557 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7be7db9f9490>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7be7db24cd60>, signals=[15])
2026-02-12T16:42:09.557 INFO:teuthology.lock.ops:Start node 'trial027.front.sepia.ceph.com' reimaging
2026-02-12T16:42:09.557 INFO:teuthology.lock.ops:Updating [trial027.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T16:42:09.557 INFO:teuthology.lock.ops:Updating trial027.front.sepia.ceph.com on lock server
2026-02-12T16:42:09.614 INFO:teuthology.lock.ops:Start node 'trial199.front.sepia.ceph.com' reimaging
2026-02-12T16:42:09.614 INFO:teuthology.lock.ops:Updating [trial199.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T16:42:09.614 INFO:teuthology.lock.ops:Updating trial199.front.sepia.ceph.com on lock server
2026-02-12T16:42:09.821 DEBUG:teuthology.provision.fog.trial027:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T16:42:09.859 DEBUG:teuthology.provision.fog.trial199:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T16:42:09.867 INFO:teuthology.provision.fog.trial027:Scheduling deploy of rocky 10.1
2026-02-12T16:42:09.911 INFO:teuthology.provision.fog.trial199:Scheduling deploy of rocky 10.1
2026-02-12T16:42:10.944 INFO:teuthology.orchestra.console.trial199:Power off
2026-02-12T16:42:10.944 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T16:42:10.956 INFO:teuthology.orchestra.console.trial027:Power off
2026-02-12T16:42:10.956 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T16:42:10.983 DEBUG:teuthology.orchestra.console.trial199:power off output: Chassis Power Control: Down/Off
2026-02-12T16:42:10.994 DEBUG:teuthology.orchestra.console.trial027:power off output: Chassis Power Control: Down/Off
2026-02-12T16:42:14.988 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:42:14.996 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:42:15.098 DEBUG:teuthology.orchestra.console.trial199:check power output: Chassis Power is off
2026-02-12T16:42:15.098 INFO:teuthology.orchestra.console.trial199:Power off completed
2026-02-12T16:42:15.104 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is off
2026-02-12T16:42:15.105 INFO:teuthology.orchestra.console.trial027:Power off completed
2026-02-12T16:42:15.199 INFO:teuthology.orchestra.console.trial199:Power on
2026-02-12T16:42:15.199 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T16:42:15.207 INFO:teuthology.orchestra.console.trial027:Power on
2026-02-12T16:42:15.207 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T16:42:15.244 DEBUG:teuthology.orchestra.console.trial199:power on output: Chassis Power Control: Up/On
2026-02-12T16:42:15.248 DEBUG:teuthology.orchestra.console.trial027:power on output: Chassis Power Control: Up/On
2026-02-12T16:42:19.250 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:42:19.259 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:42:19.361 DEBUG:teuthology.orchestra.console.trial199:check power output: Chassis Power is on
2026-02-12T16:42:19.362 INFO:teuthology.orchestra.console.trial199:Power on completed
2026-02-12T16:42:19.368 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is on
2026-02-12T16:42:19.369 INFO:teuthology.orchestra.console.trial027:Power on completed
2026-02-12T16:42:19.463 INFO:teuthology.provision.fog.trial199:Waiting for deploy to finish
2026-02-12T16:42:19.469 INFO:teuthology.provision.fog.trial027:Waiting for deploy to finish
2026-02-12T16:44:06.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:06.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:09.629 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-12T16:44:09.757 WARNING:teuthology.provision.fog.trial199:[Errno None] Unable to connect to port 22 on 10.20.193.199
2026-02-12T16:44:15.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:15.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:18.717 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-12T16:44:18.845 WARNING:teuthology.provision.fog.trial199:[Errno None] Unable to connect to port 22 on 10.20.193.199
2026-02-12T16:44:24.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:24.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:27.805 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-12T16:44:27.933 WARNING:teuthology.provision.fog.trial199:[Errno None] Unable to connect to port 22 on 10.20.193.199
2026-02-12T16:44:33.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:33.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:36.893 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-12T16:44:37.021 WARNING:teuthology.provision.fog.trial199:[Errno None] Unable to connect to port 22 on 10.20.193.199
2026-02-12T16:44:42.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:43.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:45:19.013 ERROR:teuthology.orchestra.connection:Error authenticating with trial027.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T16:45:19.115 ERROR:teuthology.orchestra.connection:Error authenticating with trial199.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T16:45:23.103 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T16:45:23.103 DEBUG:teuthology.orchestra.run.trial027:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T16:45:23.189 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T16:45:23.189 DEBUG:teuthology.orchestra.run.trial199:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T16:45:28.169 INFO:teuthology.provision.fog.trial199:Node is ready
2026-02-12T16:45:28.170 DEBUG:teuthology.orchestra.run.trial199:> hostname
2026-02-12T16:45:28.188 INFO:teuthology.orchestra.run.trial199.stdout:trial199.front.sepia.ceph.com
2026-02-12T16:45:28.188 DEBUG:teuthology.orchestra.run.trial199:> grep trial199.front.sepia.ceph.com /etc/hosts
2026-02-12T16:45:28.246 INFO:teuthology.orchestra.run.trial199.stdout:10.20.193.199 trial199.front.sepia.ceph.com trial199
2026-02-12T16:45:28.246 DEBUG:teuthology.orchestra.run.trial199:> sudo hostname trial199
2026-02-12T16:45:28.319 DEBUG:teuthology.orchestra.run.trial199:> sudo sed -i -e 's/trial199.front.sepia.ceph.com/trial199/g' /etc/hosts
2026-02-12T16:45:28.387 DEBUG:teuthology.orchestra.run.trial199:> sudo sed -i -e 's/10.20.193.199/10.20.193.199/g' /etc/hosts
2026-02-12T16:45:28.453 DEBUG:teuthology.orchestra.run.trial199:> sudo sed -i -e 's/trial199.front.sepia.ceph.com/trial199/g' /etc/hostname
2026-02-12T16:45:28.519 DEBUG:teuthology.orchestra.run.trial199:> sudo hostname trial199
2026-02-12T16:45:28.585 DEBUG:teuthology.orchestra.run.trial199:> cat /etc/os-release
2026-02-12T16:45:28.643 INFO:teuthology.orchestra.run.trial199.stdout:NAME="Rocky Linux"
2026-02-12T16:45:28.643 INFO:teuthology.orchestra.run.trial199.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:45:28.643 INFO:teuthology.orchestra.run.trial199.stdout:ID="rocky"
2026-02-12T16:45:28.643 INFO:teuthology.orchestra.run.trial199.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:45:28.643 INFO:teuthology.orchestra.run.trial199.stdout:VERSION_ID="10.1"
2026-02-12T16:45:28.643 INFO:teuthology.orchestra.run.trial199.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:45:28.643 INFO:teuthology.orchestra.run.trial199.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:45:28.643 INFO:teuthology.orchestra.run.trial199.stdout:ANSI_COLOR="0;32"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:VENDOR_NAME="RESF"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:45:28.644 INFO:teuthology.orchestra.run.trial199.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:45:28.645 INFO:teuthology.provision.fog.trial199:Deploy complete!
2026-02-12T16:45:28.646 DEBUG:teuthology.parallel:result is None
2026-02-12T16:45:28.731 INFO:teuthology.provision.fog.trial027:Node is ready
2026-02-12T16:45:28.731 DEBUG:teuthology.orchestra.run.trial027:> hostname
2026-02-12T16:45:28.749 INFO:teuthology.orchestra.run.trial027.stdout:trial027.front.sepia.ceph.com
2026-02-12T16:45:28.750 DEBUG:teuthology.orchestra.run.trial027:> grep trial027.front.sepia.ceph.com /etc/hosts
2026-02-12T16:45:28.811 INFO:teuthology.orchestra.run.trial027.stdout:10.20.193.27 trial027.front.sepia.ceph.com trial027
2026-02-12T16:45:28.812 DEBUG:teuthology.orchestra.run.trial027:> sudo hostname trial027
2026-02-12T16:45:28.887 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/trial027.front.sepia.ceph.com/trial027/g' /etc/hosts
2026-02-12T16:45:28.958 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/10.20.193.27/10.20.193.27/g' /etc/hosts
2026-02-12T16:45:29.029 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/trial027.front.sepia.ceph.com/trial027/g' /etc/hostname
2026-02-12T16:45:29.100 DEBUG:teuthology.orchestra.run.trial027:> sudo hostname trial027
2026-02-12T16:45:29.170 DEBUG:teuthology.orchestra.run.trial027:> cat /etc/os-release
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:NAME="Rocky Linux"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:ID="rocky"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:VERSION_ID="10.1"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:ANSI_COLOR="0;32"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:VENDOR_NAME="RESF"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:45:29.230 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:45:29.231 INFO:teuthology.provision.fog.trial027:Deploy complete!
2026-02-12T16:45:29.231 DEBUG:teuthology.parallel:result is None
2026-02-12T16:45:29.576 INFO:teuthology.lock.ops:Checking trial027.front.sepia.ceph.com
2026-02-12T16:45:29.576 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T16:45:29.670 INFO:teuthology.lock.ops:Checking trial199.front.sepia.ceph.com
2026-02-12T16:45:29.670 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T16:45:29.732 INFO:teuthology.lock.ops:Updating [trial027.front.sepia.ceph.com]: set os type and version on server
2026-02-12T16:45:29.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial027.front.sepia.ceph.com'
2026-02-12T16:45:29.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:45:29.796 DEBUG:teuthology.orchestra.run.trial027:> true
2026-02-12T16:45:29.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial027.front.sepia.ceph.com'
2026-02-12T16:45:29.867 DEBUG:teuthology.orchestra.run.trial027:> uname -m
2026-02-12T16:45:29.928 INFO:teuthology.orchestra.run.trial027.stdout:x86_64
2026-02-12T16:45:29.928 DEBUG:teuthology.orchestra.run.trial027:> cat /etc/os-release
2026-02-12T16:45:29.988 INFO:teuthology.orchestra.run.trial027.stdout:NAME="Rocky Linux"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:ID="rocky"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:VERSION_ID="10.1"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:ANSI_COLOR="0;32"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:45:29.989 INFO:teuthology.orchestra.run.trial027.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:VENDOR_NAME="RESF"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:45:29.990 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:45:29.991 INFO:teuthology.lock.ops:Updating trial027.front.sepia.ceph.com on lock server
2026-02-12T16:45:30.094 INFO:teuthology.lock.ops:Updating [trial199.front.sepia.ceph.com]: set os type and version on server
2026-02-12T16:45:30.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial199.front.sepia.ceph.com'
2026-02-12T16:45:30.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial199.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:45:30.164 DEBUG:teuthology.orchestra.run.trial199:> true
2026-02-12T16:45:30.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial199.front.sepia.ceph.com'
2026-02-12T16:45:30.250 DEBUG:teuthology.orchestra.run.trial199:> uname -m
2026-02-12T16:45:30.308 INFO:teuthology.orchestra.run.trial199.stdout:x86_64
2026-02-12T16:45:30.308 DEBUG:teuthology.orchestra.run.trial199:> cat /etc/os-release
2026-02-12T16:45:30.366 INFO:teuthology.orchestra.run.trial199.stdout:NAME="Rocky Linux"
2026-02-12T16:45:30.366 INFO:teuthology.orchestra.run.trial199.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:ID="rocky"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:VERSION_ID="10.1"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:ANSI_COLOR="0;32"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:45:30.367 INFO:teuthology.orchestra.run.trial199.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:45:30.368 INFO:teuthology.orchestra.run.trial199.stdout:VENDOR_NAME="RESF"
2026-02-12T16:45:30.368 INFO:teuthology.orchestra.run.trial199.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:45:30.368 INFO:teuthology.orchestra.run.trial199.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:45:30.368 INFO:teuthology.orchestra.run.trial199.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:45:30.368 INFO:teuthology.orchestra.run.trial199.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:45:30.368 INFO:teuthology.orchestra.run.trial199.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:45:30.368 INFO:teuthology.orchestra.run.trial199.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:45:30.368 INFO:teuthology.orchestra.run.trial199.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:45:30.369 INFO:teuthology.lock.ops:Updating trial199.front.sepia.ceph.com on lock server
2026-02-12T16:45:30.472 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:45:30.555 INFO:teuthology.dispatcher.supervisor:Running job 46844
2026-02-12T16:45:30.556 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:38:03-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46844 --name pdonnell-2026-02-12_16:38:03-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs:functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:38:03-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46844/orig.config.yaml
2026-02-12T16:45:30.556 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:38:03-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46844
2026-02-12T16:45:30.556 INFO:teuthology.dispatcher.supervisor:Job PID: 45915
2026-02-12T16:45:30.556 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T16:47:30.656 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:49:30.845 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:51:30.998 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:53:31.192 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:55:31.297 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:57:31.436 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:59:31.611 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:01:31.722 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:03:31.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:05:32.097 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:07:32.296 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:09:32.499 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:11:32.680 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:13:32.865 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:15:33.052 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:17:33.245 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:17:33.329 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T17:17:33.445 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T17:17:33.959 INFO:teuthology.orchestra.console.trial199:Power off
2026-02-12T17:17:33.959 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T17:17:33.969 INFO:teuthology.orchestra.console.trial027:Power off
2026-02-12T17:17:33.969 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T17:17:33.997 DEBUG:teuthology.orchestra.console.trial199:power off output: Chassis Power Control: Down/Off
2026-02-12T17:17:34.006 DEBUG:teuthology.orchestra.console.trial027:power off output: Chassis Power Control: Down/Off
2026-02-12T17:17:38.002 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:17:38.008 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:17:38.111 DEBUG:teuthology.orchestra.console.trial199:check power output: Chassis Power is on
2026-02-12T17:17:38.116 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is on
2026-02-12T17:17:42.116 DEBUG:teuthology.orchestra.console.trial199:pexpect command: ipmitool -H trial199.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:17:42.125 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:17:42.227 DEBUG:teuthology.orchestra.console.trial199:check power output: Chassis Power is off
2026-02-12T17:17:42.227 INFO:teuthology.orchestra.console.trial199:Power off completed
2026-02-12T17:17:42.235 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is off
2026-02-12T17:17:42.235 INFO:teuthology.orchestra.console.trial027:Power off completed
2026-02-12T17:17:42.475 INFO:teuthology.lock.ops:unlocked: trial199.front.sepia.ceph.com
2026-02-12T17:17:42.490 INFO:teuthology.lock.ops:unlocked: trial027.front.sepia.ceph.com