2026-02-12T22:42:57.497 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473
2026-02-12T22:42:57.497 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:42:57.593 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:42:57.810 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x74f896be11c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x74f896456840>, signals=[15])
2026-02-12T22:42:57.810 INFO:teuthology.lock.ops:Start node 'trial086.front.sepia.ceph.com' reimaging
2026-02-12T22:42:57.810 INFO:teuthology.lock.ops:Updating [trial086.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T22:42:57.810 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server
2026-02-12T22:42:57.865 INFO:teuthology.lock.ops:Start node 'trial197.front.sepia.ceph.com' reimaging
2026-02-12T22:42:57.865 INFO:teuthology.lock.ops:Updating [trial197.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T22:42:57.865 INFO:teuthology.lock.ops:Updating trial197.front.sepia.ceph.com on lock server
2026-02-12T22:42:58.062 DEBUG:teuthology.provision.fog.trial197:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T22:42:58.098 DEBUG:teuthology.provision.fog.trial086:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T22:42:58.115 INFO:teuthology.provision.fog.trial197:Scheduling deploy of rocky 10.1
2026-02-12T22:42:58.149 INFO:teuthology.provision.fog.trial086:Scheduling deploy of rocky 10.1
2026-02-12T22:42:59.554 INFO:teuthology.orchestra.console.trial086:Power off
2026-02-12T22:42:59.554 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:42:59.592 DEBUG:teuthology.orchestra.console.trial086:power off output: Chassis Power Control: Down/Off
2026-02-12T22:42:59.655 INFO:teuthology.orchestra.console.trial197:Power off
2026-02-12T22:42:59.655 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:42:59.694 DEBUG:teuthology.orchestra.console.trial197:power off output: Chassis Power Control: Down/Off
2026-02-12T22:43:03.597 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:43:03.696 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:43:03.706 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is off
2026-02-12T22:43:03.706 INFO:teuthology.orchestra.console.trial086:Power off completed
2026-02-12T22:43:03.803 DEBUG:teuthology.orchestra.console.trial197:check power output: Chassis Power is off
2026-02-12T22:43:03.803 INFO:teuthology.orchestra.console.trial197:Power off completed
2026-02-12T22:43:03.807 INFO:teuthology.orchestra.console.trial086:Power on
2026-02-12T22:43:03.807 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T22:43:03.848 DEBUG:teuthology.orchestra.console.trial086:power on output: Chassis Power Control: Up/On
2026-02-12T22:43:03.904 INFO:teuthology.orchestra.console.trial197:Power on
2026-02-12T22:43:03.904 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T22:43:03.943 DEBUG:teuthology.orchestra.console.trial197:power on output: Chassis Power Control: Up/On
2026-02-12T22:43:07.853 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:43:07.944 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:43:07.964 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is on
2026-02-12T22:43:07.964 INFO:teuthology.orchestra.console.trial086:Power on completed
2026-02-12T22:43:08.054 DEBUG:teuthology.orchestra.console.trial197:check power output: Chassis Power is on
2026-02-12T22:43:08.054 INFO:teuthology.orchestra.console.trial197:Power on completed
2026-02-12T22:43:08.065 INFO:teuthology.provision.fog.trial086:Waiting for deploy to finish
2026-02-12T22:43:08.155 INFO:teuthology.provision.fog.trial197:Waiting for deploy to finish
2026-02-12T22:44:55.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:44:55.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:44:58.589 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86
2026-02-12T22:45:04.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:45:07.677 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86
2026-02-12T22:45:13.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:45:16.765 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86
2026-02-12T22:45:22.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:45:25.853 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86
2026-02-12T22:45:31.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:45:55.819 WARNING:teuthology.provision.fog.trial197:timed out
2026-02-12T22:46:01.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:46:07.881 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T22:46:07.882 DEBUG:teuthology.orchestra.run.trial086:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T22:46:09.107 ERROR:teuthology.orchestra.connection:Error authenticating with trial197.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T22:46:12.679 INFO:teuthology.provision.fog.trial086:Node is ready
2026-02-12T22:46:12.679 DEBUG:teuthology.orchestra.run.trial086:> hostname
2026-02-12T22:46:12.698 INFO:teuthology.orchestra.run.trial086.stdout:trial086.front.sepia.ceph.com
2026-02-12T22:46:12.698 DEBUG:teuthology.orchestra.run.trial086:> grep trial086.front.sepia.ceph.com /etc/hosts
2026-02-12T22:46:12.752 INFO:teuthology.orchestra.run.trial086.stdout:10.20.193.86 trial086.front.sepia.ceph.com trial086
2026-02-12T22:46:12.753 DEBUG:teuthology.orchestra.run.trial086:> sudo hostname trial086
2026-02-12T22:46:12.822 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/trial086.front.sepia.ceph.com/trial086/g' /etc/hosts
2026-02-12T22:46:12.886 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/10.20.193.86/10.20.193.86/g' /etc/hosts
2026-02-12T22:46:12.950 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/trial086.front.sepia.ceph.com/trial086/g' /etc/hostname
2026-02-12T22:46:13.013 DEBUG:teuthology.orchestra.run.trial086:> sudo hostname trial086
2026-02-12T22:46:13.077 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release
2026-02-12T22:46:13.208 INFO:teuthology.orchestra.run.trial086.stdout:NAME="Rocky Linux"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:ID="rocky"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="10.1"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;32"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:VENDOR_NAME="RESF"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:46:13.209 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:46:13.209 INFO:teuthology.provision.fog.trial086:Deploy complete!
2026-02-12T22:46:13.210 DEBUG:teuthology.parallel:result is None
2026-02-12T22:46:13.221 ERROR:teuthology.orchestra.connection:Error authenticating with trial197.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T22:46:20.339 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T22:46:20.339 DEBUG:teuthology.orchestra.run.trial197:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T22:46:20.522 INFO:teuthology.provision.fog.trial197:Node is ready
2026-02-12T22:46:20.522 DEBUG:teuthology.orchestra.run.trial197:> hostname
2026-02-12T22:46:20.583 INFO:teuthology.orchestra.run.trial197.stdout:trial197.front.sepia.ceph.com
2026-02-12T22:46:20.583 DEBUG:teuthology.orchestra.run.trial197:> grep trial197.front.sepia.ceph.com /etc/hosts
2026-02-12T22:46:20.644 INFO:teuthology.orchestra.run.trial197.stdout:10.20.193.197 trial197.front.sepia.ceph.com trial197
2026-02-12T22:46:20.645 DEBUG:teuthology.orchestra.run.trial197:> sudo hostname trial197
2026-02-12T22:46:20.721 DEBUG:teuthology.orchestra.run.trial197:> sudo sed -i -e 's/trial197.front.sepia.ceph.com/trial197/g' /etc/hosts
2026-02-12T22:46:20.789 DEBUG:teuthology.orchestra.run.trial197:> sudo sed -i -e 's/10.20.193.197/10.20.193.197/g' /etc/hosts
2026-02-12T22:46:20.857 DEBUG:teuthology.orchestra.run.trial197:> sudo sed -i -e 's/trial197.front.sepia.ceph.com/trial197/g' /etc/hostname
2026-02-12T22:46:20.925 DEBUG:teuthology.orchestra.run.trial197:> sudo hostname trial197
2026-02-12T22:46:20.991 DEBUG:teuthology.orchestra.run.trial197:> cat /etc/os-release
2026-02-12T22:46:21.048 INFO:teuthology.orchestra.run.trial197.stdout:NAME="Rocky Linux"
2026-02-12T22:46:21.048 INFO:teuthology.orchestra.run.trial197.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:ID="rocky"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:VERSION_ID="10.1"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:ANSI_COLOR="0;32"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:46:21.049 INFO:teuthology.orchestra.run.trial197.stdout:VENDOR_NAME="RESF"
2026-02-12T22:46:21.050 INFO:teuthology.orchestra.run.trial197.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:46:21.050 INFO:teuthology.orchestra.run.trial197.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:46:21.050 INFO:teuthology.orchestra.run.trial197.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:46:21.050 INFO:teuthology.orchestra.run.trial197.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:46:21.050 INFO:teuthology.orchestra.run.trial197.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:46:21.050 INFO:teuthology.orchestra.run.trial197.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:46:21.050 INFO:teuthology.orchestra.run.trial197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:46:21.050 INFO:teuthology.provision.fog.trial197:Deploy complete!
2026-02-12T22:46:21.051 DEBUG:teuthology.parallel:result is None
2026-02-12T22:46:21.444 INFO:teuthology.lock.ops:Checking trial086.front.sepia.ceph.com
2026-02-12T22:46:21.444 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T22:46:21.505 INFO:teuthology.lock.ops:Checking trial197.front.sepia.ceph.com
2026-02-12T22:46:21.505 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T22:46:21.562 INFO:teuthology.lock.ops:Updating [trial086.front.sepia.ceph.com]: set os type and version on server
2026-02-12T22:46:21.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com'
2026-02-12T22:46:21.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:46:21.622 DEBUG:teuthology.orchestra.run.trial086:> true
2026-02-12T22:46:21.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com'
2026-02-12T22:46:21.707 DEBUG:teuthology.orchestra.run.trial086:> uname -m
2026-02-12T22:46:21.764 INFO:teuthology.orchestra.run.trial086.stdout:x86_64
2026-02-12T22:46:21.764 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release
2026-02-12T22:46:21.822 INFO:teuthology.orchestra.run.trial086.stdout:NAME="Rocky Linux"
2026-02-12T22:46:21.822 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:46:21.822 INFO:teuthology.orchestra.run.trial086.stdout:ID="rocky"
2026-02-12T22:46:21.822 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:46:21.822 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="10.1"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;32"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:VENDOR_NAME="RESF"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:46:21.823 INFO:teuthology.orchestra.run.trial086.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:46:21.824 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:46:21.824 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:46:21.824 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server
2026-02-12T22:46:21.927 INFO:teuthology.lock.ops:Updating [trial197.front.sepia.ceph.com]: set os type and version on server
2026-02-12T22:46:21.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial197.front.sepia.ceph.com'
2026-02-12T22:46:21.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:46:21.998 DEBUG:teuthology.orchestra.run.trial197:> true
2026-02-12T22:46:22.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial197.front.sepia.ceph.com'
2026-02-12T22:46:22.083 DEBUG:teuthology.orchestra.run.trial197:> uname -m
2026-02-12T22:46:22.140 INFO:teuthology.orchestra.run.trial197.stdout:x86_64
2026-02-12T22:46:22.141 DEBUG:teuthology.orchestra.run.trial197:> cat /etc/os-release
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:NAME="Rocky Linux"
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:ID="rocky"
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:VERSION_ID="10.1"
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:ANSI_COLOR="0;32"
2026-02-12T22:46:22.200 INFO:teuthology.orchestra.run.trial197.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:VENDOR_NAME="RESF"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:46:22.201 INFO:teuthology.orchestra.run.trial197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:46:22.202 INFO:teuthology.lock.ops:Updating trial197.front.sepia.ceph.com on lock server
2026-02-12T22:46:22.304 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:46:22.403 INFO:teuthology.dispatcher.supervisor:Running job 47287
2026-02-12T22:46:22.403 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47287 --name pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/uninlining} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47287/orig.config.yaml
2026-02-12T22:46:22.404 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47287
2026-02-12T22:46:22.404 INFO:teuthology.dispatcher.supervisor:Job PID: 826528
2026-02-12T22:46:22.404 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T22:48:22.407 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:50:22.583 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:52:22.680 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:54:22.832 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:54:22.909 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-12T22:54:23.019 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T22:54:23.510 INFO:teuthology.orchestra.console.trial086:Power off
2026-02-12T22:54:23.510 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:54:23.529 INFO:teuthology.orchestra.console.trial197:Power off
2026-02-12T22:54:23.530 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:54:23.550 DEBUG:teuthology.orchestra.console.trial086:power off output: Chassis Power Control: Down/Off
2026-02-12T22:54:23.567 DEBUG:teuthology.orchestra.console.trial197:power off output: Chassis Power Control: Down/Off
2026-02-12T22:54:27.554 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:54:27.568 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:54:27.662 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is on
2026-02-12T22:54:27.676 DEBUG:teuthology.orchestra.console.trial197:check power output: Chassis Power is on
2026-02-12T22:54:31.667 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:54:31.677 DEBUG:teuthology.orchestra.console.trial197:pexpect command: ipmitool -H trial197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:54:31.779 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is off
2026-02-12T22:54:31.780 INFO:teuthology.orchestra.console.trial086:Power off completed
2026-02-12T22:54:31.786 DEBUG:teuthology.orchestra.console.trial197:check power output: Chassis Power is off
2026-02-12T22:54:31.786 INFO:teuthology.orchestra.console.trial197:Power off completed
2026-02-12T22:54:32.040 INFO:teuthology.lock.ops:unlocked: trial086.front.sepia.ceph.com
2026-02-12T22:54:32.054 INFO:teuthology.lock.ops:unlocked: trial197.front.sepia.ceph.com