2026-02-12T16:40:48.025 INFO:root:teuthology version: 1.2.4.dev6+g96afe742a
2026-02-12T16:40:48.025 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:40:48.096 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:40:48.292 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7564fc744fb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7564fbf7ff60>, signals=[15])
2026-02-12T16:40:48.292 INFO:teuthology.lock.ops:Start node 'trial060.front.sepia.ceph.com' reimaging
2026-02-12T16:40:48.292 INFO:teuthology.lock.ops:Updating [trial060.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T16:40:48.292 INFO:teuthology.lock.ops:Updating trial060.front.sepia.ceph.com on lock server
2026-02-12T16:40:48.352 INFO:teuthology.lock.ops:Start node 'trial104.front.sepia.ceph.com' reimaging
2026-02-12T16:40:48.352 INFO:teuthology.lock.ops:Updating [trial104.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T16:40:48.353 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server
2026-02-12T16:40:48.559 DEBUG:teuthology.provision.fog.trial060:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T16:40:48.565 DEBUG:teuthology.provision.fog.trial104:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T16:40:48.604 INFO:teuthology.provision.fog.trial060:Scheduling deploy of rocky 10.1
2026-02-12T16:40:48.617 INFO:teuthology.provision.fog.trial104:Scheduling deploy of rocky 10.1
2026-02-12T16:40:49.797 INFO:teuthology.orchestra.console.trial104:Power off
2026-02-12T16:40:49.797 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T16:40:49.809 INFO:teuthology.orchestra.console.trial060:Power off
2026-02-12T16:40:49.809 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T16:40:49.834 DEBUG:teuthology.orchestra.console.trial104:power off output: Chassis Power Control: Down/Off
2026-02-12T16:40:49.847 DEBUG:teuthology.orchestra.console.trial060:power off output: Chassis Power Control: Down/Off
2026-02-12T16:40:53.840 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:40:53.848 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:40:53.950 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is off
2026-02-12T16:40:53.950 INFO:teuthology.orchestra.console.trial104:Power off completed
2026-02-12T16:40:53.958 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is off
2026-02-12T16:40:53.958 INFO:teuthology.orchestra.console.trial060:Power off completed
2026-02-12T16:40:54.051 INFO:teuthology.orchestra.console.trial104:Power on
2026-02-12T16:40:54.052 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T16:40:54.060 INFO:teuthology.orchestra.console.trial060:Power on
2026-02-12T16:40:54.060 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T16:40:54.090 DEBUG:teuthology.orchestra.console.trial104:power on output: Chassis Power Control: Up/On
2026-02-12T16:40:54.099 DEBUG:teuthology.orchestra.console.trial060:power on output: Chassis Power Control: Up/On
2026-02-12T16:40:58.095 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:40:58.104 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:40:58.207 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is on
2026-02-12T16:40:58.207 INFO:teuthology.orchestra.console.trial104:Power on completed
2026-02-12T16:40:58.213 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is on
2026-02-12T16:40:58.213 INFO:teuthology.orchestra.console.trial060:Power on completed
2026-02-12T16:40:58.308 INFO:teuthology.provision.fog.trial104:Waiting for deploy to finish
2026-02-12T16:40:58.314 INFO:teuthology.provision.fog.trial060:Waiting for deploy to finish
2026-02-12T16:42:45.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:42:45.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:42:48.669 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-12T16:42:48.670 WARNING:teuthology.provision.fog.trial104:[Errno None] Unable to connect to port 22 on 10.20.193.104
2026-02-12T16:42:54.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:42:54.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:42:57.757 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-12T16:42:57.757 WARNING:teuthology.provision.fog.trial104:[Errno None] Unable to connect to port 22 on 10.20.193.104
2026-02-12T16:43:03.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:43:03.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:43:06.845 WARNING:teuthology.provision.fog.trial104:[Errno None] Unable to connect to port 22 on 10.20.193.104
2026-02-12T16:43:06.845 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-12T16:43:12.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:43:12.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:43:15.933 WARNING:teuthology.provision.fog.trial104:[Errno None] Unable to connect to port 22 on 10.20.193.104
2026-02-12T16:43:15.933 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-12T16:43:21.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:43:21.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:43:58.152 ERROR:teuthology.orchestra.connection:Error authenticating with trial060.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T16:43:58.161 ERROR:teuthology.orchestra.connection:Error authenticating with trial104.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T16:44:02.303 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T16:44:02.303 DEBUG:teuthology.orchestra.run.trial060:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T16:44:02.312 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T16:44:02.312 DEBUG:teuthology.orchestra.run.trial104:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T16:44:07.359 INFO:teuthology.provision.fog.trial060:Node is ready
2026-02-12T16:44:07.359 DEBUG:teuthology.orchestra.run.trial060:> hostname
2026-02-12T16:44:07.377 INFO:teuthology.orchestra.run.trial060.stdout:trial060.front.sepia.ceph.com
2026-02-12T16:44:07.377 DEBUG:teuthology.orchestra.run.trial060:> grep trial060.front.sepia.ceph.com /etc/hosts
2026-02-12T16:44:07.437 INFO:teuthology.orchestra.run.trial060.stdout:10.20.193.60 trial060.front.sepia.ceph.com trial060
2026-02-12T16:44:07.437 DEBUG:teuthology.orchestra.run.trial060:> sudo hostname trial060
2026-02-12T16:44:07.510 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/trial060.front.sepia.ceph.com/trial060/g' /etc/hosts
2026-02-12T16:44:07.515 INFO:teuthology.provision.fog.trial104:Node is ready
2026-02-12T16:44:07.516 DEBUG:teuthology.orchestra.run.trial104:> hostname
2026-02-12T16:44:07.574 INFO:teuthology.orchestra.run.trial104.stdout:trial104.front.sepia.ceph.com
2026-02-12T16:44:07.574 DEBUG:teuthology.orchestra.run.trial104:> grep trial104.front.sepia.ceph.com /etc/hosts
2026-02-12T16:44:07.577 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/10.20.193.60/10.20.193.60/g' /etc/hosts
2026-02-12T16:44:07.633 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104 trial104.front.sepia.ceph.com trial104
2026-02-12T16:44:07.634 DEBUG:teuthology.orchestra.run.trial104:> sudo hostname trial104
2026-02-12T16:44:07.645 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/trial060.front.sepia.ceph.com/trial060/g' /etc/hostname
2026-02-12T16:44:07.706 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/trial104.front.sepia.ceph.com/trial104/g' /etc/hosts
2026-02-12T16:44:07.713 DEBUG:teuthology.orchestra.run.trial060:> sudo hostname trial060
2026-02-12T16:44:07.773 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/10.20.193.104/10.20.193.104/g' /etc/hosts
2026-02-12T16:44:07.779 DEBUG:teuthology.orchestra.run.trial060:> cat /etc/os-release
2026-02-12T16:44:07.837 INFO:teuthology.orchestra.run.trial060.stdout:NAME="Rocky Linux"
2026-02-12T16:44:07.837 INFO:teuthology.orchestra.run.trial060.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:44:07.837 INFO:teuthology.orchestra.run.trial060.stdout:ID="rocky"
2026-02-12T16:44:07.837 INFO:teuthology.orchestra.run.trial060.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:44:07.837 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_ID="10.1"
2026-02-12T16:44:07.837 INFO:teuthology.orchestra.run.trial060.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:44:07.837 INFO:teuthology.orchestra.run.trial060.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:44:07.837 INFO:teuthology.orchestra.run.trial060.stdout:ANSI_COLOR="0;32"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:VENDOR_NAME="RESF"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:44:07.838 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:44:07.839 INFO:teuthology.provision.fog.trial060:Deploy complete!
2026-02-12T16:44:07.840 DEBUG:teuthology.parallel:result is None
2026-02-12T16:44:07.842 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/trial104.front.sepia.ceph.com/trial104/g' /etc/hostname
2026-02-12T16:44:07.908 DEBUG:teuthology.orchestra.run.trial104:> sudo hostname trial104
2026-02-12T16:44:07.974 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:NAME="Rocky Linux"
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:ID="rocky"
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="10.1"
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:ANSI_COLOR="0;32"
2026-02-12T16:44:08.032 INFO:teuthology.orchestra.run.trial104.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:VENDOR_NAME="RESF"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:44:08.033 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:44:08.034 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:44:08.034 INFO:teuthology.provision.fog.trial104:Deploy complete!
2026-02-12T16:44:08.035 DEBUG:teuthology.parallel:result is None
2026-02-12T16:44:08.428 INFO:teuthology.lock.ops:Checking trial060.front.sepia.ceph.com
2026-02-12T16:44:08.428 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T16:44:08.529 INFO:teuthology.lock.ops:Checking trial104.front.sepia.ceph.com
2026-02-12T16:44:08.529 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T16:44:08.590 INFO:teuthology.lock.ops:Updating [trial060.front.sepia.ceph.com]: set os type and version on server
2026-02-12T16:44:08.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial060.front.sepia.ceph.com'
2026-02-12T16:44:08.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:08.650 DEBUG:teuthology.orchestra.run.trial060:> true
2026-02-12T16:44:08.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial060.front.sepia.ceph.com'
2026-02-12T16:44:08.733 DEBUG:teuthology.orchestra.run.trial060:> uname -m
2026-02-12T16:44:08.791 INFO:teuthology.orchestra.run.trial060.stdout:x86_64
2026-02-12T16:44:08.791 DEBUG:teuthology.orchestra.run.trial060:> cat /etc/os-release
2026-02-12T16:44:08.849 INFO:teuthology.orchestra.run.trial060.stdout:NAME="Rocky Linux"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:ID="rocky"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_ID="10.1"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:ANSI_COLOR="0;32"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:44:08.850 INFO:teuthology.orchestra.run.trial060.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:44:08.851 INFO:teuthology.orchestra.run.trial060.stdout:VENDOR_NAME="RESF"
2026-02-12T16:44:08.851 INFO:teuthology.orchestra.run.trial060.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:44:08.851 INFO:teuthology.orchestra.run.trial060.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:44:08.851 INFO:teuthology.orchestra.run.trial060.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:44:08.851 INFO:teuthology.orchestra.run.trial060.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:44:08.851 INFO:teuthology.orchestra.run.trial060.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:44:08.851 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:44:08.851 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:44:08.852 INFO:teuthology.lock.ops:Updating trial060.front.sepia.ceph.com on lock server
2026-02-12T16:44:08.954 INFO:teuthology.lock.ops:Updating [trial104.front.sepia.ceph.com]: set os type and version on server
2026-02-12T16:44:08.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com'
2026-02-12T16:44:08.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:44:09.021 DEBUG:teuthology.orchestra.run.trial104:> true
2026-02-12T16:44:09.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com'
2026-02-12T16:44:09.097 DEBUG:teuthology.orchestra.run.trial104:> uname -m
2026-02-12T16:44:09.154 INFO:teuthology.orchestra.run.trial104.stdout:x86_64
2026-02-12T16:44:09.154 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release
2026-02-12T16:44:09.212 INFO:teuthology.orchestra.run.trial104.stdout:NAME="Rocky Linux"
2026-02-12T16:44:09.212 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:44:09.212 INFO:teuthology.orchestra.run.trial104.stdout:ID="rocky"
2026-02-12T16:44:09.212 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:44:09.212 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="10.1"
2026-02-12T16:44:09.212 INFO:teuthology.orchestra.run.trial104.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:44:09.212 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:ANSI_COLOR="0;32"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:VENDOR_NAME="RESF"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:44:09.213 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:44:09.214 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server
2026-02-12T16:44:09.317 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:44:09.413 INFO:teuthology.dispatcher.supervisor:Running job 46841
2026-02-12T16:44:09.413 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:37:35-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46841 --name pdonnell-2026-02-12_16:37:35-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs:functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/snapshots} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:37:35-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46841/orig.config.yaml
2026-02-12T16:44:09.413 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:37:35-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46841
2026-02-12T16:44:09.413 INFO:teuthology.dispatcher.supervisor:Job PID: 41668
2026-02-12T16:44:09.413 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T16:46:09.514 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:48:09.698 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:50:09.867 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:52:10.039 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:54:10.243 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:56:10.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:58:10.600 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:00:10.813 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:02:10.950 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:04:11.137 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:06:11.319 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:08:11.425 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:10:11.617 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:12:11.806 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:14:12.008 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:16:12.212 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:16:12.282 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T17:16:12.394 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T17:16:12.886 INFO:teuthology.orchestra.console.trial104:Power off
2026-02-12T17:16:12.886 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T17:16:12.907 INFO:teuthology.orchestra.console.trial060:Power off
2026-02-12T17:16:12.908 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T17:16:12.925 DEBUG:teuthology.orchestra.console.trial104:power off output: Chassis Power Control: Down/Off
2026-02-12T17:16:12.947 DEBUG:teuthology.orchestra.console.trial060:power off output: Chassis Power Control: Down/Off
2026-02-12T17:16:16.927 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:16:16.948 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:16:17.035 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is on
2026-02-12T17:16:17.056 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is on
2026-02-12T17:16:21.040 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:16:21.056 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:16:21.149 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is off
2026-02-12T17:16:21.150 INFO:teuthology.orchestra.console.trial104:Power off completed
2026-02-12T17:16:21.167 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is off
2026-02-12T17:16:21.167 INFO:teuthology.orchestra.console.trial060:Power off completed
2026-02-12T17:16:21.392 INFO:teuthology.lock.ops:unlocked: trial104.front.sepia.ceph.com
2026-02-12T17:16:21.405 INFO:teuthology.lock.ops:unlocked: trial060.front.sepia.ceph.com