2026-02-12T16:39:14.179 INFO:root:teuthology version: 1.2.4.dev6+g96afe742a
2026-02-12T16:39:14.179 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:39:14.252 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:39:14.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x746c6e50c290>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x746c6e463a60>, signals=[15])
2026-02-12T16:39:14.443 INFO:teuthology.lock.ops:Start node 'trial046.front.sepia.ceph.com' reimaging
2026-02-12T16:39:14.443 INFO:teuthology.lock.ops:Updating [trial046.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T16:39:14.443 INFO:teuthology.lock.ops:Updating trial046.front.sepia.ceph.com on lock server
2026-02-12T16:39:14.501 INFO:teuthology.lock.ops:Start node 'trial098.front.sepia.ceph.com' reimaging
2026-02-12T16:39:14.501 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T16:39:14.501 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server
2026-02-12T16:39:14.725 DEBUG:teuthology.provision.fog.trial046:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T16:39:14.737 DEBUG:teuthology.provision.fog.trial098:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T16:39:14.776 INFO:teuthology.provision.fog.trial046:Scheduling deploy of rocky 10.1
2026-02-12T16:39:14.790 INFO:teuthology.provision.fog.trial098:Scheduling deploy of rocky 10.1
2026-02-12T16:39:15.781 INFO:teuthology.orchestra.console.trial046:Power off
2026-02-12T16:39:15.782 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T16:39:15.801 INFO:teuthology.orchestra.console.trial098:Power off
2026-02-12T16:39:15.801 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T16:39:15.819 DEBUG:teuthology.orchestra.console.trial046:power off output: Chassis Power Control: Down/Off
2026-02-12T16:39:15.839 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off
2026-02-12T16:39:19.825 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:39:19.839 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:39:19.933 DEBUG:teuthology.orchestra.console.trial046:check power output: Chassis Power is off
2026-02-12T16:39:19.933 INFO:teuthology.orchestra.console.trial046:Power off completed
2026-02-12T16:39:19.946 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T16:39:19.946 INFO:teuthology.orchestra.console.trial098:Power off completed
2026-02-12T16:39:20.035 INFO:teuthology.orchestra.console.trial046:Power on
2026-02-12T16:39:20.035 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T16:39:20.047 INFO:teuthology.orchestra.console.trial098:Power on
2026-02-12T16:39:20.048 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T16:39:20.074 DEBUG:teuthology.orchestra.console.trial046:power on output: Chassis Power Control: Up/On
2026-02-12T16:39:20.088 DEBUG:teuthology.orchestra.console.trial098:power on output: Chassis Power Control: Up/On
2026-02-12T16:39:24.079 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:39:24.089 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T16:39:24.190 DEBUG:teuthology.orchestra.console.trial046:check power output: Chassis Power is on
2026-02-12T16:39:24.191 INFO:teuthology.orchestra.console.trial046:Power on completed
2026-02-12T16:39:24.199 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on
2026-02-12T16:39:24.199 INFO:teuthology.orchestra.console.trial098:Power on completed
2026-02-12T16:39:24.292 INFO:teuthology.provision.fog.trial046:Waiting for deploy to finish
2026-02-12T16:39:24.299 INFO:teuthology.provision.fog.trial098:Waiting for deploy to finish
2026-02-12T16:41:11.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:11.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:14.845 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T16:41:14.845 WARNING:teuthology.provision.fog.trial046:[Errno None] Unable to connect to port 22 on 10.20.193.46
2026-02-12T16:41:20.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:20.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:23.933 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T16:41:23.933 WARNING:teuthology.provision.fog.trial046:[Errno None] Unable to connect to port 22 on 10.20.193.46
2026-02-12T16:41:29.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:29.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:33.021 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T16:41:33.021 WARNING:teuthology.provision.fog.trial046:[Errno None] Unable to connect to port 22 on 10.20.193.46
2026-02-12T16:41:39.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:39.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:42.109 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T16:41:42.109 WARNING:teuthology.provision.fog.trial046:[Errno None] Unable to connect to port 22 on 10.20.193.46
2026-02-12T16:41:48.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:41:48.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:42:23.964 ERROR:teuthology.orchestra.connection:Error authenticating with trial046.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T16:42:28.046 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T16:42:28.047 DEBUG:teuthology.orchestra.run.trial046:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T16:42:33.407 INFO:teuthology.provision.fog.trial046:Node is ready
2026-02-12T16:42:33.407 DEBUG:teuthology.orchestra.run.trial046:> hostname
2026-02-12T16:42:33.425 INFO:teuthology.orchestra.run.trial046.stdout:trial046.front.sepia.ceph.com
2026-02-12T16:42:33.425 DEBUG:teuthology.orchestra.run.trial046:> grep trial046.front.sepia.ceph.com /etc/hosts
2026-02-12T16:42:33.487 INFO:teuthology.orchestra.run.trial046.stdout:10.20.193.46 trial046.front.sepia.ceph.com trial046
2026-02-12T16:42:33.487 DEBUG:teuthology.orchestra.run.trial046:> sudo hostname trial046
2026-02-12T16:42:33.564 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i -e 's/trial046.front.sepia.ceph.com/trial046/g' /etc/hosts
2026-02-12T16:42:33.634 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i -e 's/10.20.193.46/10.20.193.46/g' /etc/hosts
2026-02-12T16:42:33.705 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i -e 's/trial046.front.sepia.ceph.com/trial046/g' /etc/hostname
2026-02-12T16:42:33.775 DEBUG:teuthology.orchestra.run.trial046:> sudo hostname trial046
2026-02-12T16:42:33.844 DEBUG:teuthology.orchestra.run.trial046:> cat /etc/os-release
2026-02-12T16:42:33.905 INFO:teuthology.orchestra.run.trial046.stdout:NAME="Rocky Linux"
2026-02-12T16:42:33.905 INFO:teuthology.orchestra.run.trial046.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:ID="rocky"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:VERSION_ID="10.1"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:ANSI_COLOR="0;32"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:VENDOR_NAME="RESF"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:42:33.906 INFO:teuthology.orchestra.run.trial046.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:42:33.907 INFO:teuthology.orchestra.run.trial046.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:42:33.907 INFO:teuthology.orchestra.run.trial046.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:42:33.907 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:42:33.907 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:42:33.907 INFO:teuthology.provision.fog.trial046:Deploy complete!
2026-02-12T16:42:33.908 DEBUG:teuthology.parallel:result is None
2026-02-12T16:42:48.117 WARNING:teuthology.provision.fog.trial098:timed out
2026-02-12T16:42:54.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:42:54.254 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T16:42:54.254 DEBUG:teuthology.orchestra.run.trial098:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T16:42:54.451 INFO:teuthology.provision.fog.trial098:Node is ready
2026-02-12T16:42:54.451 DEBUG:teuthology.orchestra.run.trial098:> hostname
2026-02-12T16:42:54.509 INFO:teuthology.orchestra.run.trial098.stdout:trial098.front.sepia.ceph.com
2026-02-12T16:42:54.509 DEBUG:teuthology.orchestra.run.trial098:> grep trial098.front.sepia.ceph.com /etc/hosts
2026-02-12T16:42:54.566 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98 trial098.front.sepia.ceph.com trial098
2026-02-12T16:42:54.566 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098
2026-02-12T16:42:54.640 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hosts
2026-02-12T16:42:54.707 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/10.20.193.98/10.20.193.98/g' /etc/hosts
2026-02-12T16:42:54.773 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hostname
2026-02-12T16:42:54.840 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098
2026-02-12T16:42:54.908 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release
2026-02-12T16:42:54.965 INFO:teuthology.orchestra.run.trial098.stdout:NAME="Rocky Linux"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:ID="rocky"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="10.1"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;32"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:42:54.966 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:VENDOR_NAME="RESF"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:42:54.967 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:42:54.968 INFO:teuthology.provision.fog.trial098:Deploy complete!
2026-02-12T16:42:54.968 DEBUG:teuthology.parallel:result is None
2026-02-12T16:42:55.381 INFO:teuthology.lock.ops:Checking trial046.front.sepia.ceph.com
2026-02-12T16:42:55.381 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T16:42:55.463 INFO:teuthology.lock.ops:Checking trial098.front.sepia.ceph.com
2026-02-12T16:42:55.463 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T16:42:55.523 INFO:teuthology.lock.ops:Updating [trial046.front.sepia.ceph.com]: set os type and version on server
2026-02-12T16:42:55.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com'
2026-02-12T16:42:55.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:42:55.585 DEBUG:teuthology.orchestra.run.trial046:> true
2026-02-12T16:42:55.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com'
2026-02-12T16:42:55.668 DEBUG:teuthology.orchestra.run.trial046:> uname -m
2026-02-12T16:42:55.726 INFO:teuthology.orchestra.run.trial046.stdout:x86_64
2026-02-12T16:42:55.727 DEBUG:teuthology.orchestra.run.trial046:> cat /etc/os-release
2026-02-12T16:42:55.784 INFO:teuthology.orchestra.run.trial046.stdout:NAME="Rocky Linux"
2026-02-12T16:42:55.784 INFO:teuthology.orchestra.run.trial046.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:42:55.784 INFO:teuthology.orchestra.run.trial046.stdout:ID="rocky"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:VERSION_ID="10.1"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:ANSI_COLOR="0;32"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:VENDOR_NAME="RESF"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:42:55.785 INFO:teuthology.orchestra.run.trial046.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:42:55.786 INFO:teuthology.orchestra.run.trial046.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:42:55.786 INFO:teuthology.orchestra.run.trial046.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:42:55.786 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:42:55.786 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:42:55.786 INFO:teuthology.lock.ops:Updating trial046.front.sepia.ceph.com on lock server
2026-02-12T16:42:55.888 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: set os type and version on server
2026-02-12T16:42:55.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com'
2026-02-12T16:42:55.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T16:42:55.959 DEBUG:teuthology.orchestra.run.trial098:> true
2026-02-12T16:42:56.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial098.front.sepia.ceph.com'
2026-02-12T16:42:56.031 DEBUG:teuthology.orchestra.run.trial098:> uname -m
2026-02-12T16:42:56.090 INFO:teuthology.orchestra.run.trial098.stdout:x86_64
2026-02-12T16:42:56.090 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release
2026-02-12T16:42:56.148 INFO:teuthology.orchestra.run.trial098.stdout:NAME="Rocky Linux"
2026-02-12T16:42:56.148 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T16:42:56.148 INFO:teuthology.orchestra.run.trial098.stdout:ID="rocky"
2026-02-12T16:42:56.148 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T16:42:56.148 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="10.1"
2026-02-12T16:42:56.148 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el10"
2026-02-12T16:42:56.148 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;32"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:VENDOR_NAME="RESF"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:SUPPORT_END="2035-05-31"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T16:42:56.149 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T16:42:56.150 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server
2026-02-12T16:42:56.253 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:42:56.349 INFO:teuthology.dispatcher.supervisor:Running job 46835
2026-02-12T16:42:56.349 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_96afe742af26c52260031b90a6912285896e1b3c/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:37:35-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46835 --name pdonnell-2026-02-12_16:37:35-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs:functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/exports} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:37:35-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46835/orig.config.yaml
2026-02-12T16:42:56.349 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_16:37:35-fs:functional-wip-pdonnell-testing-20260210.171210-distro-default-trial/46835
2026-02-12T16:42:56.349 INFO:teuthology.dispatcher.supervisor:Job PID: 39369
2026-02-12T16:42:56.349 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T16:44:56.350 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:45:39.357 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2026-02-12T16:46:56.506 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:48:56.724 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:50:56.921 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:52:57.135 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:54:57.269 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:56:57.458 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T16:58:57.597 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:00:57.795 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:02:57.973 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:04:58.170 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:06:58.371 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:08:58.563 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:10:58.703 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:12:58.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:14:59.074 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:16:59.274 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:18:59.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:20:59.614 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:22:59.808 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:24:59.964 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:27:00.126 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:29:00.303 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:31:00.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:33:00.561 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:35:00.750 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T17:35:00.835 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-12T17:35:00.949 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T17:35:01.448 INFO:teuthology.orchestra.console.trial046:Power off
2026-02-12T17:35:01.449 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T17:35:01.468 INFO:teuthology.orchestra.console.trial098:Power off
2026-02-12T17:35:01.468 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T17:35:01.488 DEBUG:teuthology.orchestra.console.trial046:power off output: Chassis Power Control: Down/Off
2026-02-12T17:35:01.508 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off
2026-02-12T17:35:05.493 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:35:05.509 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:35:05.602 DEBUG:teuthology.orchestra.console.trial046:check power output: Chassis Power is on
2026-02-12T17:35:05.617 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on
2026-02-12T17:35:09.607 DEBUG:teuthology.orchestra.console.trial046:pexpect command: ipmitool -H trial046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:35:09.618 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T17:35:09.716 DEBUG:teuthology.orchestra.console.trial046:check power output: Chassis Power is off
2026-02-12T17:35:09.717 INFO:teuthology.orchestra.console.trial046:Power off completed
2026-02-12T17:35:09.725 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T17:35:09.725 INFO:teuthology.orchestra.console.trial098:Power off completed
2026-02-12T17:35:09.958 INFO:teuthology.lock.ops:unlocked: trial046.front.sepia.ceph.com
2026-02-12T17:35:09.971 INFO:teuthology.lock.ops:unlocked: trial098.front.sepia.ceph.com