2026-02-19T21:48:15.786 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-19T21:48:15.786 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T21:48:15.859 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T21:48:16.056 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7aeb72f5c3e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7aeb72985f80>, signals=[15])
2026-02-19T21:48:16.056 INFO:teuthology.lock.ops:Start node 'trial031.front.sepia.ceph.com' reimaging
2026-02-19T21:48:16.056 INFO:teuthology.lock.ops:Updating [trial031.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T21:48:16.056 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server
2026-02-19T21:48:16.114 INFO:teuthology.lock.ops:Start node 'trial093.front.sepia.ceph.com' reimaging
2026-02-19T21:48:16.114 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: reset os type and version on server
2026-02-19T21:48:16.114 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server
2026-02-19T21:48:16.338 DEBUG:teuthology.provision.fog.trial093:Requesting image trial_rocky_10.1 (ID 4)
2026-02-19T21:48:16.346 DEBUG:teuthology.provision.fog.trial031:Requesting image trial_rocky_10.1 (ID 4)
2026-02-19T21:48:16.381 INFO:teuthology.provision.fog.trial093:Scheduling deploy of rocky 10.1
2026-02-19T21:48:16.389 INFO:teuthology.provision.fog.trial031:Scheduling deploy of rocky 10.1
2026-02-19T21:48:17.606 INFO:teuthology.orchestra.console.trial093:Power off
2026-02-19T21:48:17.606 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T21:48:17.617 INFO:teuthology.orchestra.console.trial031:Power off
2026-02-19T21:48:17.617 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-19T21:48:17.645 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off
2026-02-19T21:48:17.655 DEBUG:teuthology.orchestra.console.trial031:power off output: Chassis Power Control: Down/Off
2026-02-19T21:48:21.649 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T21:48:21.657 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T21:48:21.760 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off
2026-02-19T21:48:21.760 INFO:teuthology.orchestra.console.trial093:Power off completed
2026-02-19T21:48:21.767 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is off
2026-02-19T21:48:21.768 INFO:teuthology.orchestra.console.trial031:Power off completed
2026-02-19T21:48:21.862 INFO:teuthology.orchestra.console.trial093:Power on
2026-02-19T21:48:21.862 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T21:48:21.872 INFO:teuthology.orchestra.console.trial031:Power on
2026-02-19T21:48:21.872 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-19T21:48:21.903 DEBUG:teuthology.orchestra.console.trial093:power on output: Chassis Power Control: Up/On
2026-02-19T21:48:21.912 DEBUG:teuthology.orchestra.console.trial031:power on output: Chassis Power Control: Up/On
2026-02-19T21:48:25.906 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T21:48:25.913 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-19T21:48:26.015 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on
2026-02-19T21:48:26.016 INFO:teuthology.orchestra.console.trial093:Power on completed
2026-02-19T21:48:26.021 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is on
2026-02-19T21:48:26.021 INFO:teuthology.orchestra.console.trial031:Power on completed
2026-02-19T21:48:26.117 INFO:teuthology.provision.fog.trial093:Waiting for deploy to finish
2026-02-19T21:48:26.122 INFO:teuthology.provision.fog.trial031:Waiting for deploy to finish
2026-02-19T21:50:13.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:13.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:16.961 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-19T21:50:16.961 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31
2026-02-19T21:50:22.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:22.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:26.048 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-19T21:50:26.048 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31
2026-02-19T21:50:32.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:32.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:35.135 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-19T21:50:35.136 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31
2026-02-19T21:50:41.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:41.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:44.224 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-19T21:50:44.224 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31
2026-02-19T21:50:50.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:50.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:53.312 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-19T21:50:53.312 WARNING:teuthology.provision.fog.trial031:[Errno None] Unable to connect to port 22 on 10.20.193.31
2026-02-19T21:50:59.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:50:59.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:51:35.417 ERROR:teuthology.orchestra.connection:Error authenticating with trial031.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T21:51:35.441 ERROR:teuthology.orchestra.connection:Error authenticating with trial093.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-19T21:51:39.538 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T21:51:39.538 DEBUG:teuthology.orchestra.run.trial031:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T21:51:39.550 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-19T21:51:39.550 DEBUG:teuthology.orchestra.run.trial093:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-19T21:51:39.647 INFO:teuthology.provision.fog.trial031:Node is ready
2026-02-19T21:51:39.647 DEBUG:teuthology.orchestra.run.trial031:> hostname
2026-02-19T21:51:39.701 INFO:teuthology.orchestra.run.trial031.stdout:trial031.front.sepia.ceph.com
2026-02-19T21:51:39.701 DEBUG:teuthology.orchestra.run.trial031:> grep trial031.front.sepia.ceph.com /etc/hosts
2026-02-19T21:51:39.735 INFO:teuthology.provision.fog.trial093:Node is ready
2026-02-19T21:51:39.736 DEBUG:teuthology.orchestra.run.trial093:> hostname
2026-02-19T21:51:39.755 INFO:teuthology.orchestra.run.trial031.stdout:10.20.193.31 trial031.front.sepia.ceph.com trial031
2026-02-19T21:51:39.756 DEBUG:teuthology.orchestra.run.trial031:> sudo hostname trial031
2026-02-19T21:51:39.793 INFO:teuthology.orchestra.run.trial093.stdout:trial093.front.sepia.ceph.com
2026-02-19T21:51:39.794 DEBUG:teuthology.orchestra.run.trial093:> grep trial093.front.sepia.ceph.com /etc/hosts
2026-02-19T21:51:39.826 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/trial031.front.sepia.ceph.com/trial031/g' /etc/hosts
2026-02-19T21:51:39.850 INFO:teuthology.orchestra.run.trial093.stdout:10.20.193.93 trial093.front.sepia.ceph.com trial093
2026-02-19T21:51:39.851 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093
2026-02-19T21:51:39.890 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/10.20.193.31/10.20.193.31/g' /etc/hosts
2026-02-19T21:51:39.923 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hosts
2026-02-19T21:51:39.955 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/trial031.front.sepia.ceph.com/trial031/g' /etc/hostname
2026-02-19T21:51:39.990 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/10.20.193.93/10.20.193.93/g' /etc/hosts
2026-02-19T21:51:40.017 DEBUG:teuthology.orchestra.run.trial031:> sudo hostname trial031
2026-02-19T21:51:40.056 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hostname
2026-02-19T21:51:40.080 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release
2026-02-19T21:51:40.122 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093
2026-02-19T21:51:40.136 INFO:teuthology.orchestra.run.trial031.stdout:NAME="Rocky Linux"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:ID="rocky"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="10.1"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el10"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;32"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:VENDOR_NAME="RESF"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:SUPPORT_END="2035-05-31"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T21:51:40.137 INFO:teuthology.orchestra.run.trial031.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T21:51:40.138 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T21:51:40.138 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T21:51:40.138 INFO:teuthology.provision.fog.trial031:Deploy complete!
2026-02-19T21:51:40.139 DEBUG:teuthology.parallel:result is None
2026-02-19T21:51:40.187 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release
2026-02-19T21:51:40.245 INFO:teuthology.orchestra.run.trial093.stdout:NAME="Rocky Linux"
2026-02-19T21:51:40.245 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:ID="rocky"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="10.1"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el10"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;32"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_NAME="RESF"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:SUPPORT_END="2035-05-31"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T21:51:40.246 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T21:51:40.247 INFO:teuthology.provision.fog.trial093:Deploy complete!
2026-02-19T21:51:40.247 DEBUG:teuthology.parallel:result is None
2026-02-19T21:51:40.625 INFO:teuthology.lock.ops:Checking trial031.front.sepia.ceph.com
2026-02-19T21:51:40.625 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T21:51:40.725 INFO:teuthology.lock.ops:Checking trial093.front.sepia.ceph.com
2026-02-19T21:51:40.725 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-19T21:51:40.785 INFO:teuthology.lock.ops:Updating [trial031.front.sepia.ceph.com]: set os type and version on server
2026-02-19T21:51:40.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com'
2026-02-19T21:51:40.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:51:40.845 DEBUG:teuthology.orchestra.run.trial031:> true
2026-02-19T21:51:40.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com'
2026-02-19T21:51:40.928 DEBUG:teuthology.orchestra.run.trial031:> uname -m
2026-02-19T21:51:40.983 INFO:teuthology.orchestra.run.trial031.stdout:x86_64
2026-02-19T21:51:40.983 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release
2026-02-19T21:51:41.037 INFO:teuthology.orchestra.run.trial031.stdout:NAME="Rocky Linux"
2026-02-19T21:51:41.037 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T21:51:41.037 INFO:teuthology.orchestra.run.trial031.stdout:ID="rocky"
2026-02-19T21:51:41.037 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T21:51:41.037 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="10.1"
2026-02-19T21:51:41.037 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el10"
2026-02-19T21:51:41.037 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;32"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:VENDOR_NAME="RESF"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:SUPPORT_END="2035-05-31"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T21:51:41.038 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T21:51:41.039 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server
2026-02-19T21:51:41.143 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: set os type and version on server
2026-02-19T21:51:41.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com'
2026-02-19T21:51:41.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-19T21:51:41.212 DEBUG:teuthology.orchestra.run.trial093:> true
2026-02-19T21:51:41.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com'
2026-02-19T21:51:41.296 DEBUG:teuthology.orchestra.run.trial093:> uname -m
2026-02-19T21:51:41.351 INFO:teuthology.orchestra.run.trial093.stdout:x86_64
2026-02-19T21:51:41.351 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:NAME="Rocky Linux"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="10.1 (Red Quartz)"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:ID="rocky"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel centos fedora"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="10.1"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el10"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;32"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://rockylinux.org/"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_NAME="RESF"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:VENDOR_URL="https://resf.org/"
2026-02-19T21:51:41.405 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-19T21:51:41.406 INFO:teuthology.orchestra.run.trial093.stdout:SUPPORT_END="2035-05-31"
2026-02-19T21:51:41.406 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-19T21:51:41.406 INFO:teuthology.orchestra.run.trial093.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T21:51:41.406 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-19T21:51:41.406 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-19T21:51:41.406 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server
2026-02-19T21:51:41.472 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T21:51:41.562 INFO:teuthology.dispatcher.supervisor:Running job 58505
2026-02-19T21:51:41.562 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58505 --name skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial --description fs/functional/{0-use-snaprealm/{subvol} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/test_snap_schedule/{overrides/{v1} snap-schedule}} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58505/orig.config.yaml
2026-02-19T21:51:41.563 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58505
2026-02-19T21:51:41.563 INFO:teuthology.dispatcher.supervisor:Job PID: 1966830
2026-02-19T21:51:41.563 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-19T21:53:41.613 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T21:55:41.756 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T21:57:41.967 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T21:59:42.162 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:01:42.336 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:03:42.523 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:05:42.656 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:07:42.836 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:09:42.979 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:11:43.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:13:43.376 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:15:43.482 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:17:43.655 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:19:43.825 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:21:44.006 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:23:44.164 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:25:44.362 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:27:44.543 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:29:44.729 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:31:44.929 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:33:45.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:35:45.324 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:37:45.467 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:39:45.668 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:41:45.868 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:43:46.001 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:45:48.333 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:47:48.511 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:49:48.685 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:51:48.866 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:53:49.059 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:55:49.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:57:49.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T22:59:50.977 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:01:51.165 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:03:51.378 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:05:51.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:07:51.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:09:51.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:11:52.041 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:13:52.196 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:15:52.348 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:17:52.545 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:19:52.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:21:52.932 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:23:53.134 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:25:53.266 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:27:53.461 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:29:53.541 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:31:53.730 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:33:53.936 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:35:54.135 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:37:54.319 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:39:54.495 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:41:54.676 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:43:54.856 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:45:55.013 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:47:55.177 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:49:55.269 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:51:55.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:53:55.664 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:55:55.861 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:57:56.032 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-19T23:59:56.163 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:01:56.362 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:03:56.512 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:05:56.719 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:07:56.925 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:09:57.080 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:11:57.264 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:13:57.459 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:15:57.625 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:17:57.821 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:19:57.958 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:21:58.128 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T00:21:58.205 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-20T00:21:58.317 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-20T00:21:58.834 INFO:teuthology.orchestra.console.trial093:Power off
2026-02-20T00:21:58.835 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T00:21:58.854 INFO:teuthology.orchestra.console.trial031:Power off
2026-02-20T00:21:58.854 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T00:21:58.875 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off
2026-02-20T00:21:58.892 DEBUG:teuthology.orchestra.console.trial031:power off output: Chassis Power Control: Down/Off
2026-02-20T00:22:02.879 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:22:02.893 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:22:02.989 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on
2026-02-20T00:22:03.001 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is on
2026-02-20T00:22:06.993 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:22:07.002 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T00:22:07.105 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off
2026-02-20T00:22:07.105 INFO:teuthology.orchestra.console.trial093:Power off completed
2026-02-20T00:22:07.112 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is off
2026-02-20T00:22:07.112 INFO:teuthology.orchestra.console.trial031:Power off completed
2026-02-20T00:22:07.357 INFO:teuthology.lock.ops:unlocked: trial093.front.sepia.ceph.com
2026-02-20T00:22:07.368 INFO:teuthology.lock.ops:unlocked: trial031.front.sepia.ceph.com