2026-02-13T22:43:56.634 INFO:root:teuthology version: 1.2.4.dev6+g76f36e686
2026-02-13T22:43:56.635 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T22:43:56.709 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T22:43:56.964 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x78cb4c6a9700>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x78cb4be905e0>, signals=[15])
2026-02-13T22:43:56.964 INFO:teuthology.lock.ops:Start node 'trial010.front.sepia.ceph.com' reimaging
2026-02-13T22:43:56.965 INFO:teuthology.lock.ops:Updating [trial010.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T22:43:56.965 INFO:teuthology.lock.ops:Updating trial010.front.sepia.ceph.com on lock server
2026-02-13T22:43:57.023 INFO:teuthology.lock.ops:Start node 'trial065.front.sepia.ceph.com' reimaging
2026-02-13T22:43:57.023 INFO:teuthology.lock.ops:Updating [trial065.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T22:43:57.023 INFO:teuthology.lock.ops:Updating trial065.front.sepia.ceph.com on lock server
2026-02-13T22:43:57.082 INFO:teuthology.lock.ops:Start node 'trial069.front.sepia.ceph.com' reimaging
2026-02-13T22:43:57.082 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T22:43:57.082 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server
2026-02-13T22:43:57.284 DEBUG:teuthology.provision.fog.trial010:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T22:43:57.330 DEBUG:teuthology.provision.fog.trial065:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T22:43:57.364 DEBUG:teuthology.provision.fog.trial069:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T22:43:57.382 INFO:teuthology.provision.fog.trial010:Scheduling deploy of centos 9.stream
2026-02-13T22:43:57.385 INFO:teuthology.provision.fog.trial065:Scheduling deploy of centos 9.stream
2026-02-13T22:43:57.417 INFO:teuthology.provision.fog.trial069:Scheduling deploy of centos 9.stream
2026-02-13T22:43:58.748 INFO:teuthology.orchestra.console.trial010:Power off
2026-02-13T22:43:58.748 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T22:43:58.760 INFO:teuthology.orchestra.console.trial065:Power off
2026-02-13T22:43:58.760 DEBUG:teuthology.orchestra.console.trial065:pexpect command: ipmitool -H trial065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T22:43:58.767 INFO:teuthology.orchestra.console.trial069:Power off
2026-02-13T22:43:58.768 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T22:43:58.787 DEBUG:teuthology.orchestra.console.trial010:power off output: Chassis Power Control: Down/Off
2026-02-13T22:43:58.800 DEBUG:teuthology.orchestra.console.trial065:power off output: Chassis Power Control: Down/Off
2026-02-13T22:43:58.806 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off
2026-02-13T22:44:02.792 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T22:44:02.800 DEBUG:teuthology.orchestra.console.trial065:pexpect command: ipmitool -H trial065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T22:44:02.806 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T22:44:02.900 DEBUG:teuthology.orchestra.console.trial010:check power output: Chassis Power is off
2026-02-13T22:44:02.901 INFO:teuthology.orchestra.console.trial010:Power off completed
2026-02-13T22:44:02.907 DEBUG:teuthology.orchestra.console.trial065:check power output: Chassis Power is off
2026-02-13T22:44:02.907 INFO:teuthology.orchestra.console.trial065:Power off completed
2026-02-13T22:44:02.912 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off
2026-02-13T22:44:02.912 INFO:teuthology.orchestra.console.trial069:Power off completed
2026-02-13T22:44:03.002 INFO:teuthology.orchestra.console.trial010:Power on
2026-02-13T22:44:03.002 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T22:44:03.008 INFO:teuthology.orchestra.console.trial065:Power on
2026-02-13T22:44:03.008 DEBUG:teuthology.orchestra.console.trial065:pexpect command: ipmitool -H trial065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T22:44:03.014 INFO:teuthology.orchestra.console.trial069:Power on
2026-02-13T22:44:03.014 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T22:44:03.041 DEBUG:teuthology.orchestra.console.trial010:power on output: Chassis Power Control: Up/On
2026-02-13T22:44:03.045 DEBUG:teuthology.orchestra.console.trial065:power on output: Chassis Power Control: Up/On
2026-02-13T22:44:03.051 DEBUG:teuthology.orchestra.console.trial069:power on output: Chassis Power Control: Up/On
2026-02-13T22:44:07.045 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T22:44:07.051 DEBUG:teuthology.orchestra.console.trial065:pexpect command: ipmitool -H trial065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T22:44:07.059 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T22:44:07.155 DEBUG:teuthology.orchestra.console.trial010:check power output: Chassis Power is on
2026-02-13T22:44:07.155 INFO:teuthology.orchestra.console.trial010:Power on completed
2026-02-13T22:44:07.161 DEBUG:teuthology.orchestra.console.trial065:check power output: Chassis Power is on
2026-02-13T22:44:07.161 INFO:teuthology.orchestra.console.trial065:Power on completed
2026-02-13T22:44:07.169 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on
2026-02-13T22:44:07.169 INFO:teuthology.orchestra.console.trial069:Power on completed
2026-02-13T22:44:07.256 INFO:teuthology.provision.fog.trial010:Waiting for deploy to finish
2026-02-13T22:44:07.262 INFO:teuthology.provision.fog.trial065:Waiting for deploy to finish
2026-02-13T22:44:07.270 INFO:teuthology.provision.fog.trial069:Waiting for deploy to finish
2026-02-13T22:45:54.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:45:54.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:45:54.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:45:57.853 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-13T22:45:57.853 WARNING:teuthology.provision.fog.trial010:[Errno None] Unable to connect to port 22 on 10.20.193.10
2026-02-13T22:46:03.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:03.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:06.941 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-13T22:46:06.941 WARNING:teuthology.provision.fog.trial010:[Errno None] Unable to connect to port 22 on 10.20.193.10
2026-02-13T22:46:12.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:12.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:16.029 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-13T22:46:16.029 WARNING:teuthology.provision.fog.trial010:[Errno None] Unable to connect to port 22 on 10.20.193.10
2026-02-13T22:46:22.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:22.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:25.117 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-13T22:46:25.117 WARNING:teuthology.provision.fog.trial010:[Errno None] Unable to connect to port 22 on 10.20.193.10
2026-02-13T22:46:31.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:31.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:34.205 WARNING:teuthology.provision.fog.trial069:[Errno None] Unable to connect to port 22 on 10.20.193.69
2026-02-13T22:46:34.205 WARNING:teuthology.provision.fog.trial010:[Errno None] Unable to connect to port 22 on 10.20.193.10
2026-02-13T22:46:40.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:40.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:46:54.752 WARNING:teuthology.provision.fog.trial065:timed out
2026-02-13T22:47:00.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:47:08.069 ERROR:teuthology.orchestra.connection:Error authenticating with trial065.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T22:47:12.194 ERROR:teuthology.orchestra.connection:Error authenticating with trial065.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T22:47:16.017 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T22:47:16.017 DEBUG:teuthology.orchestra.run.trial010:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T22:47:16.018 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T22:47:16.018 DEBUG:teuthology.orchestra.run.trial069:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T22:47:16.160 INFO:teuthology.provision.fog.trial010:Node is ready
2026-02-13T22:47:16.161 DEBUG:teuthology.orchestra.run.trial010:> hostname
2026-02-13T22:47:16.169 INFO:teuthology.provision.fog.trial069:Node is ready
2026-02-13T22:47:16.169 DEBUG:teuthology.orchestra.run.trial069:> hostname
2026-02-13T22:47:16.216 INFO:teuthology.orchestra.run.trial010.stdout:trial010.front.sepia.ceph.com
2026-02-13T22:47:16.216 DEBUG:teuthology.orchestra.run.trial010:> grep trial010.front.sepia.ceph.com /etc/hosts
2026-02-13T22:47:16.225 INFO:teuthology.orchestra.run.trial069.stdout:trial069.front.sepia.ceph.com
2026-02-13T22:47:16.226 DEBUG:teuthology.orchestra.run.trial069:> grep trial069.front.sepia.ceph.com /etc/hosts
2026-02-13T22:47:16.273 INFO:teuthology.orchestra.run.trial010.stdout:10.20.193.10 trial010.front.sepia.ceph.com trial010
2026-02-13T22:47:16.274 DEBUG:teuthology.orchestra.run.trial010:> sudo hostname trial010
2026-02-13T22:47:16.281 INFO:teuthology.orchestra.run.trial069.stdout:10.20.193.69 trial069.front.sepia.ceph.com trial069
2026-02-13T22:47:16.282 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069
2026-02-13T22:47:16.343 DEBUG:teuthology.orchestra.run.trial010:> sudo sed -i -e 's/trial010.front.sepia.ceph.com/trial010/g' /etc/hosts
2026-02-13T22:47:16.350 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hosts
2026-02-13T22:47:16.407 DEBUG:teuthology.orchestra.run.trial010:> sudo sed -i -e 's/10.20.193.10/10.20.193.10/g' /etc/hosts
2026-02-13T22:47:16.415 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/10.20.193.69/10.20.193.69/g' /etc/hosts
2026-02-13T22:47:16.472 DEBUG:teuthology.orchestra.run.trial010:> sudo sed -i -e 's/trial010.front.sepia.ceph.com/trial010/g' /etc/hostname
2026-02-13T22:47:16.479 DEBUG:teuthology.orchestra.run.trial069:> sudo sed -i -e 's/trial069.front.sepia.ceph.com/trial069/g' /etc/hostname
2026-02-13T22:47:16.537 DEBUG:teuthology.orchestra.run.trial010:> sudo hostname trial010
2026-02-13T22:47:16.542 DEBUG:teuthology.orchestra.run.trial069:> sudo hostname trial069
2026-02-13T22:47:16.601 DEBUG:teuthology.orchestra.run.trial010:> cat /etc/os-release
2026-02-13T22:47:16.606 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:NAME="CentOS Stream"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:VERSION="9"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:ID="centos"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:ID_LIKE="rhel fedora"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:VERSION_ID="9"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:PLATFORM_ID="platform:el9"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:ANSI_COLOR="0;31"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:LOGO="fedora-logo-icon"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T22:47:16.656 INFO:teuthology.orchestra.run.trial010.stdout:HOME_URL="https://centos.org/"
2026-02-13T22:47:16.657 INFO:teuthology.orchestra.run.trial010.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T22:47:16.657 INFO:teuthology.orchestra.run.trial010.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T22:47:16.657 INFO:teuthology.orchestra.run.trial010.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T22:47:16.657 INFO:teuthology.provision.fog.trial010:Deploy complete!
2026-02-13T22:47:16.657 DEBUG:teuthology.parallel:result is None
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T22:47:16.663 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T22:47:16.663 INFO:teuthology.provision.fog.trial069:Deploy complete!
2026-02-13T22:47:16.663 DEBUG:teuthology.parallel:result is None
2026-02-13T22:47:19.300 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T22:47:19.300 DEBUG:teuthology.orchestra.run.trial065:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T22:47:19.451 INFO:teuthology.provision.fog.trial065:Node is ready
2026-02-13T22:47:19.451 DEBUG:teuthology.orchestra.run.trial065:> hostname
2026-02-13T22:47:19.509 INFO:teuthology.orchestra.run.trial065.stdout:trial065.front.sepia.ceph.com
2026-02-13T22:47:19.509 DEBUG:teuthology.orchestra.run.trial065:> grep trial065.front.sepia.ceph.com /etc/hosts
2026-02-13T22:47:19.566 INFO:teuthology.orchestra.run.trial065.stdout:10.20.193.65 trial065.front.sepia.ceph.com trial065
2026-02-13T22:47:19.566 DEBUG:teuthology.orchestra.run.trial065:> sudo hostname trial065
2026-02-13T22:47:19.634 DEBUG:teuthology.orchestra.run.trial065:> sudo sed -i -e 's/trial065.front.sepia.ceph.com/trial065/g' /etc/hosts
2026-02-13T22:47:19.699 DEBUG:teuthology.orchestra.run.trial065:> sudo sed -i -e 's/10.20.193.65/10.20.193.65/g' /etc/hosts
2026-02-13T22:47:19.764 DEBUG:teuthology.orchestra.run.trial065:> sudo sed -i -e 's/trial065.front.sepia.ceph.com/trial065/g' /etc/hostname
2026-02-13T22:47:19.829 DEBUG:teuthology.orchestra.run.trial065:> sudo hostname trial065
2026-02-13T22:47:19.893 DEBUG:teuthology.orchestra.run.trial065:> cat /etc/os-release
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:NAME="CentOS Stream"
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:VERSION="9"
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:ID="centos"
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:ID_LIKE="rhel fedora"
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:VERSION_ID="9"
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:PLATFORM_ID="platform:el9"
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:ANSI_COLOR="0;31"
2026-02-13T22:47:19.950 INFO:teuthology.orchestra.run.trial065.stdout:LOGO="fedora-logo-icon"
2026-02-13T22:47:19.951 INFO:teuthology.orchestra.run.trial065.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T22:47:19.951 INFO:teuthology.orchestra.run.trial065.stdout:HOME_URL="https://centos.org/"
2026-02-13T22:47:19.951 INFO:teuthology.orchestra.run.trial065.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T22:47:19.951 INFO:teuthology.orchestra.run.trial065.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T22:47:19.951 INFO:teuthology.orchestra.run.trial065.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T22:47:19.951 INFO:teuthology.provision.fog.trial065:Deploy complete!
2026-02-13T22:47:19.952 DEBUG:teuthology.parallel:result is None
2026-02-13T22:47:20.476 INFO:teuthology.lock.ops:Checking trial010.front.sepia.ceph.com
2026-02-13T22:47:20.477 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T22:47:20.552 INFO:teuthology.lock.ops:Checking trial065.front.sepia.ceph.com
2026-02-13T22:47:20.552 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T22:47:20.610 INFO:teuthology.lock.ops:Checking trial069.front.sepia.ceph.com
2026-02-13T22:47:20.611 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T22:47:20.668 INFO:teuthology.lock.ops:Updating [trial010.front.sepia.ceph.com]: set os type and version on server
2026-02-13T22:47:20.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial010.front.sepia.ceph.com'
2026-02-13T22:47:20.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:47:20.732 DEBUG:teuthology.orchestra.run.trial010:> true
2026-02-13T22:47:20.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial010.front.sepia.ceph.com'
2026-02-13T22:47:20.804 DEBUG:teuthology.orchestra.run.trial010:> uname -m
2026-02-13T22:47:20.859 INFO:teuthology.orchestra.run.trial010.stdout:x86_64
2026-02-13T22:47:20.859 DEBUG:teuthology.orchestra.run.trial010:> cat /etc/os-release
2026-02-13T22:47:20.914 INFO:teuthology.orchestra.run.trial010.stdout:NAME="CentOS Stream"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:VERSION="9"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:ID="centos"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:ID_LIKE="rhel fedora"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:VERSION_ID="9"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:PLATFORM_ID="platform:el9"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:ANSI_COLOR="0;31"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:LOGO="fedora-logo-icon"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T22:47:20.915 INFO:teuthology.orchestra.run.trial010.stdout:HOME_URL="https://centos.org/"
2026-02-13T22:47:20.916 INFO:teuthology.orchestra.run.trial010.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T22:47:20.916 INFO:teuthology.orchestra.run.trial010.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T22:47:20.916 INFO:teuthology.orchestra.run.trial010.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T22:47:20.916 INFO:teuthology.lock.ops:Updating trial010.front.sepia.ceph.com on lock server
2026-02-13T22:47:21.020 INFO:teuthology.lock.ops:Updating [trial065.front.sepia.ceph.com]: set os type and version on server
2026-02-13T22:47:21.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial065.front.sepia.ceph.com'
2026-02-13T22:47:21.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial065.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:47:21.091 DEBUG:teuthology.orchestra.run.trial065:> true
2026-02-13T22:47:21.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial065.front.sepia.ceph.com'
2026-02-13T22:47:21.167 DEBUG:teuthology.orchestra.run.trial065:> uname -m
2026-02-13T22:47:21.223 INFO:teuthology.orchestra.run.trial065.stdout:x86_64
2026-02-13T22:47:21.224 DEBUG:teuthology.orchestra.run.trial065:> cat /etc/os-release
2026-02-13T22:47:21.279 INFO:teuthology.orchestra.run.trial065.stdout:NAME="CentOS Stream"
2026-02-13T22:47:21.279 INFO:teuthology.orchestra.run.trial065.stdout:VERSION="9"
2026-02-13T22:47:21.279 INFO:teuthology.orchestra.run.trial065.stdout:ID="centos"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:ID_LIKE="rhel fedora"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:VERSION_ID="9"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:PLATFORM_ID="platform:el9"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:ANSI_COLOR="0;31"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:LOGO="fedora-logo-icon"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:HOME_URL="https://centos.org/"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T22:47:21.280 INFO:teuthology.orchestra.run.trial065.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T22:47:21.281 INFO:teuthology.lock.ops:Updating trial065.front.sepia.ceph.com on lock server
2026-02-13T22:47:21.388 INFO:teuthology.lock.ops:Updating [trial069.front.sepia.ceph.com]: set os type and version on server
2026-02-13T22:47:21.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial069.front.sepia.ceph.com'
2026-02-13T22:47:21.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T22:47:21.459 DEBUG:teuthology.orchestra.run.trial069:> true
2026-02-13T22:47:21.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial069.front.sepia.ceph.com'
2026-02-13T22:47:21.535 DEBUG:teuthology.orchestra.run.trial069:> uname -m
2026-02-13T22:47:21.590 INFO:teuthology.orchestra.run.trial069.stdout:x86_64
2026-02-13T22:47:21.590 DEBUG:teuthology.orchestra.run.trial069:> cat /etc/os-release
2026-02-13T22:47:21.645 INFO:teuthology.orchestra.run.trial069.stdout:NAME="CentOS Stream"
2026-02-13T22:47:21.645 INFO:teuthology.orchestra.run.trial069.stdout:VERSION="9"
2026-02-13T22:47:21.645 INFO:teuthology.orchestra.run.trial069.stdout:ID="centos"
2026-02-13T22:47:21.645 INFO:teuthology.orchestra.run.trial069.stdout:ID_LIKE="rhel fedora"
2026-02-13T22:47:21.645 INFO:teuthology.orchestra.run.trial069.stdout:VERSION_ID="9"
2026-02-13T22:47:21.645 INFO:teuthology.orchestra.run.trial069.stdout:PLATFORM_ID="platform:el9"
2026-02-13T22:47:21.646 INFO:teuthology.orchestra.run.trial069.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T22:47:21.646 INFO:teuthology.orchestra.run.trial069.stdout:ANSI_COLOR="0;31"
2026-02-13T22:47:21.646 INFO:teuthology.orchestra.run.trial069.stdout:LOGO="fedora-logo-icon"
2026-02-13T22:47:21.646 INFO:teuthology.orchestra.run.trial069.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T22:47:21.646 INFO:teuthology.orchestra.run.trial069.stdout:HOME_URL="https://centos.org/"
2026-02-13T22:47:21.646 INFO:teuthology.orchestra.run.trial069.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T22:47:21.646 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T22:47:21.646 INFO:teuthology.orchestra.run.trial069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T22:47:21.647 INFO:teuthology.lock.ops:Updating trial069.front.sepia.ceph.com on lock server
2026-02-13T22:47:21.755 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T22:47:21.857 INFO:teuthology.dispatcher.supervisor:Running job 50262
2026-02-13T22:47:21.857 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50262 --name pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50262/orig.config.yaml
2026-02-13T22:47:21.857 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50262
2026-02-13T22:47:21.857 INFO:teuthology.dispatcher.supervisor:Job PID: 521811
2026-02-13T22:47:21.857 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T22:49:21.955 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T22:51:22.187 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T22:53:22.414 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T22:55:22.625 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T22:57:22.767 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T22:59:22.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:01:23.088 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:03:23.212 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:05:23.430 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:07:23.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:09:23.739 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:11:23.883 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:13:24.038 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:15:24.208 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:17:24.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:19:24.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:19:24.512 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-13T23:19:24.691 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T23:19:25.460 INFO:teuthology.orchestra.console.trial065:Power off
2026-02-13T23:19:25.460 DEBUG:teuthology.orchestra.console.trial065:pexpect command: ipmitool -H trial065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:19:25.472 INFO:teuthology.orchestra.console.trial069:Power off
2026-02-13T23:19:25.473 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:19:25.484 INFO:teuthology.orchestra.console.trial010:Power off
2026-02-13T23:19:25.484 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:19:25.500 DEBUG:teuthology.orchestra.console.trial065:power off output: Chassis Power Control: Down/Off
2026-02-13T23:19:25.512 DEBUG:teuthology.orchestra.console.trial069:power off output: Chassis Power Control: Down/Off
2026-02-13T23:19:25.525 DEBUG:teuthology.orchestra.console.trial010:power off output: Chassis Power Control: Down/Off
2026-02-13T23:19:29.505 DEBUG:teuthology.orchestra.console.trial065:pexpect command: ipmitool -H trial065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:19:29.513 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:19:29.526 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:19:29.615 DEBUG:teuthology.orchestra.console.trial065:check power output: Chassis Power is on
2026-02-13T23:19:29.622 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is on
2026-02-13T23:19:29.634 DEBUG:teuthology.orchestra.console.trial010:check power output: Chassis Power is on
2026-02-13T23:19:33.618 DEBUG:teuthology.orchestra.console.trial065:pexpect command: ipmitool -H trial065.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:19:33.625 DEBUG:teuthology.orchestra.console.trial069:pexpect command: ipmitool -H trial069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:19:33.635 DEBUG:teuthology.orchestra.console.trial010:pexpect command: ipmitool -H trial010.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:19:33.727 DEBUG:teuthology.orchestra.console.trial065:check power output: Chassis Power is off
2026-02-13T23:19:33.727 INFO:teuthology.orchestra.console.trial065:Power off completed
2026-02-13T23:19:33.733 DEBUG:teuthology.orchestra.console.trial069:check power output: Chassis Power is off
2026-02-13T23:19:33.733 INFO:teuthology.orchestra.console.trial069:Power off completed
2026-02-13T23:19:33.744 DEBUG:teuthology.orchestra.console.trial010:check power output: Chassis Power is off
2026-02-13T23:19:33.745 INFO:teuthology.orchestra.console.trial010:Power off completed
2026-02-13T23:19:33.992 INFO:teuthology.lock.ops:unlocked: trial065.front.sepia.ceph.com
2026-02-13T23:19:34.000 INFO:teuthology.lock.ops:unlocked: trial069.front.sepia.ceph.com
2026-02-13T23:19:34.005 INFO:teuthology.lock.ops:unlocked: trial010.front.sepia.ceph.com