2026-02-14T01:22:35.963 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-14T01:22:35.963 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:22:36.035 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:22:36.294 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7a5d9570bc20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7a5d956b6a20>, signals=[15])
2026-02-14T01:22:36.294 INFO:teuthology.lock.ops:Start node 'trial026.front.sepia.ceph.com' reimaging
2026-02-14T01:22:36.294 INFO:teuthology.lock.ops:Updating [trial026.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:22:36.294 INFO:teuthology.lock.ops:Updating trial026.front.sepia.ceph.com on lock server
2026-02-14T01:22:36.359 INFO:teuthology.lock.ops:Start node 'trial151.front.sepia.ceph.com' reimaging
2026-02-14T01:22:36.359 INFO:teuthology.lock.ops:Updating [trial151.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:22:36.359 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server
2026-02-14T01:22:36.432 INFO:teuthology.lock.ops:Start node 'trial176.front.sepia.ceph.com' reimaging
2026-02-14T01:22:36.432 INFO:teuthology.lock.ops:Updating [trial176.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:22:36.432 INFO:teuthology.lock.ops:Updating trial176.front.sepia.ceph.com on lock server
2026-02-14T01:22:36.642 DEBUG:teuthology.provision.fog.trial151:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:22:36.689 DEBUG:teuthology.provision.fog.trial026:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:22:36.696 INFO:teuthology.provision.fog.trial151:Scheduling deploy of centos 9.stream
2026-02-14T01:22:36.741 INFO:teuthology.provision.fog.trial026:Scheduling deploy of centos 9.stream
2026-02-14T01:22:36.745 DEBUG:teuthology.provision.fog.trial176:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:22:36.796 INFO:teuthology.provision.fog.trial176:Scheduling deploy of centos 9.stream
2026-02-14T01:22:37.826 INFO:teuthology.orchestra.console.trial026:Power off
2026-02-14T01:22:37.826 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:22:37.839 INFO:teuthology.orchestra.console.trial176:Power off
2026-02-14T01:22:37.839 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:22:37.849 INFO:teuthology.orchestra.console.trial151:Power off
2026-02-14T01:22:37.849 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:22:37.868 DEBUG:teuthology.orchestra.console.trial026:power off output: Chassis Power Control: Down/Off
2026-02-14T01:22:37.876 DEBUG:teuthology.orchestra.console.trial176:power off output: Chassis Power Control: Down/Off
2026-02-14T01:22:37.886 DEBUG:teuthology.orchestra.console.trial151:power off output: Chassis Power Control: Down/Off
2026-02-14T01:22:41.873 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:22:41.879 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:22:41.887 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:22:41.981 DEBUG:teuthology.orchestra.console.trial026:check power output: Chassis Power is off
2026-02-14T01:22:41.982 INFO:teuthology.orchestra.console.trial026:Power off completed
2026-02-14T01:22:41.987 DEBUG:teuthology.orchestra.console.trial176:check power output: Chassis Power is off
2026-02-14T01:22:41.987 INFO:teuthology.orchestra.console.trial176:Power off completed
2026-02-14T01:22:41.995 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is off
2026-02-14T01:22:41.995 INFO:teuthology.orchestra.console.trial151:Power off completed
2026-02-14T01:22:42.082 INFO:teuthology.orchestra.console.trial026:Power on
2026-02-14T01:22:42.083 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:22:42.091 INFO:teuthology.orchestra.console.trial176:Power on
2026-02-14T01:22:42.092 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:22:42.100 INFO:teuthology.orchestra.console.trial151:Power on
2026-02-14T01:22:42.101 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:22:42.123 DEBUG:teuthology.orchestra.console.trial026:power on output: Chassis Power Control: Up/On
2026-02-14T01:22:42.132 DEBUG:teuthology.orchestra.console.trial176:power on output: Chassis Power Control: Up/On
2026-02-14T01:22:42.140 DEBUG:teuthology.orchestra.console.trial151:power on output: Chassis Power Control: Up/On
2026-02-14T01:22:46.128 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:22:46.137 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:22:46.145 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:22:46.239 DEBUG:teuthology.orchestra.console.trial026:check power output: Chassis Power is on
2026-02-14T01:22:46.239 INFO:teuthology.orchestra.console.trial026:Power on completed
2026-02-14T01:22:46.247 DEBUG:teuthology.orchestra.console.trial176:check power output: Chassis Power is on
2026-02-14T01:22:46.247 INFO:teuthology.orchestra.console.trial176:Power on completed
2026-02-14T01:22:46.253 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is on
2026-02-14T01:22:46.253 INFO:teuthology.orchestra.console.trial151:Power on completed
2026-02-14T01:22:46.340 INFO:teuthology.provision.fog.trial026:Waiting for deploy to finish
2026-02-14T01:22:46.348 INFO:teuthology.provision.fog.trial176:Waiting for deploy to finish
2026-02-14T01:22:46.353 INFO:teuthology.provision.fog.trial151:Waiting for deploy to finish
2026-02-14T01:24:33.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:24:33.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:24:33.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:24:33.877 ERROR:teuthology.orchestra.connection:Error authenticating with trial176.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-14T01:24:36.829 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-14T01:24:42.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:24:45.917 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-14T01:24:51.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:24:55.005 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-14T01:25:01.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:04.093 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-14T01:25:10.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:13.181 WARNING:teuthology.provision.fog.trial151:[Errno None] Unable to connect to port 22 on 10.20.193.151
2026-02-14T01:25:19.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:33.742 WARNING:teuthology.provision.fog.trial026:timed out
2026-02-14T01:25:37.880 WARNING:teuthology.provision.fog.trial176:timed out
2026-02-14T01:25:39.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:43.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:47.086 ERROR:teuthology.orchestra.connection:Error authenticating with trial176.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T01:25:51.089 ERROR:teuthology.orchestra.connection:Error authenticating with trial026.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T01:25:51.189 ERROR:teuthology.orchestra.connection:Error authenticating with trial176.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T01:25:55.157 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:25:55.158 DEBUG:teuthology.orchestra.run.trial151:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:25:55.169 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:25:55.169 DEBUG:teuthology.orchestra.run.trial026:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:25:55.271 INFO:teuthology.provision.fog.trial151:Node is ready
2026-02-14T01:25:55.272 DEBUG:teuthology.orchestra.run.trial151:> hostname
2026-02-14T01:25:55.327 INFO:teuthology.orchestra.run.trial151.stdout:trial151.front.sepia.ceph.com
2026-02-14T01:25:55.327 DEBUG:teuthology.orchestra.run.trial151:> grep trial151.front.sepia.ceph.com /etc/hosts
2026-02-14T01:25:55.384 INFO:teuthology.orchestra.run.trial151.stdout:10.20.193.151 trial151.front.sepia.ceph.com trial151
2026-02-14T01:25:55.385 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname trial151
2026-02-14T01:25:55.456 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/trial151.front.sepia.ceph.com/trial151/g' /etc/hosts
2026-02-14T01:25:55.522 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/10.20.193.151/10.20.193.151/g' /etc/hosts
2026-02-14T01:25:55.587 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/trial151.front.sepia.ceph.com/trial151/g' /etc/hostname
2026-02-14T01:25:55.651 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname trial151
2026-02-14T01:25:55.715 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:NAME="CentOS Stream"
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="9"
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:ID="centos"
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="9"
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;31"
2026-02-14T01:25:55.772 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:25:55.773 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:25:55.773 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:25:55.773 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:25:55.773 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:25:55.773 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:25:55.774 INFO:teuthology.provision.fog.trial151:Deploy complete!
2026-02-14T01:25:55.775 DEBUG:teuthology.parallel:result is None
2026-02-14T01:25:58.299 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:25:58.299 DEBUG:teuthology.orchestra.run.trial176:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:25:58.493 INFO:teuthology.provision.fog.trial176:Node is ready
2026-02-14T01:25:58.493 DEBUG:teuthology.orchestra.run.trial176:> hostname
2026-02-14T01:25:58.550 INFO:teuthology.orchestra.run.trial176.stdout:trial176.front.sepia.ceph.com
2026-02-14T01:25:58.550 DEBUG:teuthology.orchestra.run.trial176:> grep trial176.front.sepia.ceph.com /etc/hosts
2026-02-14T01:25:58.606 INFO:teuthology.orchestra.run.trial176.stdout:10.20.193.176 trial176.front.sepia.ceph.com trial176
2026-02-14T01:25:58.607 DEBUG:teuthology.orchestra.run.trial176:> sudo hostname trial176
2026-02-14T01:25:58.676 DEBUG:teuthology.orchestra.run.trial176:> sudo sed -i -e 's/trial176.front.sepia.ceph.com/trial176/g' /etc/hosts
2026-02-14T01:25:58.741 DEBUG:teuthology.orchestra.run.trial176:> sudo sed -i -e 's/10.20.193.176/10.20.193.176/g' /etc/hosts
2026-02-14T01:25:58.805 DEBUG:teuthology.orchestra.run.trial176:> sudo sed -i -e 's/trial176.front.sepia.ceph.com/trial176/g' /etc/hostname
2026-02-14T01:25:58.868 DEBUG:teuthology.orchestra.run.trial176:> sudo hostname trial176
2026-02-14T01:25:58.934 DEBUG:teuthology.orchestra.run.trial176:> cat /etc/os-release
2026-02-14T01:25:58.990 INFO:teuthology.orchestra.run.trial176.stdout:NAME="CentOS Stream"
2026-02-14T01:25:58.990 INFO:teuthology.orchestra.run.trial176.stdout:VERSION="9"
2026-02-14T01:25:58.990 INFO:teuthology.orchestra.run.trial176.stdout:ID="centos"
2026-02-14T01:25:58.990 INFO:teuthology.orchestra.run.trial176.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:25:58.990 INFO:teuthology.orchestra.run.trial176.stdout:VERSION_ID="9"
2026-02-14T01:25:58.990 INFO:teuthology.orchestra.run.trial176.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:25:58.991 INFO:teuthology.orchestra.run.trial176.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:25:58.991 INFO:teuthology.orchestra.run.trial176.stdout:ANSI_COLOR="0;31"
2026-02-14T01:25:58.991 INFO:teuthology.orchestra.run.trial176.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:25:58.991 INFO:teuthology.orchestra.run.trial176.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:25:58.991 INFO:teuthology.orchestra.run.trial176.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:25:58.991 INFO:teuthology.orchestra.run.trial176.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:25:58.991 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:25:58.991 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:25:58.992 INFO:teuthology.provision.fog.trial176:Deploy complete!
2026-02-14T01:25:58.992 DEBUG:teuthology.parallel:result is None
2026-02-14T01:26:00.313 INFO:teuthology.provision.fog.trial026:Node is ready
2026-02-14T01:26:00.313 DEBUG:teuthology.orchestra.run.trial026:> hostname
2026-02-14T01:26:00.331 INFO:teuthology.orchestra.run.trial026.stdout:trial026.front.sepia.ceph.com
2026-02-14T01:26:00.331 DEBUG:teuthology.orchestra.run.trial026:> grep trial026.front.sepia.ceph.com /etc/hosts
2026-02-14T01:26:00.387 INFO:teuthology.orchestra.run.trial026.stdout:10.20.193.26 trial026.front.sepia.ceph.com trial026
2026-02-14T01:26:00.388 DEBUG:teuthology.orchestra.run.trial026:> sudo hostname trial026
2026-02-14T01:26:00.458 DEBUG:teuthology.orchestra.run.trial026:> sudo sed -i -e 's/trial026.front.sepia.ceph.com/trial026/g' /etc/hosts
2026-02-14T01:26:00.524 DEBUG:teuthology.orchestra.run.trial026:> sudo sed -i -e 's/10.20.193.26/10.20.193.26/g' /etc/hosts
2026-02-14T01:26:00.589 DEBUG:teuthology.orchestra.run.trial026:> sudo sed -i -e 's/trial026.front.sepia.ceph.com/trial026/g' /etc/hostname
2026-02-14T01:26:00.654 DEBUG:teuthology.orchestra.run.trial026:> sudo hostname trial026
2026-02-14T01:26:00.718 DEBUG:teuthology.orchestra.run.trial026:> cat /etc/os-release
2026-02-14T01:26:00.775 INFO:teuthology.orchestra.run.trial026.stdout:NAME="CentOS Stream"
2026-02-14T01:26:00.775 INFO:teuthology.orchestra.run.trial026.stdout:VERSION="9"
2026-02-14T01:26:00.775 INFO:teuthology.orchestra.run.trial026.stdout:ID="centos"
2026-02-14T01:26:00.775 INFO:teuthology.orchestra.run.trial026.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:26:00.775 INFO:teuthology.orchestra.run.trial026.stdout:VERSION_ID="9"
2026-02-14T01:26:00.775 INFO:teuthology.orchestra.run.trial026.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:26:00.775 INFO:teuthology.orchestra.run.trial026.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:26:00.776 INFO:teuthology.orchestra.run.trial026.stdout:ANSI_COLOR="0;31"
2026-02-14T01:26:00.776 INFO:teuthology.orchestra.run.trial026.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:26:00.776 INFO:teuthology.orchestra.run.trial026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:26:00.776 INFO:teuthology.orchestra.run.trial026.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:26:00.776 INFO:teuthology.orchestra.run.trial026.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:26:00.776 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:26:00.776 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:26:00.777 INFO:teuthology.provision.fog.trial026:Deploy complete!
2026-02-14T01:26:00.777 DEBUG:teuthology.parallel:result is None
2026-02-14T01:26:01.309 INFO:teuthology.lock.ops:Checking trial026.front.sepia.ceph.com
2026-02-14T01:26:01.309 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:26:01.416 INFO:teuthology.lock.ops:Checking trial151.front.sepia.ceph.com
2026-02-14T01:26:01.416 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:26:01.483 INFO:teuthology.lock.ops:Checking trial176.front.sepia.ceph.com
2026-02-14T01:26:01.483 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:26:01.540 INFO:teuthology.lock.ops:Updating [trial026.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:26:01.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com'
2026-02-14T01:26:01.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:01.601 DEBUG:teuthology.orchestra.run.trial026:> true
2026-02-14T01:26:01.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com'
2026-02-14T01:26:01.677 DEBUG:teuthology.orchestra.run.trial026:> uname -m
2026-02-14T01:26:01.732 INFO:teuthology.orchestra.run.trial026.stdout:x86_64
2026-02-14T01:26:01.733 DEBUG:teuthology.orchestra.run.trial026:> cat /etc/os-release
2026-02-14T01:26:01.790 INFO:teuthology.orchestra.run.trial026.stdout:NAME="CentOS Stream"
2026-02-14T01:26:01.790 INFO:teuthology.orchestra.run.trial026.stdout:VERSION="9"
2026-02-14T01:26:01.790 INFO:teuthology.orchestra.run.trial026.stdout:ID="centos"
2026-02-14T01:26:01.790 INFO:teuthology.orchestra.run.trial026.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:26:01.790 INFO:teuthology.orchestra.run.trial026.stdout:VERSION_ID="9"
2026-02-14T01:26:01.790 INFO:teuthology.orchestra.run.trial026.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:26:01.790 INFO:teuthology.orchestra.run.trial026.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:26:01.791 INFO:teuthology.orchestra.run.trial026.stdout:ANSI_COLOR="0;31"
2026-02-14T01:26:01.791 INFO:teuthology.orchestra.run.trial026.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:26:01.791 INFO:teuthology.orchestra.run.trial026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:26:01.791 INFO:teuthology.orchestra.run.trial026.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:26:01.791 INFO:teuthology.orchestra.run.trial026.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:26:01.791 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:26:01.791 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:26:01.792 INFO:teuthology.lock.ops:Updating trial026.front.sepia.ceph.com on lock server
2026-02-14T01:26:01.894 INFO:teuthology.lock.ops:Updating [trial151.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:26:01.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial151.front.sepia.ceph.com'
2026-02-14T01:26:01.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:01.963 DEBUG:teuthology.orchestra.run.trial151:> true
2026-02-14T01:26:02.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial151.front.sepia.ceph.com'
2026-02-14T01:26:02.037 DEBUG:teuthology.orchestra.run.trial151:> uname -m
2026-02-14T01:26:02.094 INFO:teuthology.orchestra.run.trial151.stdout:x86_64
2026-02-14T01:26:02.094 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release
2026-02-14T01:26:02.149 INFO:teuthology.orchestra.run.trial151.stdout:NAME="CentOS Stream"
2026-02-14T01:26:02.150 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="9"
2026-02-14T01:26:02.150 INFO:teuthology.orchestra.run.trial151.stdout:ID="centos"
2026-02-14T01:26:02.150 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:26:02.150 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="9"
2026-02-14T01:26:02.150 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:26:02.150 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:26:02.150 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;31"
2026-02-14T01:26:02.150 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:26:02.151 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:26:02.151 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:26:02.151 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:26:02.151 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:26:02.151 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:26:02.152 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server
2026-02-14T01:26:02.264 INFO:teuthology.lock.ops:Updating [trial176.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:26:02.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial176.front.sepia.ceph.com'
2026-02-14T01:26:02.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:02.325 DEBUG:teuthology.orchestra.run.trial176:> true
2026-02-14T01:26:02.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial176.front.sepia.ceph.com'
2026-02-14T01:26:02.393 DEBUG:teuthology.orchestra.run.trial176:> uname -m
2026-02-14T01:26:02.448 INFO:teuthology.orchestra.run.trial176.stdout:x86_64
2026-02-14T01:26:02.449 DEBUG:teuthology.orchestra.run.trial176:> cat /etc/os-release
2026-02-14T01:26:02.505 INFO:teuthology.orchestra.run.trial176.stdout:NAME="CentOS Stream"
2026-02-14T01:26:02.505 INFO:teuthology.orchestra.run.trial176.stdout:VERSION="9"
2026-02-14T01:26:02.505 INFO:teuthology.orchestra.run.trial176.stdout:ID="centos"
2026-02-14T01:26:02.505 INFO:teuthology.orchestra.run.trial176.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:26:02.505 INFO:teuthology.orchestra.run.trial176.stdout:VERSION_ID="9"
2026-02-14T01:26:02.505 INFO:teuthology.orchestra.run.trial176.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:26:02.505 INFO:teuthology.orchestra.run.trial176.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:26:02.505 INFO:teuthology.orchestra.run.trial176.stdout:ANSI_COLOR="0;31"
2026-02-14T01:26:02.506 INFO:teuthology.orchestra.run.trial176.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:26:02.506 INFO:teuthology.orchestra.run.trial176.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:26:02.506 INFO:teuthology.orchestra.run.trial176.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:26:02.506 INFO:teuthology.orchestra.run.trial176.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:26:02.506 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:26:02.506 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:26:02.507 INFO:teuthology.lock.ops:Updating trial176.front.sepia.ceph.com on lock server
2026-02-14T01:26:02.609 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:26:02.709 INFO:teuthology.dispatcher.supervisor:Running job 50554
2026-02-14T01:26:02.709 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50554 --name jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50554/orig.config.yaml
2026-02-14T01:26:02.710 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50554
2026-02-14T01:26:02.710 INFO:teuthology.dispatcher.supervisor:Job PID: 1544341
2026-02-14T01:26:02.710 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-14T01:28:02.710 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:30:02.830 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:32:02.952 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:34:03.077 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:36:03.200 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:38:03.325 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:40:03.407 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:42:03.532 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:42:03.656 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-14T01:42:03.837 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-14T01:42:04.585 INFO:teuthology.orchestra.console.trial026:Power off
2026-02-14T01:42:04.585 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:42:04.596 INFO:teuthology.orchestra.console.trial176:Power off
2026-02-14T01:42:04.596 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:42:04.618 INFO:teuthology.orchestra.console.trial151:Power off
2026-02-14T01:42:04.618 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:42:04.626 DEBUG:teuthology.orchestra.console.trial026:power off output: Chassis Power Control: Down/Off
2026-02-14T01:42:04.641 DEBUG:teuthology.orchestra.console.trial176:power off output: Chassis Power Control: Down/Off
2026-02-14T01:42:04.656 DEBUG:teuthology.orchestra.console.trial151:power off output: Chassis Power Control: Down/Off
2026-02-14T01:42:08.628 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:42:08.642 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:42:08.657 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:42:08.737 DEBUG:teuthology.orchestra.console.trial026:check power output: Chassis Power is on
2026-02-14T01:42:08.753 DEBUG:teuthology.orchestra.console.trial176:check power output: Chassis Power is on
2026-02-14T01:42:08.767 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is on
2026-02-14T01:42:12.738 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:42:12.754 DEBUG:teuthology.orchestra.console.trial176:pexpect command: ipmitool -H trial176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:42:12.768 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:42:12.850 DEBUG:teuthology.orchestra.console.trial026:check power output: Chassis Power is off
2026-02-14T01:42:12.850 INFO:teuthology.orchestra.console.trial026:Power off completed
2026-02-14T01:42:12.864 DEBUG:teuthology.orchestra.console.trial176:check power output: Chassis Power is off
2026-02-14T01:42:12.864 INFO:teuthology.orchestra.console.trial176:Power off completed
2026-02-14T01:42:12.877 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is off
2026-02-14T01:42:12.878 INFO:teuthology.orchestra.console.trial151:Power off completed
2026-02-14T01:42:13.148 INFO:teuthology.lock.ops:unlocked: trial026.front.sepia.ceph.com
2026-02-14T01:42:13.158 INFO:teuthology.lock.ops:unlocked: trial176.front.sepia.ceph.com
2026-02-14T01:42:13.161 INFO:teuthology.lock.ops:unlocked: trial151.front.sepia.ceph.com