2026-02-14T00:53:22.623 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-14T00:53:22.623 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T00:53:22.697 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T00:53:22.945 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x751cce5a0920>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x751ccdfa3060>, signals=[15])
2026-02-14T00:53:22.945 INFO:teuthology.lock.ops:Start node 'trial101.front.sepia.ceph.com' reimaging
2026-02-14T00:53:22.945 INFO:teuthology.lock.ops:Updating [trial101.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T00:53:22.945 INFO:teuthology.lock.ops:Updating trial101.front.sepia.ceph.com on lock server
2026-02-14T00:53:23.003 INFO:teuthology.lock.ops:Start node 'trial121.front.sepia.ceph.com' reimaging
2026-02-14T00:53:23.003 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T00:53:23.003 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-14T00:53:23.061 INFO:teuthology.lock.ops:Start node 'trial187.front.sepia.ceph.com' reimaging
2026-02-14T00:53:23.061 INFO:teuthology.lock.ops:Updating [trial187.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T00:53:23.061 INFO:teuthology.lock.ops:Updating trial187.front.sepia.ceph.com on lock server
2026-02-14T00:53:23.285 DEBUG:teuthology.provision.fog.trial101:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T00:53:23.286 DEBUG:teuthology.provision.fog.trial121:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T00:53:23.317 INFO:teuthology.provision.fog.trial121:Scheduling deploy of centos 9.stream
2026-02-14T00:53:23.338 INFO:teuthology.provision.fog.trial101:Scheduling deploy of centos 9.stream
2026-02-14T00:53:23.339 DEBUG:teuthology.provision.fog.trial187:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T00:53:23.381 INFO:teuthology.provision.fog.trial187:Scheduling deploy of centos 9.stream
2026-02-14T00:53:24.528 INFO:teuthology.orchestra.console.trial187:Power off
2026-02-14T00:53:24.529 DEBUG:teuthology.orchestra.console.trial187:pexpect command: ipmitool -H trial187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T00:53:24.540 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-14T00:53:24.540 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T00:53:24.550 INFO:teuthology.orchestra.console.trial101:Power off
2026-02-14T00:53:24.550 DEBUG:teuthology.orchestra.console.trial101:pexpect command: ipmitool -H trial101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T00:53:24.566 DEBUG:teuthology.orchestra.console.trial187:power off output: Chassis Power Control: Down/Off
2026-02-14T00:53:24.577 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-14T00:53:24.586 DEBUG:teuthology.orchestra.console.trial101:power off output: Chassis Power Control: Down/Off
2026-02-14T00:53:28.571 DEBUG:teuthology.orchestra.console.trial187:pexpect command: ipmitool -H trial187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T00:53:28.578 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T00:53:28.587 DEBUG:teuthology.orchestra.console.trial101:pexpect command: ipmitool -H trial101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T00:53:28.680 DEBUG:teuthology.orchestra.console.trial187:check power output: Chassis Power is off
2026-02-14T00:53:28.681 INFO:teuthology.orchestra.console.trial187:Power off completed
2026-02-14T00:53:28.685 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-14T00:53:28.686 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-14T00:53:28.695 DEBUG:teuthology.orchestra.console.trial101:check power output: Chassis Power is off
2026-02-14T00:53:28.695 INFO:teuthology.orchestra.console.trial101:Power off completed
2026-02-14T00:53:28.782 INFO:teuthology.orchestra.console.trial187:Power on
2026-02-14T00:53:28.782 DEBUG:teuthology.orchestra.console.trial187:pexpect command: ipmitool -H trial187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T00:53:28.792 INFO:teuthology.orchestra.console.trial121:Power on
2026-02-14T00:53:28.792 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T00:53:28.800 INFO:teuthology.orchestra.console.trial101:Power on
2026-02-14T00:53:28.800 DEBUG:teuthology.orchestra.console.trial101:pexpect command: ipmitool -H trial101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T00:53:28.823 DEBUG:teuthology.orchestra.console.trial187:power on output: Chassis Power Control: Up/On
2026-02-14T00:53:28.832 DEBUG:teuthology.orchestra.console.trial121:power on output: Chassis Power Control: Up/On
2026-02-14T00:53:28.838 DEBUG:teuthology.orchestra.console.trial101:power on output: Chassis Power Control: Up/On
2026-02-14T00:53:32.829 DEBUG:teuthology.orchestra.console.trial187:pexpect command: ipmitool -H trial187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T00:53:32.836 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T00:53:32.843 DEBUG:teuthology.orchestra.console.trial101:pexpect command: ipmitool -H trial101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T00:53:32.939 DEBUG:teuthology.orchestra.console.trial187:check power output: Chassis Power is on
2026-02-14T00:53:32.939 INFO:teuthology.orchestra.console.trial187:Power on completed
2026-02-14T00:53:32.945 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-14T00:53:32.945 INFO:teuthology.orchestra.console.trial121:Power on completed
2026-02-14T00:53:32.952 DEBUG:teuthology.orchestra.console.trial101:check power output: Chassis Power is on
2026-02-14T00:53:32.952 INFO:teuthology.orchestra.console.trial101:Power on completed
2026-02-14T00:53:33.040 INFO:teuthology.provision.fog.trial187:Waiting for deploy to finish
2026-02-14T00:53:33.046 INFO:teuthology.provision.fog.trial121:Waiting for deploy to finish
2026-02-14T00:53:33.053 INFO:teuthology.provision.fog.trial101:Waiting for deploy to finish
2026-02-14T00:55:20.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:20.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:20.684 ERROR:teuthology.orchestra.connection:Error authenticating with trial187.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-14T00:55:23.613 WARNING:teuthology.provision.fog.trial101:[Errno None] Unable to connect to port 22 on 10.20.193.101
2026-02-14T00:55:29.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:32.701 WARNING:teuthology.provision.fog.trial101:[Errno None] Unable to connect to port 22 on 10.20.193.101
2026-02-14T00:55:35.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:38.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:38.781 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-14T00:55:41.789 WARNING:teuthology.provision.fog.trial101:[Errno None] Unable to connect to port 22 on 10.20.193.101
2026-02-14T00:55:44.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:47.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:47.870 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-14T00:55:50.877 WARNING:teuthology.provision.fog.trial101:[Errno None] Unable to connect to port 22 on 10.20.193.101
2026-02-14T00:55:53.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:56.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:55:56.957 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-14T00:55:59.965 WARNING:teuthology.provision.fog.trial101:[Errno None] Unable to connect to port 22 on 10.20.193.101
2026-02-14T00:56:02.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:56:05.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:56:06.045 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-14T00:56:12.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:56:24.687 WARNING:teuthology.provision.fog.trial187:timed out
2026-02-14T00:56:30.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:56:38.259 ERROR:teuthology.orchestra.connection:Error authenticating with trial187.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T00:56:42.019 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T00:56:42.019 DEBUG:teuthology.orchestra.run.trial101:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T00:56:42.180 INFO:teuthology.provision.fog.trial101:Node is ready
2026-02-14T00:56:42.181 DEBUG:teuthology.orchestra.run.trial101:> hostname
2026-02-14T00:56:42.236 INFO:teuthology.orchestra.run.trial101.stdout:trial101.front.sepia.ceph.com
2026-02-14T00:56:42.236 DEBUG:teuthology.orchestra.run.trial101:> grep trial101.front.sepia.ceph.com /etc/hosts
2026-02-14T00:56:42.372 INFO:teuthology.orchestra.run.trial101.stdout:10.20.193.101 trial101.front.sepia.ceph.com trial101
2026-02-14T00:56:42.372 DEBUG:teuthology.orchestra.run.trial101:> sudo hostname trial101
2026-02-14T00:56:42.395 ERROR:teuthology.orchestra.connection:Error authenticating with trial187.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T00:56:42.442 DEBUG:teuthology.orchestra.run.trial101:> sudo sed -i -e 's/trial101.front.sepia.ceph.com/trial101/g' /etc/hosts
2026-02-14T00:56:42.507 DEBUG:teuthology.orchestra.run.trial101:> sudo sed -i -e 's/10.20.193.101/10.20.193.101/g' /etc/hosts
2026-02-14T00:56:42.571 DEBUG:teuthology.orchestra.run.trial101:> sudo sed -i -e 's/trial101.front.sepia.ceph.com/trial101/g' /etc/hostname
2026-02-14T00:56:42.636 DEBUG:teuthology.orchestra.run.trial101:> sudo hostname trial101
2026-02-14T00:56:42.700 DEBUG:teuthology.orchestra.run.trial101:> cat /etc/os-release
2026-02-14T00:56:42.756 INFO:teuthology.orchestra.run.trial101.stdout:NAME="CentOS Stream"
2026-02-14T00:56:42.756 INFO:teuthology.orchestra.run.trial101.stdout:VERSION="9"
2026-02-14T00:56:42.756 INFO:teuthology.orchestra.run.trial101.stdout:ID="centos"
2026-02-14T00:56:42.756 INFO:teuthology.orchestra.run.trial101.stdout:ID_LIKE="rhel fedora"
2026-02-14T00:56:42.756 INFO:teuthology.orchestra.run.trial101.stdout:VERSION_ID="9"
2026-02-14T00:56:42.756 INFO:teuthology.orchestra.run.trial101.stdout:PLATFORM_ID="platform:el9"
2026-02-14T00:56:42.757 INFO:teuthology.orchestra.run.trial101.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T00:56:42.757 INFO:teuthology.orchestra.run.trial101.stdout:ANSI_COLOR="0;31"
2026-02-14T00:56:42.757 INFO:teuthology.orchestra.run.trial101.stdout:LOGO="fedora-logo-icon"
2026-02-14T00:56:42.757 INFO:teuthology.orchestra.run.trial101.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T00:56:42.757 INFO:teuthology.orchestra.run.trial101.stdout:HOME_URL="https://centos.org/"
2026-02-14T00:56:42.757 INFO:teuthology.orchestra.run.trial101.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T00:56:42.757 INFO:teuthology.orchestra.run.trial101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T00:56:42.757 INFO:teuthology.orchestra.run.trial101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T00:56:42.758 INFO:teuthology.provision.fog.trial101:Deploy complete!
2026-02-14T00:56:42.760 DEBUG:teuthology.parallel:result is None
2026-02-14T00:56:48.157 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T00:56:48.157 DEBUG:teuthology.orchestra.run.trial121:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T00:56:48.366 INFO:teuthology.provision.fog.trial121:Node is ready
2026-02-14T00:56:48.366 DEBUG:teuthology.orchestra.run.trial121:> hostname
2026-02-14T00:56:48.424 INFO:teuthology.orchestra.run.trial121.stdout:trial121.front.sepia.ceph.com
2026-02-14T00:56:48.425 DEBUG:teuthology.orchestra.run.trial121:> grep trial121.front.sepia.ceph.com /etc/hosts
2026-02-14T00:56:48.479 INFO:teuthology.orchestra.run.trial121.stdout:10.20.193.121 trial121.front.sepia.ceph.com trial121
2026-02-14T00:56:48.479 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-14T00:56:48.545 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hosts
2026-02-14T00:56:48.609 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/10.20.193.121/10.20.193.121/g' /etc/hosts
2026-02-14T00:56:48.671 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hostname
2026-02-14T00:56:48.734 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-14T00:56:48.796 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-14T00:56:48.850 INFO:teuthology.orchestra.run.trial121.stdout:NAME="CentOS Stream"
2026-02-14T00:56:48.850 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="9"
2026-02-14T00:56:48.850 INFO:teuthology.orchestra.run.trial121.stdout:ID="centos"
2026-02-14T00:56:48.850 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE="rhel fedora"
2026-02-14T00:56:48.850 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="9"
2026-02-14T00:56:48.850 INFO:teuthology.orchestra.run.trial121.stdout:PLATFORM_ID="platform:el9"
2026-02-14T00:56:48.851 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T00:56:48.851 INFO:teuthology.orchestra.run.trial121.stdout:ANSI_COLOR="0;31"
2026-02-14T00:56:48.851 INFO:teuthology.orchestra.run.trial121.stdout:LOGO="fedora-logo-icon"
2026-02-14T00:56:48.851 INFO:teuthology.orchestra.run.trial121.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T00:56:48.851 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://centos.org/"
2026-02-14T00:56:48.851 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T00:56:48.851 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T00:56:48.851 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T00:56:48.852 INFO:teuthology.provision.fog.trial121:Deploy complete!
2026-02-14T00:56:48.852 DEBUG:teuthology.parallel:result is None
2026-02-14T00:56:49.509 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T00:56:49.509 DEBUG:teuthology.orchestra.run.trial187:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T00:56:49.669 INFO:teuthology.provision.fog.trial187:Node is ready
2026-02-14T00:56:49.669 DEBUG:teuthology.orchestra.run.trial187:> hostname
2026-02-14T00:56:49.725 INFO:teuthology.orchestra.run.trial187.stdout:trial187.front.sepia.ceph.com
2026-02-14T00:56:49.726 DEBUG:teuthology.orchestra.run.trial187:> grep trial187.front.sepia.ceph.com /etc/hosts
2026-02-14T00:56:49.782 INFO:teuthology.orchestra.run.trial187.stdout:10.20.193.187 trial187.front.sepia.ceph.com trial187
2026-02-14T00:56:49.782 DEBUG:teuthology.orchestra.run.trial187:> sudo hostname trial187
2026-02-14T00:56:49.851 DEBUG:teuthology.orchestra.run.trial187:> sudo sed -i -e 's/trial187.front.sepia.ceph.com/trial187/g' /etc/hosts
2026-02-14T00:56:49.917 DEBUG:teuthology.orchestra.run.trial187:> sudo sed -i -e 's/10.20.193.187/10.20.193.187/g' /etc/hosts
2026-02-14T00:56:49.981 DEBUG:teuthology.orchestra.run.trial187:> sudo sed -i -e 's/trial187.front.sepia.ceph.com/trial187/g' /etc/hostname
2026-02-14T00:56:50.047 DEBUG:teuthology.orchestra.run.trial187:> sudo hostname trial187
2026-02-14T00:56:50.111 DEBUG:teuthology.orchestra.run.trial187:> cat /etc/os-release
2026-02-14T00:56:50.167 INFO:teuthology.orchestra.run.trial187.stdout:NAME="CentOS Stream"
2026-02-14T00:56:50.167 INFO:teuthology.orchestra.run.trial187.stdout:VERSION="9"
2026-02-14T00:56:50.167 INFO:teuthology.orchestra.run.trial187.stdout:ID="centos"
2026-02-14T00:56:50.167 INFO:teuthology.orchestra.run.trial187.stdout:ID_LIKE="rhel fedora"
2026-02-14T00:56:50.167 INFO:teuthology.orchestra.run.trial187.stdout:VERSION_ID="9"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:PLATFORM_ID="platform:el9"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:ANSI_COLOR="0;31"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:LOGO="fedora-logo-icon"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:HOME_URL="https://centos.org/"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T00:56:50.168 INFO:teuthology.orchestra.run.trial187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T00:56:50.169 INFO:teuthology.provision.fog.trial187:Deploy complete!
2026-02-14T00:56:50.170 DEBUG:teuthology.parallel:result is None
2026-02-14T00:56:50.711 INFO:teuthology.lock.ops:Checking trial101.front.sepia.ceph.com
2026-02-14T00:56:50.711 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T00:56:50.817 INFO:teuthology.lock.ops:Checking trial121.front.sepia.ceph.com
2026-02-14T00:56:50.818 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T00:56:50.881 INFO:teuthology.lock.ops:Checking trial187.front.sepia.ceph.com
2026-02-14T00:56:50.881 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T00:56:50.941 INFO:teuthology.lock.ops:Updating [trial101.front.sepia.ceph.com]: set os type and version on server
2026-02-14T00:56:50.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial101.front.sepia.ceph.com'
2026-02-14T00:56:50.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:56:51.004 DEBUG:teuthology.orchestra.run.trial101:> true
2026-02-14T00:56:51.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial101.front.sepia.ceph.com'
2026-02-14T00:56:51.082 DEBUG:teuthology.orchestra.run.trial101:> uname -m
2026-02-14T00:56:51.137 INFO:teuthology.orchestra.run.trial101.stdout:x86_64
2026-02-14T00:56:51.138 DEBUG:teuthology.orchestra.run.trial101:> cat /etc/os-release
2026-02-14T00:56:51.193 INFO:teuthology.orchestra.run.trial101.stdout:NAME="CentOS Stream"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:VERSION="9"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:ID="centos"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:ID_LIKE="rhel fedora"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:VERSION_ID="9"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:PLATFORM_ID="platform:el9"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:ANSI_COLOR="0;31"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:LOGO="fedora-logo-icon"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:HOME_URL="https://centos.org/"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T00:56:51.194 INFO:teuthology.orchestra.run.trial101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T00:56:51.195 INFO:teuthology.orchestra.run.trial101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T00:56:51.195 INFO:teuthology.lock.ops:Updating trial101.front.sepia.ceph.com on lock server
2026-02-14T00:56:51.298 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: set os type and version on server
2026-02-14T00:56:51.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial121.front.sepia.ceph.com'
2026-02-14T00:56:51.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:56:51.367 DEBUG:teuthology.orchestra.run.trial121:> true
2026-02-14T00:56:51.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial121.front.sepia.ceph.com'
2026-02-14T00:56:51.444 DEBUG:teuthology.orchestra.run.trial121:> uname -m
2026-02-14T00:56:51.500 INFO:teuthology.orchestra.run.trial121.stdout:x86_64
2026-02-14T00:56:51.501 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-14T00:56:51.557 INFO:teuthology.orchestra.run.trial121.stdout:NAME="CentOS Stream"
2026-02-14T00:56:51.557 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="9"
2026-02-14T00:56:51.557 INFO:teuthology.orchestra.run.trial121.stdout:ID="centos"
2026-02-14T00:56:51.557 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE="rhel fedora"
2026-02-14T00:56:51.557 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="9"
2026-02-14T00:56:51.557 INFO:teuthology.orchestra.run.trial121.stdout:PLATFORM_ID="platform:el9"
2026-02-14T00:56:51.557 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T00:56:51.558 INFO:teuthology.orchestra.run.trial121.stdout:ANSI_COLOR="0;31"
2026-02-14T00:56:51.558 INFO:teuthology.orchestra.run.trial121.stdout:LOGO="fedora-logo-icon"
2026-02-14T00:56:51.558 INFO:teuthology.orchestra.run.trial121.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T00:56:51.558 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://centos.org/"
2026-02-14T00:56:51.558 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T00:56:51.558 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T00:56:51.558 INFO:teuthology.orchestra.run.trial121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T00:56:51.559 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-14T00:56:51.665 INFO:teuthology.lock.ops:Updating [trial187.front.sepia.ceph.com]: set os type and version on server
2026-02-14T00:56:51.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial187.front.sepia.ceph.com'
2026-02-14T00:56:51.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T00:56:51.737 DEBUG:teuthology.orchestra.run.trial187:> true
2026-02-14T00:56:51.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial187.front.sepia.ceph.com'
2026-02-14T00:56:51.808 DEBUG:teuthology.orchestra.run.trial187:> uname -m
2026-02-14T00:56:51.865 INFO:teuthology.orchestra.run.trial187.stdout:x86_64
2026-02-14T00:56:51.866 DEBUG:teuthology.orchestra.run.trial187:> cat /etc/os-release
2026-02-14T00:56:51.922 INFO:teuthology.orchestra.run.trial187.stdout:NAME="CentOS Stream"
2026-02-14T00:56:51.923 INFO:teuthology.orchestra.run.trial187.stdout:VERSION="9"
2026-02-14T00:56:51.923 INFO:teuthology.orchestra.run.trial187.stdout:ID="centos"
2026-02-14T00:56:51.923 INFO:teuthology.orchestra.run.trial187.stdout:ID_LIKE="rhel fedora"
2026-02-14T00:56:51.923 INFO:teuthology.orchestra.run.trial187.stdout:VERSION_ID="9"
2026-02-14T00:56:51.923 INFO:teuthology.orchestra.run.trial187.stdout:PLATFORM_ID="platform:el9"
2026-02-14T00:56:51.923 INFO:teuthology.orchestra.run.trial187.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T00:56:51.923 INFO:teuthology.orchestra.run.trial187.stdout:ANSI_COLOR="0;31"
2026-02-14T00:56:51.924 INFO:teuthology.orchestra.run.trial187.stdout:LOGO="fedora-logo-icon"
2026-02-14T00:56:51.924 INFO:teuthology.orchestra.run.trial187.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T00:56:51.924 INFO:teuthology.orchestra.run.trial187.stdout:HOME_URL="https://centos.org/"
2026-02-14T00:56:51.924 INFO:teuthology.orchestra.run.trial187.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T00:56:51.924 INFO:teuthology.orchestra.run.trial187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T00:56:51.924 INFO:teuthology.orchestra.run.trial187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T00:56:51.925 INFO:teuthology.lock.ops:Updating trial187.front.sepia.ceph.com on lock server
2026-02-14T00:56:52.029 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T00:56:52.127 INFO:teuthology.dispatcher.supervisor:Running job 50499
2026-02-14T00:56:52.127 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50499 --name jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50499/orig.config.yaml
2026-02-14T00:56:52.128 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50499
2026-02-14T00:56:52.128 INFO:teuthology.dispatcher.supervisor:Job PID: 1364401
2026-02-14T00:56:52.128 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-14T00:58:52.129 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:00:52.238 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:02:52.365 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:04:52.483 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:06:52.588 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:08:52.710 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:10:52.796 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:12:52.917 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:14:53.045 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:16:53.127 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:16:53.248 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-14T01:16:53.430 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-14T01:16:54.204 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-14T01:16:54.204 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:16:54.217 INFO:teuthology.orchestra.console.trial187:Power off
2026-02-14T01:16:54.217 DEBUG:teuthology.orchestra.console.trial187:pexpect command: ipmitool -H trial187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:16:54.229 INFO:teuthology.orchestra.console.trial101:Power off
2026-02-14T01:16:54.229 DEBUG:teuthology.orchestra.console.trial101:pexpect command: ipmitool -H trial101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:16:54.246 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-14T01:16:54.260 DEBUG:teuthology.orchestra.console.trial187:power off output: Chassis Power Control: Down/Off
2026-02-14T01:16:54.267 DEBUG:teuthology.orchestra.console.trial101:power off output: Chassis Power Control: Down/Off
2026-02-14T01:16:58.247 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:16:58.261 DEBUG:teuthology.orchestra.console.trial187:pexpect command: ipmitool -H trial187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:16:58.269 DEBUG:teuthology.orchestra.console.trial101:pexpect command: ipmitool -H trial101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:16:58.358 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-14T01:16:58.370 DEBUG:teuthology.orchestra.console.trial187:check power output: Chassis Power is on
2026-02-14T01:16:58.381 DEBUG:teuthology.orchestra.console.trial101:check power output: Chassis Power is on
2026-02-14T01:17:02.358 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:17:02.371 DEBUG:teuthology.orchestra.console.trial187:pexpect command: ipmitool -H trial187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:17:02.382 DEBUG:teuthology.orchestra.console.trial101:pexpect command: ipmitool -H trial101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:17:02.467 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-14T01:17:02.467 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-14T01:17:02.479 DEBUG:teuthology.orchestra.console.trial187:check power output: Chassis Power is off
2026-02-14T01:17:02.480 INFO:teuthology.orchestra.console.trial187:Power off completed
2026-02-14T01:17:02.489 DEBUG:teuthology.orchestra.console.trial101:check power output: Chassis Power is off
2026-02-14T01:17:02.489 INFO:teuthology.orchestra.console.trial101:Power off completed
2026-02-14T01:17:02.719 INFO:teuthology.lock.ops:unlocked: trial121.front.sepia.ceph.com
2026-02-14T01:17:02.728 INFO:teuthology.lock.ops:unlocked: trial187.front.sepia.ceph.com
2026-02-14T01:17:02.732 INFO:teuthology.lock.ops:unlocked: trial101.front.sepia.ceph.com