2026-02-14T01:55:29.882 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-14T01:55:29.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:55:29.955 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:55:30.210 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x77a74ae0d1c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x77a74a64b6a0>, signals=[15])
2026-02-14T01:55:30.210 INFO:teuthology.lock.ops:Start node 'trial017.front.sepia.ceph.com' reimaging
2026-02-14T01:55:30.210 INFO:teuthology.lock.ops:Updating [trial017.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:55:30.210 INFO:teuthology.lock.ops:Updating trial017.front.sepia.ceph.com on lock server
2026-02-14T01:55:30.268 INFO:teuthology.lock.ops:Start node 'trial067.front.sepia.ceph.com' reimaging
2026-02-14T01:55:30.268 INFO:teuthology.lock.ops:Updating [trial067.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:55:30.268 INFO:teuthology.lock.ops:Updating trial067.front.sepia.ceph.com on lock server
2026-02-14T01:55:30.327 INFO:teuthology.lock.ops:Start node 'trial070.front.sepia.ceph.com' reimaging
2026-02-14T01:55:30.327 INFO:teuthology.lock.ops:Updating [trial070.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:55:30.327 INFO:teuthology.lock.ops:Updating trial070.front.sepia.ceph.com on lock server
2026-02-14T01:55:30.559 DEBUG:teuthology.provision.fog.trial017:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:55:30.560 DEBUG:teuthology.provision.fog.trial067:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:55:30.617 INFO:teuthology.provision.fog.trial067:Scheduling deploy of centos 9.stream
2026-02-14T01:55:30.619 DEBUG:teuthology.provision.fog.trial070:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:55:30.620 INFO:teuthology.provision.fog.trial017:Scheduling deploy of centos 9.stream
2026-02-14T01:55:30.672 INFO:teuthology.provision.fog.trial070:Scheduling deploy of centos 9.stream
2026-02-14T01:55:31.849 INFO:teuthology.orchestra.console.trial017:Power off
2026-02-14T01:55:31.849 DEBUG:teuthology.orchestra.console.trial017:pexpect command: ipmitool -H trial017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:55:31.863 INFO:teuthology.orchestra.console.trial067:Power off
2026-02-14T01:55:31.863 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:55:31.870 INFO:teuthology.orchestra.console.trial070:Power off
2026-02-14T01:55:31.870 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:55:31.888 DEBUG:teuthology.orchestra.console.trial017:power off output: Chassis Power Control: Down/Off
2026-02-14T01:55:31.900 DEBUG:teuthology.orchestra.console.trial067:power off output: Chassis Power Control: Down/Off
2026-02-14T01:55:31.906 DEBUG:teuthology.orchestra.console.trial070:power off output: Chassis Power Control: Down/Off
2026-02-14T01:55:35.893 DEBUG:teuthology.orchestra.console.trial017:pexpect command: ipmitool -H trial017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:55:35.900 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:55:35.908 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:55:36.002 DEBUG:teuthology.orchestra.console.trial017:check power output: Chassis Power is off
2026-02-14T01:55:36.002 INFO:teuthology.orchestra.console.trial017:Power off completed
2026-02-14T01:55:36.009 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is off
2026-02-14T01:55:36.009 INFO:teuthology.orchestra.console.trial067:Power off completed
2026-02-14T01:55:36.016 DEBUG:teuthology.orchestra.console.trial070:check power output: Chassis Power is off
2026-02-14T01:55:36.016 INFO:teuthology.orchestra.console.trial070:Power off completed
2026-02-14T01:55:36.103 INFO:teuthology.orchestra.console.trial017:Power on
2026-02-14T01:55:36.104 DEBUG:teuthology.orchestra.console.trial017:pexpect command: ipmitool -H trial017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:55:36.113 INFO:teuthology.orchestra.console.trial067:Power on
2026-02-14T01:55:36.113 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:55:36.122 INFO:teuthology.orchestra.console.trial070:Power on
2026-02-14T01:55:36.122 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:55:36.146 DEBUG:teuthology.orchestra.console.trial017:power on output: Chassis Power Control: Up/On
2026-02-14T01:55:36.154 DEBUG:teuthology.orchestra.console.trial067:power on output: Chassis Power Control: Up/On
2026-02-14T01:55:36.161 DEBUG:teuthology.orchestra.console.trial070:power on output: Chassis Power Control: Up/On
2026-02-14T01:55:40.151 DEBUG:teuthology.orchestra.console.trial017:pexpect command: ipmitool -H trial017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:55:40.159 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:55:40.167 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:55:40.261 DEBUG:teuthology.orchestra.console.trial017:check power output: Chassis Power is on
2026-02-14T01:55:40.262 INFO:teuthology.orchestra.console.trial017:Power on completed
2026-02-14T01:55:40.269 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is on
2026-02-14T01:55:40.269 INFO:teuthology.orchestra.console.trial067:Power on completed
2026-02-14T01:55:40.277 DEBUG:teuthology.orchestra.console.trial070:check power output: Chassis Power is on
2026-02-14T01:55:40.277 INFO:teuthology.orchestra.console.trial070:Power on completed
2026-02-14T01:55:40.363 INFO:teuthology.provision.fog.trial017:Waiting for deploy to finish
2026-02-14T01:55:40.370 INFO:teuthology.provision.fog.trial067:Waiting for deploy to finish
2026-02-14T01:55:40.377 INFO:teuthology.provision.fog.trial070:Waiting for deploy to finish
2026-02-14T01:57:27.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:57:27.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:57:28.026 ERROR:teuthology.orchestra.connection:Error authenticating with trial017.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-14T01:57:30.909 WARNING:teuthology.provision.fog.trial070:[Errno None] Unable to connect to port 22 on 10.20.193.70
2026-02-14T01:57:36.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:57:39.997 WARNING:teuthology.provision.fog.trial070:[Errno None] Unable to connect to port 22 on 10.20.193.70
2026-02-14T01:57:43.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:57:45.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:57:46.205 WARNING:teuthology.provision.fog.trial067:[Errno None] Unable to connect to port 22 on 10.20.193.67
2026-02-14T01:57:49.085 WARNING:teuthology.provision.fog.trial070:[Errno None] Unable to connect to port 22 on 10.20.193.70
2026-02-14T01:57:52.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:57:55.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:57:55.293 WARNING:teuthology.provision.fog.trial067:[Errno None] Unable to connect to port 22 on 10.20.193.67
2026-02-14T01:57:58.174 WARNING:teuthology.provision.fog.trial070:[Errno None] Unable to connect to port 22 on 10.20.193.70
2026-02-14T01:58:01.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:04.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:04.382 WARNING:teuthology.provision.fog.trial067:[Errno None] Unable to connect to port 22 on 10.20.193.67
2026-02-14T01:58:07.261 WARNING:teuthology.provision.fog.trial070:[Errno None] Unable to connect to port 22 on 10.20.193.70
2026-02-14T01:58:10.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:13.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:13.469 WARNING:teuthology.provision.fog.trial067:[Errno None] Unable to connect to port 22 on 10.20.193.67
2026-02-14T01:58:19.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:32.029 WARNING:teuthology.provision.fog.trial017:timed out
2026-02-14T01:58:38.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:43.401 ERROR:teuthology.orchestra.connection:Error authenticating with trial017.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T01:58:47.550 ERROR:teuthology.orchestra.connection:Error authenticating with trial017.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T01:58:49.376 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:58:49.377 DEBUG:teuthology.orchestra.run.trial070:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:58:49.539 INFO:teuthology.provision.fog.trial070:Node is ready
2026-02-14T01:58:49.539 DEBUG:teuthology.orchestra.run.trial070:> hostname
2026-02-14T01:58:49.595 INFO:teuthology.orchestra.run.trial070.stdout:trial070.front.sepia.ceph.com
2026-02-14T01:58:49.596 DEBUG:teuthology.orchestra.run.trial070:> grep trial070.front.sepia.ceph.com /etc/hosts
2026-02-14T01:58:49.653 INFO:teuthology.orchestra.run.trial070.stdout:10.20.193.70 trial070.front.sepia.ceph.com trial070
2026-02-14T01:58:49.654 DEBUG:teuthology.orchestra.run.trial070:> sudo hostname trial070
2026-02-14T01:58:49.722 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i -e 's/trial070.front.sepia.ceph.com/trial070/g' /etc/hosts
2026-02-14T01:58:49.787 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i -e 's/10.20.193.70/10.20.193.70/g' /etc/hosts
2026-02-14T01:58:49.851 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i -e 's/trial070.front.sepia.ceph.com/trial070/g' /etc/hostname
2026-02-14T01:58:49.915 DEBUG:teuthology.orchestra.run.trial070:> sudo hostname trial070
2026-02-14T01:58:49.979 DEBUG:teuthology.orchestra.run.trial070:> cat /etc/os-release
2026-02-14T01:58:50.035 INFO:teuthology.orchestra.run.trial070.stdout:NAME="CentOS Stream"
2026-02-14T01:58:50.035 INFO:teuthology.orchestra.run.trial070.stdout:VERSION="9"
2026-02-14T01:58:50.035 INFO:teuthology.orchestra.run.trial070.stdout:ID="centos"
2026-02-14T01:58:50.035 INFO:teuthology.orchestra.run.trial070.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:58:50.035 INFO:teuthology.orchestra.run.trial070.stdout:VERSION_ID="9"
2026-02-14T01:58:50.035 INFO:teuthology.orchestra.run.trial070.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:58:50.035 INFO:teuthology.orchestra.run.trial070.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:58:50.036 INFO:teuthology.orchestra.run.trial070.stdout:ANSI_COLOR="0;31"
2026-02-14T01:58:50.036 INFO:teuthology.orchestra.run.trial070.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:58:50.036 INFO:teuthology.orchestra.run.trial070.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:58:50.036 INFO:teuthology.orchestra.run.trial070.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:58:50.036 INFO:teuthology.orchestra.run.trial070.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:58:50.036 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:58:50.036 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:58:50.037 INFO:teuthology.provision.fog.trial070:Deploy complete!
2026-02-14T01:58:50.038 DEBUG:teuthology.parallel:result is None
2026-02-14T01:58:54.660 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:58:54.660 DEBUG:teuthology.orchestra.run.trial017:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:58:54.824 INFO:teuthology.provision.fog.trial017:Node is ready
2026-02-14T01:58:54.824 DEBUG:teuthology.orchestra.run.trial017:> hostname
2026-02-14T01:58:54.880 INFO:teuthology.orchestra.run.trial017.stdout:trial017.front.sepia.ceph.com
2026-02-14T01:58:54.881 DEBUG:teuthology.orchestra.run.trial017:> grep trial017.front.sepia.ceph.com /etc/hosts
2026-02-14T01:58:54.936 INFO:teuthology.orchestra.run.trial017.stdout:10.20.193.17 trial017.front.sepia.ceph.com trial017
2026-02-14T01:58:54.936 DEBUG:teuthology.orchestra.run.trial017:> sudo hostname trial017
2026-02-14T01:58:55.004 DEBUG:teuthology.orchestra.run.trial017:> sudo sed -i -e 's/trial017.front.sepia.ceph.com/trial017/g' /etc/hosts
2026-02-14T01:58:55.067 DEBUG:teuthology.orchestra.run.trial017:> sudo sed -i -e 's/10.20.193.17/10.20.193.17/g' /etc/hosts
2026-02-14T01:58:55.131 DEBUG:teuthology.orchestra.run.trial017:> sudo sed -i -e 's/trial017.front.sepia.ceph.com/trial017/g' /etc/hostname
2026-02-14T01:58:55.196 DEBUG:teuthology.orchestra.run.trial017:> sudo hostname trial017
2026-02-14T01:58:55.259 DEBUG:teuthology.orchestra.run.trial017:> cat /etc/os-release
2026-02-14T01:58:55.316 INFO:teuthology.orchestra.run.trial017.stdout:NAME="CentOS Stream"
2026-02-14T01:58:55.316 INFO:teuthology.orchestra.run.trial017.stdout:VERSION="9"
2026-02-14T01:58:55.316 INFO:teuthology.orchestra.run.trial017.stdout:ID="centos"
2026-02-14T01:58:55.316 INFO:teuthology.orchestra.run.trial017.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:58:55.316 INFO:teuthology.orchestra.run.trial017.stdout:VERSION_ID="9"
2026-02-14T01:58:55.316 INFO:teuthology.orchestra.run.trial017.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:58:55.316 INFO:teuthology.orchestra.run.trial017.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:58:55.317 INFO:teuthology.orchestra.run.trial017.stdout:ANSI_COLOR="0;31"
2026-02-14T01:58:55.317 INFO:teuthology.orchestra.run.trial017.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:58:55.317 INFO:teuthology.orchestra.run.trial017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:58:55.317 INFO:teuthology.orchestra.run.trial017.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:58:55.317 INFO:teuthology.orchestra.run.trial017.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:58:55.317 INFO:teuthology.orchestra.run.trial017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:58:55.317 INFO:teuthology.orchestra.run.trial017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:58:55.318 INFO:teuthology.provision.fog.trial017:Deploy complete!
2026-02-14T01:58:55.319 DEBUG:teuthology.parallel:result is None
2026-02-14T01:58:55.518 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:58:55.519 DEBUG:teuthology.orchestra.run.trial067:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:58:55.682 INFO:teuthology.provision.fog.trial067:Node is ready
2026-02-14T01:58:55.683 DEBUG:teuthology.orchestra.run.trial067:> hostname
2026-02-14T01:58:55.736 INFO:teuthology.orchestra.run.trial067.stdout:trial067.front.sepia.ceph.com
2026-02-14T01:58:55.736 DEBUG:teuthology.orchestra.run.trial067:> grep trial067.front.sepia.ceph.com /etc/hosts
2026-02-14T01:58:55.792 INFO:teuthology.orchestra.run.trial067.stdout:10.20.193.67 trial067.front.sepia.ceph.com trial067
2026-02-14T01:58:55.793 DEBUG:teuthology.orchestra.run.trial067:> sudo hostname trial067
2026-02-14T01:58:55.865 DEBUG:teuthology.orchestra.run.trial067:> sudo sed -i -e 's/trial067.front.sepia.ceph.com/trial067/g' /etc/hosts
2026-02-14T01:58:55.931 DEBUG:teuthology.orchestra.run.trial067:> sudo sed -i -e 's/10.20.193.67/10.20.193.67/g' /etc/hosts
2026-02-14T01:58:55.996 DEBUG:teuthology.orchestra.run.trial067:> sudo sed -i -e 's/trial067.front.sepia.ceph.com/trial067/g' /etc/hostname
2026-02-14T01:58:56.061 DEBUG:teuthology.orchestra.run.trial067:> sudo hostname trial067
2026-02-14T01:58:56.124 DEBUG:teuthology.orchestra.run.trial067:> cat /etc/os-release
2026-02-14T01:58:56.179 INFO:teuthology.orchestra.run.trial067.stdout:NAME="CentOS Stream"
2026-02-14T01:58:56.180 INFO:teuthology.orchestra.run.trial067.stdout:VERSION="9"
2026-02-14T01:58:56.180 INFO:teuthology.orchestra.run.trial067.stdout:ID="centos"
2026-02-14T01:58:56.180 INFO:teuthology.orchestra.run.trial067.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:58:56.180 INFO:teuthology.orchestra.run.trial067.stdout:VERSION_ID="9"
2026-02-14T01:58:56.180 INFO:teuthology.orchestra.run.trial067.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:58:56.180 INFO:teuthology.orchestra.run.trial067.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:58:56.180 INFO:teuthology.orchestra.run.trial067.stdout:ANSI_COLOR="0;31"
2026-02-14T01:58:56.180 INFO:teuthology.orchestra.run.trial067.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:58:56.181 INFO:teuthology.orchestra.run.trial067.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:58:56.181 INFO:teuthology.orchestra.run.trial067.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:58:56.181 INFO:teuthology.orchestra.run.trial067.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:58:56.181 INFO:teuthology.orchestra.run.trial067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:58:56.181 INFO:teuthology.orchestra.run.trial067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:58:56.181 INFO:teuthology.provision.fog.trial067:Deploy complete!
2026-02-14T01:58:56.182 DEBUG:teuthology.parallel:result is None
2026-02-14T01:58:56.712 INFO:teuthology.lock.ops:Checking trial017.front.sepia.ceph.com
2026-02-14T01:58:56.712 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:58:56.813 INFO:teuthology.lock.ops:Checking trial067.front.sepia.ceph.com
2026-02-14T01:58:56.813 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:58:56.876 INFO:teuthology.lock.ops:Checking trial070.front.sepia.ceph.com
2026-02-14T01:58:56.876 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:58:56.934 INFO:teuthology.lock.ops:Updating [trial017.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:58:56.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial017.front.sepia.ceph.com'
2026-02-14T01:58:56.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:56.997 DEBUG:teuthology.orchestra.run.trial017:> true
2026-02-14T01:58:57.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial017.front.sepia.ceph.com'
2026-02-14T01:58:57.073 DEBUG:teuthology.orchestra.run.trial017:> uname -m
2026-02-14T01:58:57.129 INFO:teuthology.orchestra.run.trial017.stdout:x86_64
2026-02-14T01:58:57.129 DEBUG:teuthology.orchestra.run.trial017:> cat /etc/os-release
2026-02-14T01:58:57.185 INFO:teuthology.orchestra.run.trial017.stdout:NAME="CentOS Stream"
2026-02-14T01:58:57.186 INFO:teuthology.orchestra.run.trial017.stdout:VERSION="9"
2026-02-14T01:58:57.186 INFO:teuthology.orchestra.run.trial017.stdout:ID="centos"
2026-02-14T01:58:57.186 INFO:teuthology.orchestra.run.trial017.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:58:57.186 INFO:teuthology.orchestra.run.trial017.stdout:VERSION_ID="9"
2026-02-14T01:58:57.186 INFO:teuthology.orchestra.run.trial017.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:58:57.186 INFO:teuthology.orchestra.run.trial017.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:58:57.186 INFO:teuthology.orchestra.run.trial017.stdout:ANSI_COLOR="0;31"
2026-02-14T01:58:57.186 INFO:teuthology.orchestra.run.trial017.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:58:57.187 INFO:teuthology.orchestra.run.trial017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:58:57.187 INFO:teuthology.orchestra.run.trial017.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:58:57.187 INFO:teuthology.orchestra.run.trial017.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:58:57.187 INFO:teuthology.orchestra.run.trial017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:58:57.187 INFO:teuthology.orchestra.run.trial017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:58:57.188 INFO:teuthology.lock.ops:Updating trial017.front.sepia.ceph.com on lock server
2026-02-14T01:58:57.290 INFO:teuthology.lock.ops:Updating [trial067.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:58:57.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial067.front.sepia.ceph.com'
2026-02-14T01:58:57.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:57.359 DEBUG:teuthology.orchestra.run.trial067:> true
2026-02-14T01:58:57.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial067.front.sepia.ceph.com'
2026-02-14T01:58:57.433 DEBUG:teuthology.orchestra.run.trial067:> uname -m
2026-02-14T01:58:57.489 INFO:teuthology.orchestra.run.trial067.stdout:x86_64
2026-02-14T01:58:57.490 DEBUG:teuthology.orchestra.run.trial067:> cat /etc/os-release
2026-02-14T01:58:57.546 INFO:teuthology.orchestra.run.trial067.stdout:NAME="CentOS Stream"
2026-02-14T01:58:57.547 INFO:teuthology.orchestra.run.trial067.stdout:VERSION="9"
2026-02-14T01:58:57.547 INFO:teuthology.orchestra.run.trial067.stdout:ID="centos"
2026-02-14T01:58:57.547 INFO:teuthology.orchestra.run.trial067.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:58:57.547 INFO:teuthology.orchestra.run.trial067.stdout:VERSION_ID="9"
2026-02-14T01:58:57.547 INFO:teuthology.orchestra.run.trial067.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:58:57.547 INFO:teuthology.orchestra.run.trial067.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:58:57.547 INFO:teuthology.orchestra.run.trial067.stdout:ANSI_COLOR="0;31"
2026-02-14T01:58:57.548 INFO:teuthology.orchestra.run.trial067.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:58:57.548 INFO:teuthology.orchestra.run.trial067.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:58:57.548 INFO:teuthology.orchestra.run.trial067.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:58:57.548 INFO:teuthology.orchestra.run.trial067.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:58:57.548 INFO:teuthology.orchestra.run.trial067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:58:57.548 INFO:teuthology.orchestra.run.trial067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:58:57.549 INFO:teuthology.lock.ops:Updating trial067.front.sepia.ceph.com on lock server
2026-02-14T01:58:57.654 INFO:teuthology.lock.ops:Updating [trial070.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:58:57.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com'
2026-02-14T01:58:57.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:58:57.715 DEBUG:teuthology.orchestra.run.trial070:> true
2026-02-14T01:58:57.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com'
2026-02-14T01:58:57.785 DEBUG:teuthology.orchestra.run.trial070:> uname -m
2026-02-14T01:58:57.841 INFO:teuthology.orchestra.run.trial070.stdout:x86_64
2026-02-14T01:58:57.841 DEBUG:teuthology.orchestra.run.trial070:> cat /etc/os-release
2026-02-14T01:58:57.897 INFO:teuthology.orchestra.run.trial070.stdout:NAME="CentOS Stream"
2026-02-14T01:58:57.897 INFO:teuthology.orchestra.run.trial070.stdout:VERSION="9"
2026-02-14T01:58:57.897 INFO:teuthology.orchestra.run.trial070.stdout:ID="centos"
2026-02-14T01:58:57.897 INFO:teuthology.orchestra.run.trial070.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:VERSION_ID="9"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:ANSI_COLOR="0;31"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:58:57.898 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:58:57.899 INFO:teuthology.lock.ops:Updating trial070.front.sepia.ceph.com on lock server
2026-02-14T01:58:57.999 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:58:58.098 INFO:teuthology.dispatcher.supervisor:Running job 50608
2026-02-14T01:58:58.098 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50608 --name jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50608/orig.config.yaml
2026-02-14T01:58:58.099 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50608
2026-02-14T01:58:58.099 INFO:teuthology.dispatcher.supervisor:Job PID: 1713364
2026-02-14T01:58:58.099 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-14T02:00:58.100 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:02:58.219 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:04:58.318 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:06:58.431 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:08:58.553 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:10:58.662 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:12:58.780 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:12:58.909 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-14T02:12:59.089 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-14T02:12:59.823 INFO:teuthology.orchestra.console.trial067:Power off
2026-02-14T02:12:59.823 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:12:59.835 INFO:teuthology.orchestra.console.trial070:Power off
2026-02-14T02:12:59.835 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:12:59.843 INFO:teuthology.orchestra.console.trial017:Power off
2026-02-14T02:12:59.843 DEBUG:teuthology.orchestra.console.trial017:pexpect command: ipmitool -H trial017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:12:59.862 DEBUG:teuthology.orchestra.console.trial067:power off output: Chassis Power Control: Down/Off
2026-02-14T02:12:59.873 DEBUG:teuthology.orchestra.console.trial070:power off output: Chassis Power Control: Down/Off
2026-02-14T02:12:59.881 DEBUG:teuthology.orchestra.console.trial017:power off output: Chassis Power Control: Down/Off
2026-02-14T02:13:03.862 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:13:03.873 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:13:03.881 DEBUG:teuthology.orchestra.console.trial017:pexpect command: ipmitool -H trial017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:13:03.972 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is on
2026-02-14T02:13:03.983 DEBUG:teuthology.orchestra.console.trial070:check power output: Chassis Power is on
2026-02-14T02:13:03.991 DEBUG:teuthology.orchestra.console.trial017:check power output: Chassis Power is on
2026-02-14T02:13:07.973 DEBUG:teuthology.orchestra.console.trial067:pexpect command: ipmitool -H trial067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:13:07.984 DEBUG:teuthology.orchestra.console.trial070:pexpect command: ipmitool -H trial070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:13:07.993 DEBUG:teuthology.orchestra.console.trial017:pexpect command: ipmitool -H trial017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:13:08.082 DEBUG:teuthology.orchestra.console.trial067:check power output: Chassis Power is off
2026-02-14T02:13:08.082 INFO:teuthology.orchestra.console.trial067:Power off completed
2026-02-14T02:13:08.094 DEBUG:teuthology.orchestra.console.trial070:check power output: Chassis Power is off
2026-02-14T02:13:08.094 INFO:teuthology.orchestra.console.trial070:Power off completed
2026-02-14T02:13:08.103 DEBUG:teuthology.orchestra.console.trial017:check power output: Chassis Power is off
2026-02-14T02:13:08.103 INFO:teuthology.orchestra.console.trial017:Power off completed
2026-02-14T02:13:08.383 INFO:teuthology.lock.ops:unlocked: trial067.front.sepia.ceph.com
2026-02-14T02:13:08.391 INFO:teuthology.lock.ops:unlocked: trial070.front.sepia.ceph.com
2026-02-14T02:13:08.395 INFO:teuthology.lock.ops:unlocked: trial017.front.sepia.ceph.com