2026-02-23T04:45:31.969 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T04:45:31.969 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:45:32.044 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:45:32.324 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7af3523ed8e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7af351b7ee80>, signals=[15])
2026-02-23T04:45:32.324 INFO:teuthology.lock.ops:Start node 'trial118.front.sepia.ceph.com' reimaging
2026-02-23T04:45:32.325 INFO:teuthology.lock.ops:Updating [trial118.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T04:45:32.325 INFO:teuthology.lock.ops:Updating trial118.front.sepia.ceph.com on lock server
2026-02-23T04:45:32.382 INFO:teuthology.lock.ops:Start node 'trial135.front.sepia.ceph.com' reimaging
2026-02-23T04:45:32.383 INFO:teuthology.lock.ops:Updating [trial135.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T04:45:32.383 INFO:teuthology.lock.ops:Updating trial135.front.sepia.ceph.com on lock server
2026-02-23T04:45:32.441 INFO:teuthology.lock.ops:Start node 'trial171.front.sepia.ceph.com' reimaging
2026-02-23T04:45:32.441 INFO:teuthology.lock.ops:Updating [trial171.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T04:45:32.441 INFO:teuthology.lock.ops:Updating trial171.front.sepia.ceph.com on lock server
2026-02-23T04:45:32.658 DEBUG:teuthology.provision.fog.trial135:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T04:45:32.659 DEBUG:teuthology.provision.fog.trial118:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T04:45:32.686 DEBUG:teuthology.provision.fog.trial171:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T04:45:32.714 INFO:teuthology.provision.fog.trial118:Scheduling deploy of centos 9.stream
2026-02-23T04:45:32.717 INFO:teuthology.provision.fog.trial135:Scheduling deploy of centos 9.stream
2026-02-23T04:45:32.738 INFO:teuthology.provision.fog.trial171:Scheduling deploy of centos 9.stream
2026-02-23T04:45:34.252 INFO:teuthology.orchestra.console.trial118:Power off
2026-02-23T04:45:34.252 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T04:45:34.352 DEBUG:teuthology.orchestra.console.trial118:power off output: Chassis Power Control: Down/Off
2026-02-23T04:45:34.357 INFO:teuthology.orchestra.console.trial171:Power off
2026-02-23T04:45:34.357 DEBUG:teuthology.orchestra.console.trial171:pexpect command: ipmitool -H trial171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T04:45:34.376 INFO:teuthology.orchestra.console.trial135:Power off
2026-02-23T04:45:34.376 DEBUG:teuthology.orchestra.console.trial135:pexpect command: ipmitool -H trial135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T04:45:34.395 DEBUG:teuthology.orchestra.console.trial171:power off output: Chassis Power Control: Down/Off
2026-02-23T04:45:34.414 DEBUG:teuthology.orchestra.console.trial135:power off output: Chassis Power Control: Down/Off
2026-02-23T04:45:38.357 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:45:38.395 DEBUG:teuthology.orchestra.console.trial171:pexpect command: ipmitool -H trial171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:45:38.415 DEBUG:teuthology.orchestra.console.trial135:pexpect command: ipmitool -H trial135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:45:38.465 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is off
2026-02-23T04:45:38.465 INFO:teuthology.orchestra.console.trial118:Power off completed
2026-02-23T04:45:38.504 DEBUG:teuthology.orchestra.console.trial171:check power output: Chassis Power is off
2026-02-23T04:45:38.504 INFO:teuthology.orchestra.console.trial171:Power off completed
2026-02-23T04:45:38.524 DEBUG:teuthology.orchestra.console.trial135:check power output: Chassis Power is off
2026-02-23T04:45:38.524 INFO:teuthology.orchestra.console.trial135:Power off completed
2026-02-23T04:45:38.566 INFO:teuthology.orchestra.console.trial118:Power on
2026-02-23T04:45:38.566 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T04:45:38.605 INFO:teuthology.orchestra.console.trial171:Power on
2026-02-23T04:45:38.606 DEBUG:teuthology.orchestra.console.trial171:pexpect command: ipmitool -H trial171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T04:45:38.614 DEBUG:teuthology.orchestra.console.trial118:power on output: Chassis Power Control: Up/On
2026-02-23T04:45:38.625 INFO:teuthology.orchestra.console.trial135:Power on
2026-02-23T04:45:38.625 DEBUG:teuthology.orchestra.console.trial135:pexpect command: ipmitool -H trial135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T04:45:38.646 DEBUG:teuthology.orchestra.console.trial171:power on output: Chassis Power Control: Up/On
2026-02-23T04:45:38.664 DEBUG:teuthology.orchestra.console.trial135:power on output: Chassis Power Control: Up/On
2026-02-23T04:45:42.620 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:45:42.647 DEBUG:teuthology.orchestra.console.trial171:pexpect command: ipmitool -H trial171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:45:42.665 DEBUG:teuthology.orchestra.console.trial135:pexpect command: ipmitool -H trial135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:45:42.730 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is on
2026-02-23T04:45:42.730 INFO:teuthology.orchestra.console.trial118:Power on completed
2026-02-23T04:45:42.757 DEBUG:teuthology.orchestra.console.trial171:check power output: Chassis Power is on
2026-02-23T04:45:42.757 INFO:teuthology.orchestra.console.trial171:Power on completed
2026-02-23T04:45:42.776 DEBUG:teuthology.orchestra.console.trial135:check power output: Chassis Power is on
2026-02-23T04:45:42.777 INFO:teuthology.orchestra.console.trial135:Power on completed
2026-02-23T04:45:42.831 INFO:teuthology.provision.fog.trial118:Waiting for deploy to finish
2026-02-23T04:45:42.859 INFO:teuthology.provision.fog.trial171:Waiting for deploy to finish
2026-02-23T04:45:42.878 INFO:teuthology.provision.fog.trial135:Waiting for deploy to finish
2026-02-23T04:47:30.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:47:30.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:47:30.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:47:31.091 ERROR:teuthology.orchestra.connection:Error authenticating with trial171.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-23T04:47:31.093 ERROR:teuthology.orchestra.connection:Error authenticating with trial135.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-23T04:47:33.952 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118
2026-02-23T04:47:39.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:47:43.039 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118
2026-02-23T04:47:49.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:47:52.128 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118
2026-02-23T04:47:58.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:48:01.216 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118
2026-02-23T04:48:07.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:48:10.304 WARNING:teuthology.provision.fog.trial118:[Errno None] Unable to connect to port 22 on 10.20.193.118
2026-02-23T04:48:16.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:48:35.094 WARNING:teuthology.provision.fog.trial171:timed out
2026-02-23T04:48:35.095 WARNING:teuthology.provision.fog.trial135:timed out
2026-02-23T04:48:41.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:48:41.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:48:44.294 ERROR:teuthology.orchestra.connection:Error authenticating with trial171.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T04:48:45.324 ERROR:teuthology.orchestra.connection:Error authenticating with trial135.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T04:48:48.431 ERROR:teuthology.orchestra.connection:Error authenticating with trial171.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T04:48:49.432 ERROR:teuthology.orchestra.connection:Error authenticating with trial135.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T04:48:52.219 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T04:48:52.219 DEBUG:teuthology.orchestra.run.trial118:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T04:48:55.540 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T04:48:55.540 DEBUG:teuthology.orchestra.run.trial171:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T04:48:55.694 INFO:teuthology.provision.fog.trial171:Node is ready
2026-02-23T04:48:55.694 DEBUG:teuthology.orchestra.run.trial171:> hostname
2026-02-23T04:48:55.751 INFO:teuthology.orchestra.run.trial171.stdout:trial171.front.sepia.ceph.com
2026-02-23T04:48:55.751 DEBUG:teuthology.orchestra.run.trial171:> grep trial171.front.sepia.ceph.com /etc/hosts
2026-02-23T04:48:55.809 INFO:teuthology.orchestra.run.trial171.stdout:10.20.193.171 trial171.front.sepia.ceph.com trial171
2026-02-23T04:48:55.809 DEBUG:teuthology.orchestra.run.trial171:> sudo hostname trial171
2026-02-23T04:48:55.879 DEBUG:teuthology.orchestra.run.trial171:> sudo sed -i -e 's/trial171.front.sepia.ceph.com/trial171/g' /etc/hosts
2026-02-23T04:48:55.944 DEBUG:teuthology.orchestra.run.trial171:> sudo sed -i -e 's/10.20.193.171/10.20.193.171/g' /etc/hosts
2026-02-23T04:48:56.009 DEBUG:teuthology.orchestra.run.trial171:> sudo sed -i -e 's/trial171.front.sepia.ceph.com/trial171/g' /etc/hostname
2026-02-23T04:48:56.075 DEBUG:teuthology.orchestra.run.trial171:> sudo hostname trial171
2026-02-23T04:48:56.139 DEBUG:teuthology.orchestra.run.trial171:> cat /etc/os-release
2026-02-23T04:48:56.195 INFO:teuthology.orchestra.run.trial171.stdout:NAME="CentOS Stream"
2026-02-23T04:48:56.196 INFO:teuthology.orchestra.run.trial171.stdout:VERSION="9"
2026-02-23T04:48:56.196 INFO:teuthology.orchestra.run.trial171.stdout:ID="centos"
2026-02-23T04:48:56.196 INFO:teuthology.orchestra.run.trial171.stdout:ID_LIKE="rhel fedora"
2026-02-23T04:48:56.196 INFO:teuthology.orchestra.run.trial171.stdout:VERSION_ID="9"
2026-02-23T04:48:56.196 INFO:teuthology.orchestra.run.trial171.stdout:PLATFORM_ID="platform:el9"
2026-02-23T04:48:56.196 INFO:teuthology.orchestra.run.trial171.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T04:48:56.196 INFO:teuthology.orchestra.run.trial171.stdout:ANSI_COLOR="0;31"
2026-02-23T04:48:56.197 INFO:teuthology.orchestra.run.trial171.stdout:LOGO="fedora-logo-icon"
2026-02-23T04:48:56.197 INFO:teuthology.orchestra.run.trial171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T04:48:56.197 INFO:teuthology.orchestra.run.trial171.stdout:HOME_URL="https://centos.org/"
2026-02-23T04:48:56.197 INFO:teuthology.orchestra.run.trial171.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T04:48:56.197 INFO:teuthology.orchestra.run.trial171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T04:48:56.197 INFO:teuthology.orchestra.run.trial171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T04:48:56.199 INFO:teuthology.provision.fog.trial171:Deploy complete!
2026-02-23T04:48:56.200 DEBUG:teuthology.parallel:result is None
2026-02-23T04:48:56.541 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T04:48:56.541 DEBUG:teuthology.orchestra.run.trial135:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T04:48:56.717 INFO:teuthology.provision.fog.trial135:Node is ready
2026-02-23T04:48:56.717 DEBUG:teuthology.orchestra.run.trial135:> hostname
2026-02-23T04:48:56.773 INFO:teuthology.orchestra.run.trial135.stdout:trial135.front.sepia.ceph.com
2026-02-23T04:48:56.773 DEBUG:teuthology.orchestra.run.trial135:> grep trial135.front.sepia.ceph.com /etc/hosts
2026-02-23T04:48:56.829 INFO:teuthology.orchestra.run.trial135.stdout:10.20.193.135 trial135.front.sepia.ceph.com trial135
2026-02-23T04:48:56.830 DEBUG:teuthology.orchestra.run.trial135:> sudo hostname trial135
2026-02-23T04:48:56.899 DEBUG:teuthology.orchestra.run.trial135:> sudo sed -i -e 's/trial135.front.sepia.ceph.com/trial135/g' /etc/hosts
2026-02-23T04:48:56.965 DEBUG:teuthology.orchestra.run.trial135:> sudo sed -i -e 's/10.20.193.135/10.20.193.135/g' /etc/hosts
2026-02-23T04:48:57.029 DEBUG:teuthology.orchestra.run.trial135:> sudo sed -i -e 's/trial135.front.sepia.ceph.com/trial135/g' /etc/hostname
2026-02-23T04:48:57.094 DEBUG:teuthology.orchestra.run.trial135:> sudo hostname trial135
2026-02-23T04:48:57.158 DEBUG:teuthology.orchestra.run.trial135:> cat /etc/os-release
2026-02-23T04:48:57.214 INFO:teuthology.orchestra.run.trial135.stdout:NAME="CentOS Stream"
2026-02-23T04:48:57.215 INFO:teuthology.orchestra.run.trial135.stdout:VERSION="9"
2026-02-23T04:48:57.215 INFO:teuthology.orchestra.run.trial135.stdout:ID="centos"
2026-02-23T04:48:57.215 INFO:teuthology.orchestra.run.trial135.stdout:ID_LIKE="rhel fedora"
2026-02-23T04:48:57.215 INFO:teuthology.orchestra.run.trial135.stdout:VERSION_ID="9"
2026-02-23T04:48:57.215 INFO:teuthology.orchestra.run.trial135.stdout:PLATFORM_ID="platform:el9"
2026-02-23T04:48:57.215 INFO:teuthology.orchestra.run.trial135.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T04:48:57.215 INFO:teuthology.orchestra.run.trial135.stdout:ANSI_COLOR="0;31"
2026-02-23T04:48:57.215 INFO:teuthology.orchestra.run.trial135.stdout:LOGO="fedora-logo-icon"
2026-02-23T04:48:57.216 INFO:teuthology.orchestra.run.trial135.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T04:48:57.216 INFO:teuthology.orchestra.run.trial135.stdout:HOME_URL="https://centos.org/"
2026-02-23T04:48:57.216 INFO:teuthology.orchestra.run.trial135.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T04:48:57.216 INFO:teuthology.orchestra.run.trial135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T04:48:57.216 INFO:teuthology.orchestra.run.trial135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T04:48:57.216 INFO:teuthology.provision.fog.trial135:Deploy complete!
2026-02-23T04:48:57.217 DEBUG:teuthology.parallel:result is None
2026-02-23T04:48:57.466 INFO:teuthology.provision.fog.trial118:Node is ready
2026-02-23T04:48:57.466 DEBUG:teuthology.orchestra.run.trial118:> hostname
2026-02-23T04:48:57.483 INFO:teuthology.orchestra.run.trial118.stdout:trial118.front.sepia.ceph.com
2026-02-23T04:48:57.483 DEBUG:teuthology.orchestra.run.trial118:> grep trial118.front.sepia.ceph.com /etc/hosts
2026-02-23T04:48:57.540 INFO:teuthology.orchestra.run.trial118.stdout:10.20.193.118 trial118.front.sepia.ceph.com trial118
2026-02-23T04:48:57.540 DEBUG:teuthology.orchestra.run.trial118:> sudo hostname trial118
2026-02-23T04:48:57.610 DEBUG:teuthology.orchestra.run.trial118:> sudo sed -i -e 's/trial118.front.sepia.ceph.com/trial118/g' /etc/hosts
2026-02-23T04:48:57.673 DEBUG:teuthology.orchestra.run.trial118:> sudo sed -i -e 's/10.20.193.118/10.20.193.118/g' /etc/hosts
2026-02-23T04:48:57.737 DEBUG:teuthology.orchestra.run.trial118:> sudo sed -i -e 's/trial118.front.sepia.ceph.com/trial118/g' /etc/hostname
2026-02-23T04:48:57.803 DEBUG:teuthology.orchestra.run.trial118:> sudo hostname trial118
2026-02-23T04:48:57.866 DEBUG:teuthology.orchestra.run.trial118:> cat /etc/os-release
2026-02-23T04:48:57.922 INFO:teuthology.orchestra.run.trial118.stdout:NAME="CentOS Stream"
2026-02-23T04:48:57.922 INFO:teuthology.orchestra.run.trial118.stdout:VERSION="9"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:ID="centos"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:ID_LIKE="rhel fedora"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:VERSION_ID="9"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:PLATFORM_ID="platform:el9"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:ANSI_COLOR="0;31"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:LOGO="fedora-logo-icon"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:HOME_URL="https://centos.org/"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T04:48:57.923 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T04:48:57.924 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T04:48:57.924 INFO:teuthology.provision.fog.trial118:Deploy complete!
2026-02-23T04:48:57.925 DEBUG:teuthology.parallel:result is None
2026-02-23T04:48:58.459 INFO:teuthology.lock.ops:Checking trial118.front.sepia.ceph.com
2026-02-23T04:48:58.459 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T04:48:58.564 INFO:teuthology.lock.ops:Checking trial135.front.sepia.ceph.com
2026-02-23T04:48:58.564 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T04:48:58.632 INFO:teuthology.lock.ops:Checking trial171.front.sepia.ceph.com
2026-02-23T04:48:58.632 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T04:48:58.689 INFO:teuthology.lock.ops:Updating [trial118.front.sepia.ceph.com]: set os type and version on server
2026-02-23T04:48:58.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial118.front.sepia.ceph.com'
2026-02-23T04:48:58.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:48:58.750 DEBUG:teuthology.orchestra.run.trial118:> true
2026-02-23T04:48:58.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial118.front.sepia.ceph.com'
2026-02-23T04:48:58.830 DEBUG:teuthology.orchestra.run.trial118:> uname -m
2026-02-23T04:48:58.887 INFO:teuthology.orchestra.run.trial118.stdout:x86_64
2026-02-23T04:48:58.887 DEBUG:teuthology.orchestra.run.trial118:> cat /etc/os-release
2026-02-23T04:48:58.942 INFO:teuthology.orchestra.run.trial118.stdout:NAME="CentOS Stream"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:VERSION="9"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:ID="centos"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:ID_LIKE="rhel fedora"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:VERSION_ID="9"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:PLATFORM_ID="platform:el9"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:ANSI_COLOR="0;31"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:LOGO="fedora-logo-icon"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T04:48:58.943 INFO:teuthology.orchestra.run.trial118.stdout:HOME_URL="https://centos.org/"
2026-02-23T04:48:58.944 INFO:teuthology.orchestra.run.trial118.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T04:48:58.944 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T04:48:58.944 INFO:teuthology.orchestra.run.trial118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T04:48:58.944 INFO:teuthology.lock.ops:Updating trial118.front.sepia.ceph.com on lock server
2026-02-23T04:48:59.053 INFO:teuthology.lock.ops:Updating [trial135.front.sepia.ceph.com]: set os type and version on server
2026-02-23T04:48:59.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial135.front.sepia.ceph.com'
2026-02-23T04:48:59.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:48:59.124 DEBUG:teuthology.orchestra.run.trial135:> true
2026-02-23T04:48:59.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial135.front.sepia.ceph.com'
2026-02-23T04:48:59.199 DEBUG:teuthology.orchestra.run.trial135:> uname -m
2026-02-23T04:48:59.255 INFO:teuthology.orchestra.run.trial135.stdout:x86_64
2026-02-23T04:48:59.256 DEBUG:teuthology.orchestra.run.trial135:> cat /etc/os-release
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:NAME="CentOS Stream"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:VERSION="9"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:ID="centos"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:ID_LIKE="rhel fedora"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:VERSION_ID="9"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:PLATFORM_ID="platform:el9"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:ANSI_COLOR="0;31"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:LOGO="fedora-logo-icon"
2026-02-23T04:48:59.312 INFO:teuthology.orchestra.run.trial135.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T04:48:59.313 INFO:teuthology.orchestra.run.trial135.stdout:HOME_URL="https://centos.org/"
2026-02-23T04:48:59.313 INFO:teuthology.orchestra.run.trial135.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T04:48:59.313 INFO:teuthology.orchestra.run.trial135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T04:48:59.313 INFO:teuthology.orchestra.run.trial135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T04:48:59.313 INFO:teuthology.lock.ops:Updating trial135.front.sepia.ceph.com on lock server
2026-02-23T04:48:59.411 INFO:teuthology.lock.ops:Updating [trial171.front.sepia.ceph.com]: set os type and version on server
2026-02-23T04:48:59.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial171.front.sepia.ceph.com'
2026-02-23T04:48:59.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:48:59.477 DEBUG:teuthology.orchestra.run.trial171:> true
2026-02-23T04:48:59.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial171.front.sepia.ceph.com'
2026-02-23T04:48:59.557 DEBUG:teuthology.orchestra.run.trial171:> uname -m
2026-02-23T04:48:59.613 INFO:teuthology.orchestra.run.trial171.stdout:x86_64
2026-02-23T04:48:59.613 DEBUG:teuthology.orchestra.run.trial171:> cat /etc/os-release
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:NAME="CentOS Stream"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:VERSION="9"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:ID="centos"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:ID_LIKE="rhel fedora"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:VERSION_ID="9"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:PLATFORM_ID="platform:el9"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:ANSI_COLOR="0;31"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:LOGO="fedora-logo-icon"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T04:48:59.669 INFO:teuthology.orchestra.run.trial171.stdout:HOME_URL="https://centos.org/"
2026-02-23T04:48:59.670 INFO:teuthology.orchestra.run.trial171.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T04:48:59.670 INFO:teuthology.orchestra.run.trial171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T04:48:59.670 INFO:teuthology.orchestra.run.trial171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T04:48:59.670 INFO:teuthology.lock.ops:Updating trial171.front.sepia.ceph.com on lock server
2026-02-23T04:48:59.733 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:48:59.821 INFO:teuthology.dispatcher.supervisor:Running job 64846
2026-02-23T04:48:59.821 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64846 --name vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64846/orig.config.yaml
2026-02-23T04:48:59.822 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64846
2026-02-23T04:48:59.822 INFO:teuthology.dispatcher.supervisor:Job PID: 1685692
2026-02-23T04:48:59.822 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T04:50:59.823 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:52:59.926 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:55:00.050 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:57:00.172 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:59:00.294 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:01:00.420 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:01:00.548 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-23T05:01:00.732 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T05:01:01.528 INFO:teuthology.orchestra.console.trial171:Power off
2026-02-23T05:01:01.529 DEBUG:teuthology.orchestra.console.trial171:pexpect command: ipmitool -H trial171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T05:01:01.542 INFO:teuthology.orchestra.console.trial135:Power off
2026-02-23T05:01:01.542 DEBUG:teuthology.orchestra.console.trial135:pexpect command: ipmitool -H trial135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T05:01:01.551 INFO:teuthology.orchestra.console.trial118:Power off
2026-02-23T05:01:01.551 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T05:01:01.570 DEBUG:teuthology.orchestra.console.trial171:power off output: Chassis Power Control: Down/Off
2026-02-23T05:01:01.580 DEBUG:teuthology.orchestra.console.trial135:power off output: Chassis Power Control: Down/Off
2026-02-23T05:01:01.590 DEBUG:teuthology.orchestra.console.trial118:power off output: Chassis Power Control: Down/Off
2026-02-23T05:01:05.571 DEBUG:teuthology.orchestra.console.trial171:pexpect command: ipmitool -H trial171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:01:05.581 DEBUG:teuthology.orchestra.console.trial135:pexpect command: ipmitool -H trial135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:01:05.591 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:01:05.681 DEBUG:teuthology.orchestra.console.trial171:check power output: Chassis Power is on
2026-02-23T05:01:05.690 DEBUG:teuthology.orchestra.console.trial135:check power output: Chassis Power is on
2026-02-23T05:01:05.700 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is on
2026-02-23T05:01:09.683 DEBUG:teuthology.orchestra.console.trial171:pexpect command: ipmitool -H trial171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:01:09.691 DEBUG:teuthology.orchestra.console.trial135:pexpect command: ipmitool -H trial135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:01:09.702 DEBUG:teuthology.orchestra.console.trial118:pexpect command: ipmitool -H trial118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:01:09.792 DEBUG:teuthology.orchestra.console.trial171:check power output: Chassis Power is off
2026-02-23T05:01:09.792 INFO:teuthology.orchestra.console.trial171:Power off completed
2026-02-23T05:01:09.798 DEBUG:teuthology.orchestra.console.trial135:check power output: Chassis Power is off
2026-02-23T05:01:09.798 INFO:teuthology.orchestra.console.trial135:Power off completed
2026-02-23T05:01:09.810 DEBUG:teuthology.orchestra.console.trial118:check power output: Chassis Power is off
2026-02-23T05:01:09.810 INFO:teuthology.orchestra.console.trial118:Power off completed
2026-02-23T05:01:10.084 INFO:teuthology.lock.ops:unlocked: trial135.front.sepia.ceph.com
2026-02-23T05:01:10.087 INFO:teuthology.lock.ops:unlocked: trial171.front.sepia.ceph.com
2026-02-23T05:01:10.096 INFO:teuthology.lock.ops:unlocked: trial118.front.sepia.ceph.com