2026-02-20T13:01:04.049 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-20T13:01:04.049 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:01:04.120 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:01:04.369 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7d58a98a65a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7d58a90913a0>, signals=[15])
2026-02-20T13:01:04.369 INFO:teuthology.lock.ops:Start node 'trial028.front.sepia.ceph.com' reimaging
2026-02-20T13:01:04.369 INFO:teuthology.lock.ops:Updating [trial028.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T13:01:04.369 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server
2026-02-20T13:01:04.427 INFO:teuthology.lock.ops:Start node 'trial034.front.sepia.ceph.com' reimaging
2026-02-20T13:01:04.427 INFO:teuthology.lock.ops:Updating [trial034.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T13:01:04.427 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server
2026-02-20T13:01:04.485 INFO:teuthology.lock.ops:Start node 'trial127.front.sepia.ceph.com' reimaging
2026-02-20T13:01:04.485 INFO:teuthology.lock.ops:Updating [trial127.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T13:01:04.485 INFO:teuthology.lock.ops:Updating trial127.front.sepia.ceph.com on lock server
2026-02-20T13:01:04.689 DEBUG:teuthology.provision.fog.trial028:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T13:01:04.690 DEBUG:teuthology.provision.fog.trial034:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T13:01:04.739 INFO:teuthology.provision.fog.trial034:Scheduling deploy of centos 9.stream
2026-02-20T13:01:04.743 INFO:teuthology.provision.fog.trial028:Scheduling deploy of centos 9.stream
2026-02-20T13:01:04.747 DEBUG:teuthology.provision.fog.trial127:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T13:01:04.797 INFO:teuthology.provision.fog.trial127:Scheduling deploy of centos 9.stream
2026-02-20T13:01:06.131 INFO:teuthology.orchestra.console.trial034:Power off
2026-02-20T13:01:06.131 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T13:01:06.141 INFO:teuthology.orchestra.console.trial127:Power off
2026-02-20T13:01:06.141 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T13:01:06.151 INFO:teuthology.orchestra.console.trial028:Power off
2026-02-20T13:01:06.151 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T13:01:06.170 DEBUG:teuthology.orchestra.console.trial034:power off output: Chassis Power Control: Down/Off
2026-02-20T13:01:06.179 DEBUG:teuthology.orchestra.console.trial127:power off output: Chassis Power Control: Down/Off
2026-02-20T13:01:06.188 DEBUG:teuthology.orchestra.console.trial028:power off output: Chassis Power Control: Down/Off
2026-02-20T13:01:10.175 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:01:10.183 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:01:10.190 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:01:10.286 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is off
2026-02-20T13:01:10.286 INFO:teuthology.orchestra.console.trial034:Power off completed
2026-02-20T13:01:10.292 DEBUG:teuthology.orchestra.console.trial127:check power output: Chassis Power is off
2026-02-20T13:01:10.292 INFO:teuthology.orchestra.console.trial127:Power off completed
2026-02-20T13:01:10.298 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is off
2026-02-20T13:01:10.298 INFO:teuthology.orchestra.console.trial028:Power off completed
2026-02-20T13:01:10.387 INFO:teuthology.orchestra.console.trial034:Power on
2026-02-20T13:01:10.388 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T13:01:10.396 INFO:teuthology.orchestra.console.trial127:Power on
2026-02-20T13:01:10.397 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T13:01:10.405 INFO:teuthology.orchestra.console.trial028:Power on
2026-02-20T13:01:10.405 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T13:01:10.428 DEBUG:teuthology.orchestra.console.trial034:power on output: Chassis Power Control: Up/On
2026-02-20T13:01:10.436 DEBUG:teuthology.orchestra.console.trial127:power on output: Chassis Power Control: Up/On
2026-02-20T13:01:10.444 DEBUG:teuthology.orchestra.console.trial028:power on output: Chassis Power Control: Up/On
2026-02-20T13:01:14.433 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:01:14.442 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:01:14.450 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:01:14.545 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is on
2026-02-20T13:01:14.546 INFO:teuthology.orchestra.console.trial034:Power on completed
2026-02-20T13:01:14.551 DEBUG:teuthology.orchestra.console.trial127:check power output: Chassis Power is on
2026-02-20T13:01:14.551 INFO:teuthology.orchestra.console.trial127:Power on completed
2026-02-20T13:01:14.561 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is on
2026-02-20T13:01:14.561 INFO:teuthology.orchestra.console.trial028:Power on completed
2026-02-20T13:01:14.647 INFO:teuthology.provision.fog.trial034:Waiting for deploy to finish
2026-02-20T13:01:14.653 INFO:teuthology.provision.fog.trial127:Waiting for deploy to finish
2026-02-20T13:01:14.663 INFO:teuthology.provision.fog.trial028:Waiting for deploy to finish
2026-02-20T13:03:02.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:03:02.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:03:02.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:03:02.679 ERROR:teuthology.orchestra.connection:Error authenticating with trial127.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-20T13:03:02.807 ERROR:teuthology.orchestra.connection:Error authenticating with trial028.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-20T13:03:16.928 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-20T13:03:22.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:03:26.016 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-20T13:03:32.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:03:35.104 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-20T13:03:41.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:03:44.192 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-20T13:03:50.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:04:06.681 WARNING:teuthology.provision.fog.trial127:timed out
2026-02-20T13:04:06.811 WARNING:teuthology.provision.fog.trial028:timed out
2026-02-20T13:04:12.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:04:12.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:04:14.969 ERROR:teuthology.orchestra.connection:Error authenticating with trial028.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-20T13:04:15.875 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T13:04:15.875 DEBUG:teuthology.orchestra.run.trial127:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T13:04:19.083 ERROR:teuthology.orchestra.connection:Error authenticating with trial028.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-20T13:04:26.146 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T13:04:26.146 DEBUG:teuthology.orchestra.run.trial034:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T13:04:26.156 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T13:04:26.156 DEBUG:teuthology.orchestra.run.trial028:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T13:04:26.271 INFO:teuthology.provision.fog.trial034:Node is ready
2026-02-20T13:04:26.272 DEBUG:teuthology.orchestra.run.trial034:> hostname
2026-02-20T13:04:26.325 INFO:teuthology.orchestra.run.trial034.stdout:trial034.front.sepia.ceph.com
2026-02-20T13:04:26.326 DEBUG:teuthology.orchestra.run.trial034:> grep trial034.front.sepia.ceph.com /etc/hosts
2026-02-20T13:04:26.378 INFO:teuthology.orchestra.run.trial034.stdout:10.20.193.34 trial034.front.sepia.ceph.com trial034
2026-02-20T13:04:26.379 DEBUG:teuthology.orchestra.run.trial034:> sudo hostname trial034
2026-02-20T13:04:26.433 INFO:teuthology.provision.fog.trial127:Node is ready
2026-02-20T13:04:26.434 DEBUG:teuthology.orchestra.run.trial127:> hostname
2026-02-20T13:04:26.448 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/trial034.front.sepia.ceph.com/trial034/g' /etc/hosts
2026-02-20T13:04:26.451 INFO:teuthology.orchestra.run.trial127.stdout:trial127.front.sepia.ceph.com
2026-02-20T13:04:26.452 DEBUG:teuthology.orchestra.run.trial127:> grep trial127.front.sepia.ceph.com /etc/hosts
2026-02-20T13:04:26.463 INFO:teuthology.provision.fog.trial028:Node is ready
2026-02-20T13:04:26.463 DEBUG:teuthology.orchestra.run.trial028:> hostname
2026-02-20T13:04:26.511 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/10.20.193.34/10.20.193.34/g' /etc/hosts
2026-02-20T13:04:26.513 INFO:teuthology.orchestra.run.trial127.stdout:10.20.193.127 trial127.front.sepia.ceph.com trial127
2026-02-20T13:04:26.513 DEBUG:teuthology.orchestra.run.trial127:> sudo hostname trial127
2026-02-20T13:04:26.519 INFO:teuthology.orchestra.run.trial028.stdout:trial028.front.sepia.ceph.com
2026-02-20T13:04:26.520 DEBUG:teuthology.orchestra.run.trial028:> grep trial028.front.sepia.ceph.com /etc/hosts
2026-02-20T13:04:26.574 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/trial034.front.sepia.ceph.com/trial034/g' /etc/hostname
2026-02-20T13:04:26.575 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28 trial028.front.sepia.ceph.com trial028
2026-02-20T13:04:26.576 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname trial028
2026-02-20T13:04:26.588 DEBUG:teuthology.orchestra.run.trial127:> sudo sed -i -e 's/trial127.front.sepia.ceph.com/trial127/g' /etc/hosts
2026-02-20T13:04:26.637 DEBUG:teuthology.orchestra.run.trial034:> sudo hostname trial034
2026-02-20T13:04:26.647 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/trial028.front.sepia.ceph.com/trial028/g' /etc/hosts
2026-02-20T13:04:26.657 DEBUG:teuthology.orchestra.run.trial127:> sudo sed -i -e 's/10.20.193.127/10.20.193.127/g' /etc/hosts
2026-02-20T13:04:26.698 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release
2026-02-20T13:04:26.712 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/10.20.193.28/10.20.193.28/g' /etc/hosts
2026-02-20T13:04:26.726 DEBUG:teuthology.orchestra.run.trial127:> sudo sed -i -e 's/trial127.front.sepia.ceph.com/trial127/g' /etc/hostname
2026-02-20T13:04:26.753 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream"
2026-02-20T13:04:26.753 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9"
2026-02-20T13:04:26.753 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos"
2026-02-20T13:04:26.753 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T13:04:26.754 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T13:04:26.755 INFO:teuthology.provision.fog.trial034:Deploy complete!
2026-02-20T13:04:26.757 DEBUG:teuthology.parallel:result is None
2026-02-20T13:04:26.783 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/trial028.front.sepia.ceph.com/trial028/g' /etc/hostname
2026-02-20T13:04:26.794 DEBUG:teuthology.orchestra.run.trial127:> sudo hostname trial127
2026-02-20T13:04:26.850 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname trial028
2026-02-20T13:04:26.862 DEBUG:teuthology.orchestra.run.trial127:> cat /etc/os-release
2026-02-20T13:04:26.915 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release
2026-02-20T13:04:26.921 INFO:teuthology.orchestra.run.trial127.stdout:NAME="CentOS Stream"
2026-02-20T13:04:26.921 INFO:teuthology.orchestra.run.trial127.stdout:VERSION="9"
2026-02-20T13:04:26.921 INFO:teuthology.orchestra.run.trial127.stdout:ID="centos"
2026-02-20T13:04:26.921 INFO:teuthology.orchestra.run.trial127.stdout:ID_LIKE="rhel fedora"
2026-02-20T13:04:26.921 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_ID="9"
2026-02-20T13:04:26.921 INFO:teuthology.orchestra.run.trial127.stdout:PLATFORM_ID="platform:el9"
2026-02-20T13:04:26.922 INFO:teuthology.orchestra.run.trial127.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T13:04:26.922 INFO:teuthology.orchestra.run.trial127.stdout:ANSI_COLOR="0;31"
2026-02-20T13:04:26.922 INFO:teuthology.orchestra.run.trial127.stdout:LOGO="fedora-logo-icon"
2026-02-20T13:04:26.922 INFO:teuthology.orchestra.run.trial127.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T13:04:26.922 INFO:teuthology.orchestra.run.trial127.stdout:HOME_URL="https://centos.org/"
2026-02-20T13:04:26.922 INFO:teuthology.orchestra.run.trial127.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T13:04:26.922 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T13:04:26.922 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T13:04:26.922 INFO:teuthology.provision.fog.trial127:Deploy complete!
2026-02-20T13:04:26.922 DEBUG:teuthology.parallel:result is None
2026-02-20T13:04:26.973 INFO:teuthology.orchestra.run.trial028.stdout:NAME="CentOS Stream"
2026-02-20T13:04:26.973 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="9"
2026-02-20T13:04:26.973 INFO:teuthology.orchestra.run.trial028.stdout:ID="centos"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel fedora"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="9"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el9"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;31"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://centos.org/"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T13:04:26.974 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T13:04:26.975 INFO:teuthology.provision.fog.trial028:Deploy complete!
2026-02-20T13:04:26.976 DEBUG:teuthology.parallel:result is None
2026-02-20T13:04:27.500 INFO:teuthology.lock.ops:Checking trial028.front.sepia.ceph.com
2026-02-20T13:04:27.500 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T13:04:27.571 INFO:teuthology.lock.ops:Checking trial034.front.sepia.ceph.com
2026-02-20T13:04:27.571 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T13:04:27.629 INFO:teuthology.lock.ops:Checking trial127.front.sepia.ceph.com
2026-02-20T13:04:27.629 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T13:04:27.688 INFO:teuthology.lock.ops:Updating [trial028.front.sepia.ceph.com]: set os type and version on server
2026-02-20T13:04:27.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com'
2026-02-20T13:04:27.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:04:27.754 DEBUG:teuthology.orchestra.run.trial028:> true
2026-02-20T13:04:27.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com'
2026-02-20T13:04:27.835 DEBUG:teuthology.orchestra.run.trial028:> uname -m
2026-02-20T13:04:27.891 INFO:teuthology.orchestra.run.trial028.stdout:x86_64
2026-02-20T13:04:27.891 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release
2026-02-20T13:04:27.947 INFO:teuthology.orchestra.run.trial028.stdout:NAME="CentOS Stream"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="9"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:ID="centos"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel fedora"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="9"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el9"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;31"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon"
2026-02-20T13:04:27.948 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T13:04:27.949 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://centos.org/"
2026-02-20T13:04:27.949 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T13:04:27.949 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T13:04:27.949 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T13:04:27.950 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server
2026-02-20T13:04:28.056 INFO:teuthology.lock.ops:Updating [trial034.front.sepia.ceph.com]: set os type and version on server
2026-02-20T13:04:28.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial034.front.sepia.ceph.com'
2026-02-20T13:04:28.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:04:28.124 DEBUG:teuthology.orchestra.run.trial034:> true
2026-02-20T13:04:28.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial034.front.sepia.ceph.com'
2026-02-20T13:04:28.203 DEBUG:teuthology.orchestra.run.trial034:> uname -m
2026-02-20T13:04:28.258 INFO:teuthology.orchestra.run.trial034.stdout:x86_64
2026-02-20T13:04:28.258 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T13:04:28.314 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T13:04:28.314 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server
2026-02-20T13:04:28.378 INFO:teuthology.lock.ops:Updating [trial127.front.sepia.ceph.com]: set os type and version on server
2026-02-20T13:04:28.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com'
2026-02-20T13:04:28.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T13:04:28.445 DEBUG:teuthology.orchestra.run.trial127:> true
2026-02-20T13:04:28.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com'
2026-02-20T13:04:28.523 DEBUG:teuthology.orchestra.run.trial127:> uname -m
2026-02-20T13:04:28.583 INFO:teuthology.orchestra.run.trial127.stdout:x86_64
2026-02-20T13:04:28.584 DEBUG:teuthology.orchestra.run.trial127:> cat /etc/os-release
2026-02-20T13:04:28.643 INFO:teuthology.orchestra.run.trial127.stdout:NAME="CentOS Stream"
2026-02-20T13:04:28.643 INFO:teuthology.orchestra.run.trial127.stdout:VERSION="9"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:ID="centos"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:ID_LIKE="rhel fedora"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_ID="9"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:PLATFORM_ID="platform:el9"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:ANSI_COLOR="0;31"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:LOGO="fedora-logo-icon"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:HOME_URL="https://centos.org/"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T13:04:28.644 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T13:04:28.645 INFO:teuthology.lock.ops:Updating trial127.front.sepia.ceph.com on lock server
2026-02-20T13:04:28.731 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:04:28.818 INFO:teuthology.dispatcher.supervisor:Running job 60221
2026-02-20T13:04:28.818 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221 --name vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221/orig.config.yaml
2026-02-20T13:04:28.818 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60221
2026-02-20T13:04:28.818 INFO:teuthology.dispatcher.supervisor:Job PID: 1980915
2026-02-20T13:04:28.818 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-20T13:06:28.820 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:08:28.944 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:10:29.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:12:29.184 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:14:29.311 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:16:29.803 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:18:29.936 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:20:30.061 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:22:30.171 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:24:30.270 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:26:30.397 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:28:30.518 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:30:30.645 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:32:30.766 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:34:30.842 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:36:30.965 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T13:36:31.036 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-20T13:36:31.212 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-20T13:36:31.963 INFO:teuthology.orchestra.console.trial028:Power off
2026-02-20T13:36:31.963 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T13:36:31.977 INFO:teuthology.orchestra.console.trial034:Power off
2026-02-20T13:36:31.977 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T13:36:31.987 INFO:teuthology.orchestra.console.trial127:Power off
2026-02-20T13:36:31.987 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T13:36:32.005 DEBUG:teuthology.orchestra.console.trial028:power off output: Chassis Power Control: Down/Off
2026-02-20T13:36:32.021 DEBUG:teuthology.orchestra.console.trial034:power off output: Chassis Power Control: Down/Off
2026-02-20T13:36:32.026 DEBUG:teuthology.orchestra.console.trial127:power off output: Chassis Power Control: Down/Off
2026-02-20T13:36:36.006 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:36:36.021 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:36:36.028 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:36:36.114 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is on
2026-02-20T13:36:36.130 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is on
2026-02-20T13:36:36.137 DEBUG:teuthology.orchestra.console.trial127:check power output: Chassis Power is on
2026-02-20T13:36:40.115 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:36:40.131 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:36:40.137 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T13:36:40.223 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is off
2026-02-20T13:36:40.224 INFO:teuthology.orchestra.console.trial028:Power off completed
2026-02-20T13:36:40.239 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is off
2026-02-20T13:36:40.239 INFO:teuthology.orchestra.console.trial034:Power off completed
2026-02-20T13:36:40.246 DEBUG:teuthology.orchestra.console.trial127:check power output: Chassis Power is off
2026-02-20T13:36:40.246 INFO:teuthology.orchestra.console.trial127:Power off completed
2026-02-20T13:36:40.518 INFO:teuthology.lock.ops:unlocked: trial028.front.sepia.ceph.com
2026-02-20T13:36:40.526 INFO:teuthology.lock.ops:unlocked: trial034.front.sepia.ceph.com
2026-02-20T13:36:40.530 INFO:teuthology.lock.ops:unlocked: trial127.front.sepia.ceph.com