2026-02-23T05:57:08.086 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T05:57:08.086 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:57:08.158 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:57:08.412 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x74f53f5114f0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x74f53ea7fb00>, signals=[15])
2026-02-23T05:57:08.413 INFO:teuthology.lock.ops:Start node 'trial020.front.sepia.ceph.com' reimaging
2026-02-23T05:57:08.413 INFO:teuthology.lock.ops:Updating [trial020.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T05:57:08.413 INFO:teuthology.lock.ops:Updating trial020.front.sepia.ceph.com on lock server
2026-02-23T05:57:08.470 INFO:teuthology.lock.ops:Start node 'trial068.front.sepia.ceph.com' reimaging
2026-02-23T05:57:08.470 INFO:teuthology.lock.ops:Updating [trial068.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T05:57:08.470 INFO:teuthology.lock.ops:Updating trial068.front.sepia.ceph.com on lock server
2026-02-23T05:57:08.527 INFO:teuthology.lock.ops:Start node 'trial080.front.sepia.ceph.com' reimaging
2026-02-23T05:57:08.527 INFO:teuthology.lock.ops:Updating [trial080.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T05:57:08.527 INFO:teuthology.lock.ops:Updating trial080.front.sepia.ceph.com on lock server
2026-02-23T05:57:08.758 DEBUG:teuthology.provision.fog.trial068:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T05:57:08.758 DEBUG:teuthology.provision.fog.trial020:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T05:57:08.811 INFO:teuthology.provision.fog.trial068:Scheduling deploy of centos 9.stream
2026-02-23T05:57:08.813 INFO:teuthology.provision.fog.trial020:Scheduling deploy of centos 9.stream
2026-02-23T05:57:08.817 DEBUG:teuthology.provision.fog.trial080:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T05:57:08.862 INFO:teuthology.provision.fog.trial080:Scheduling deploy of centos 9.stream
2026-02-23T05:57:10.735 INFO:teuthology.orchestra.console.trial068:Power off
2026-02-23T05:57:10.735 DEBUG:teuthology.orchestra.console.trial068:pexpect command: ipmitool -H trial068.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T05:57:10.747 INFO:teuthology.orchestra.console.trial080:Power off
2026-02-23T05:57:10.747 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T05:57:10.755 INFO:teuthology.orchestra.console.trial020:Power off
2026-02-23T05:57:10.755 DEBUG:teuthology.orchestra.console.trial020:pexpect command: ipmitool -H trial020.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T05:57:10.774 DEBUG:teuthology.orchestra.console.trial068:power off output: Chassis Power Control: Down/Off
2026-02-23T05:57:10.785 DEBUG:teuthology.orchestra.console.trial080:power off output: Chassis Power Control: Down/Off
2026-02-23T05:57:10.792 DEBUG:teuthology.orchestra.console.trial020:power off output: Chassis Power Control: Down/Off
2026-02-23T05:57:14.779 DEBUG:teuthology.orchestra.console.trial068:pexpect command: ipmitool -H trial068.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:57:14.786 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:57:14.793 DEBUG:teuthology.orchestra.console.trial020:pexpect command: ipmitool -H trial020.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:57:14.888 DEBUG:teuthology.orchestra.console.trial068:check power output: Chassis Power is off
2026-02-23T05:57:14.888 INFO:teuthology.orchestra.console.trial068:Power off completed
2026-02-23T05:57:14.892 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is off
2026-02-23T05:57:14.893 INFO:teuthology.orchestra.console.trial080:Power off completed
2026-02-23T05:57:14.900 DEBUG:teuthology.orchestra.console.trial020:check power output: Chassis Power is off
2026-02-23T05:57:14.900 INFO:teuthology.orchestra.console.trial020:Power off completed
2026-02-23T05:57:14.989 INFO:teuthology.orchestra.console.trial068:Power on
2026-02-23T05:57:14.990 DEBUG:teuthology.orchestra.console.trial068:pexpect command: ipmitool -H trial068.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T05:57:14.999 INFO:teuthology.orchestra.console.trial080:Power on
2026-02-23T05:57:14.999 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T05:57:15.008 INFO:teuthology.orchestra.console.trial020:Power on
2026-02-23T05:57:15.009 DEBUG:teuthology.orchestra.console.trial020:pexpect command: ipmitool -H trial020.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T05:57:15.031 DEBUG:teuthology.orchestra.console.trial068:power on output: Chassis Power Control: Up/On
2026-02-23T05:57:15.039 DEBUG:teuthology.orchestra.console.trial080:power on output: Chassis Power Control: Up/On
2026-02-23T05:57:15.049 DEBUG:teuthology.orchestra.console.trial020:power on output: Chassis Power Control: Up/On
2026-02-23T05:57:19.035 DEBUG:teuthology.orchestra.console.trial068:pexpect command: ipmitool -H trial068.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:57:19.043 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:57:19.051 DEBUG:teuthology.orchestra.console.trial020:pexpect command: ipmitool -H trial020.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:57:19.145 DEBUG:teuthology.orchestra.console.trial068:check power output: Chassis Power is on
2026-02-23T05:57:19.146 INFO:teuthology.orchestra.console.trial068:Power on completed
2026-02-23T05:57:19.153 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is on
2026-02-23T05:57:19.153 INFO:teuthology.orchestra.console.trial080:Power on completed
2026-02-23T05:57:19.161 DEBUG:teuthology.orchestra.console.trial020:check power output: Chassis Power is on
2026-02-23T05:57:19.161 INFO:teuthology.orchestra.console.trial020:Power on completed
2026-02-23T05:57:19.247 INFO:teuthology.provision.fog.trial068:Waiting for deploy to finish
2026-02-23T05:57:19.254 INFO:teuthology.provision.fog.trial080:Waiting for deploy to finish
2026-02-23T05:57:19.262 INFO:teuthology.provision.fog.trial020:Waiting for deploy to finish
2026-02-23T05:59:07.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:07.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:07.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:10.912 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-23T05:59:16.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:20.001 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-23T05:59:26.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:29.088 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-23T05:59:30.432 WARNING:teuthology.provision.fog.trial068:[Errno None] Unable to connect to port 22 on 10.20.193.68
2026-02-23T05:59:35.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:36.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:38.176 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-23T05:59:39.520 WARNING:teuthology.provision.fog.trial068:[Errno None] Unable to connect to port 22 on 10.20.193.68
2026-02-23T05:59:44.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:45.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:47.264 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-23T05:59:48.608 WARNING:teuthology.provision.fog.trial068:[Errno None] Unable to connect to port 22 on 10.20.193.68
2026-02-23T05:59:53.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:59:54.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T06:00:07.822 WARNING:teuthology.provision.fog.trial020:timed out
2026-02-23T06:00:13.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T06:00:19.114 ERROR:teuthology.orchestra.connection:Error authenticating with trial020.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T06:00:23.220 ERROR:teuthology.orchestra.connection:Error authenticating with trial020.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T06:00:29.428 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T06:00:29.428 DEBUG:teuthology.orchestra.run.trial080:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T06:00:29.667 INFO:teuthology.provision.fog.trial080:Node is ready
2026-02-23T06:00:29.668 DEBUG:teuthology.orchestra.run.trial080:> hostname
2026-02-23T06:00:29.725 INFO:teuthology.orchestra.run.trial080.stdout:trial080.front.sepia.ceph.com
2026-02-23T06:00:29.725 DEBUG:teuthology.orchestra.run.trial080:> grep trial080.front.sepia.ceph.com /etc/hosts
2026-02-23T06:00:29.781 INFO:teuthology.orchestra.run.trial080.stdout:10.20.193.80 trial080.front.sepia.ceph.com trial080
2026-02-23T06:00:29.781 DEBUG:teuthology.orchestra.run.trial080:> sudo hostname trial080
2026-02-23T06:00:29.851 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/trial080.front.sepia.ceph.com/trial080/g' /etc/hosts
2026-02-23T06:00:29.916 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/10.20.193.80/10.20.193.80/g' /etc/hosts
2026-02-23T06:00:29.982 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/trial080.front.sepia.ceph.com/trial080/g' /etc/hostname
2026-02-23T06:00:30.048 DEBUG:teuthology.orchestra.run.trial080:> sudo hostname trial080
2026-02-23T06:00:30.132 DEBUG:teuthology.orchestra.run.trial080:> cat /etc/os-release
2026-02-23T06:00:30.226 INFO:teuthology.orchestra.run.trial080.stdout:NAME="CentOS Stream"
2026-02-23T06:00:30.226 INFO:teuthology.orchestra.run.trial080.stdout:VERSION="9"
2026-02-23T06:00:30.226 INFO:teuthology.orchestra.run.trial080.stdout:ID="centos"
2026-02-23T06:00:30.226 INFO:teuthology.orchestra.run.trial080.stdout:ID_LIKE="rhel fedora"
2026-02-23T06:00:30.226 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_ID="9"
2026-02-23T06:00:30.226 INFO:teuthology.orchestra.run.trial080.stdout:PLATFORM_ID="platform:el9"
2026-02-23T06:00:30.226 INFO:teuthology.orchestra.run.trial080.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T06:00:30.227 INFO:teuthology.orchestra.run.trial080.stdout:ANSI_COLOR="0;31"
2026-02-23T06:00:30.227 INFO:teuthology.orchestra.run.trial080.stdout:LOGO="fedora-logo-icon"
2026-02-23T06:00:30.227 INFO:teuthology.orchestra.run.trial080.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T06:00:30.227 INFO:teuthology.orchestra.run.trial080.stdout:HOME_URL="https://centos.org/"
2026-02-23T06:00:30.227 INFO:teuthology.orchestra.run.trial080.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T06:00:30.227 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T06:00:30.227 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T06:00:30.228 INFO:teuthology.provision.fog.trial080:Deploy complete!
2026-02-23T06:00:30.229 DEBUG:teuthology.parallel:result is None
2026-02-23T06:00:30.333 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T06:00:30.333 DEBUG:teuthology.orchestra.run.trial020:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T06:00:30.439 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T06:00:30.439 DEBUG:teuthology.orchestra.run.trial068:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T06:00:30.506 INFO:teuthology.provision.fog.trial020:Node is ready
2026-02-23T06:00:30.506 DEBUG:teuthology.orchestra.run.trial020:> hostname
2026-02-23T06:00:30.562 INFO:teuthology.orchestra.run.trial020.stdout:trial020.front.sepia.ceph.com
2026-02-23T06:00:30.562 DEBUG:teuthology.orchestra.run.trial020:> grep trial020.front.sepia.ceph.com /etc/hosts
2026-02-23T06:00:30.620 INFO:teuthology.orchestra.run.trial020.stdout:10.20.193.20 trial020.front.sepia.ceph.com trial020
2026-02-23T06:00:30.621 DEBUG:teuthology.orchestra.run.trial020:> sudo hostname trial020
2026-02-23T06:00:30.669 INFO:teuthology.provision.fog.trial068:Node is ready
2026-02-23T06:00:30.669 DEBUG:teuthology.orchestra.run.trial068:> hostname
2026-02-23T06:00:30.694 DEBUG:teuthology.orchestra.run.trial020:> sudo sed -i -e 's/trial020.front.sepia.ceph.com/trial020/g' /etc/hosts
2026-02-23T06:00:30.725 INFO:teuthology.orchestra.run.trial068.stdout:trial068.front.sepia.ceph.com
2026-02-23T06:00:30.726 DEBUG:teuthology.orchestra.run.trial068:> grep trial068.front.sepia.ceph.com /etc/hosts
2026-02-23T06:00:30.759 DEBUG:teuthology.orchestra.run.trial020:> sudo sed -i -e 's/10.20.193.20/10.20.193.20/g' /etc/hosts
2026-02-23T06:00:30.782 INFO:teuthology.orchestra.run.trial068.stdout:10.20.193.68 trial068.front.sepia.ceph.com trial068
2026-02-23T06:00:30.783 DEBUG:teuthology.orchestra.run.trial068:> sudo hostname trial068
2026-02-23T06:00:30.824 DEBUG:teuthology.orchestra.run.trial020:> sudo sed -i -e 's/trial020.front.sepia.ceph.com/trial020/g' /etc/hostname
2026-02-23T06:00:30.890 DEBUG:teuthology.orchestra.run.trial020:> sudo hostname trial020
2026-02-23T06:00:30.912 DEBUG:teuthology.orchestra.run.trial068:> sudo sed -i -e 's/trial068.front.sepia.ceph.com/trial068/g' /etc/hosts
2026-02-23T06:00:30.956 DEBUG:teuthology.orchestra.run.trial020:> cat /etc/os-release
2026-02-23T06:00:30.991 DEBUG:teuthology.orchestra.run.trial068:> sudo sed -i -e 's/10.20.193.68/10.20.193.68/g' /etc/hosts
2026-02-23T06:00:31.013 INFO:teuthology.orchestra.run.trial020.stdout:NAME="CentOS Stream"
2026-02-23T06:00:31.013 INFO:teuthology.orchestra.run.trial020.stdout:VERSION="9"
2026-02-23T06:00:31.013 INFO:teuthology.orchestra.run.trial020.stdout:ID="centos"
2026-02-23T06:00:31.013 INFO:teuthology.orchestra.run.trial020.stdout:ID_LIKE="rhel fedora"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:VERSION_ID="9"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:PLATFORM_ID="platform:el9"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:ANSI_COLOR="0;31"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:LOGO="fedora-logo-icon"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:HOME_URL="https://centos.org/"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T06:00:31.014 INFO:teuthology.orchestra.run.trial020.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T06:00:31.015 INFO:teuthology.provision.fog.trial020:Deploy complete!
2026-02-23T06:00:31.016 DEBUG:teuthology.parallel:result is None
2026-02-23T06:00:31.022 DEBUG:teuthology.orchestra.run.trial068:> sudo sed -i -e 's/trial068.front.sepia.ceph.com/trial068/g' /etc/hostname
2026-02-23T06:00:31.088 DEBUG:teuthology.orchestra.run.trial068:> sudo hostname trial068
2026-02-23T06:00:31.152 DEBUG:teuthology.orchestra.run.trial068:> cat /etc/os-release
2026-02-23T06:00:31.207 INFO:teuthology.orchestra.run.trial068.stdout:NAME="CentOS Stream"
2026-02-23T06:00:31.207 INFO:teuthology.orchestra.run.trial068.stdout:VERSION="9"
2026-02-23T06:00:31.207 INFO:teuthology.orchestra.run.trial068.stdout:ID="centos"
2026-02-23T06:00:31.207 INFO:teuthology.orchestra.run.trial068.stdout:ID_LIKE="rhel fedora"
2026-02-23T06:00:31.207 INFO:teuthology.orchestra.run.trial068.stdout:VERSION_ID="9"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:PLATFORM_ID="platform:el9"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:ANSI_COLOR="0;31"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:LOGO="fedora-logo-icon"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:HOME_URL="https://centos.org/"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T06:00:31.208 INFO:teuthology.orchestra.run.trial068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T06:00:31.209 INFO:teuthology.provision.fog.trial068:Deploy complete!
2026-02-23T06:00:31.210 DEBUG:teuthology.parallel:result is None
2026-02-23T06:00:31.736 INFO:teuthology.lock.ops:Checking trial020.front.sepia.ceph.com
2026-02-23T06:00:31.736 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T06:00:31.807 INFO:teuthology.lock.ops:Checking trial068.front.sepia.ceph.com
2026-02-23T06:00:31.807 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T06:00:31.865 INFO:teuthology.lock.ops:Checking trial080.front.sepia.ceph.com
2026-02-23T06:00:31.865 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T06:00:31.923 INFO:teuthology.lock.ops:Updating [trial020.front.sepia.ceph.com]: set os type and version on server
2026-02-23T06:00:31.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial020.front.sepia.ceph.com'
2026-02-23T06:00:31.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T06:00:31.986 DEBUG:teuthology.orchestra.run.trial020:> true
2026-02-23T06:00:32.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial020.front.sepia.ceph.com'
2026-02-23T06:00:32.060 DEBUG:teuthology.orchestra.run.trial020:> uname -m
2026-02-23T06:00:32.115 INFO:teuthology.orchestra.run.trial020.stdout:x86_64
2026-02-23T06:00:32.115 DEBUG:teuthology.orchestra.run.trial020:> cat /etc/os-release
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:NAME="CentOS Stream"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:VERSION="9"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:ID="centos"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:ID_LIKE="rhel fedora"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:VERSION_ID="9"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:PLATFORM_ID="platform:el9"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:ANSI_COLOR="0;31"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:LOGO="fedora-logo-icon"
2026-02-23T06:00:32.171 INFO:teuthology.orchestra.run.trial020.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T06:00:32.172 INFO:teuthology.orchestra.run.trial020.stdout:HOME_URL="https://centos.org/"
2026-02-23T06:00:32.172 INFO:teuthology.orchestra.run.trial020.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T06:00:32.172 INFO:teuthology.orchestra.run.trial020.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T06:00:32.172 INFO:teuthology.orchestra.run.trial020.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T06:00:32.172 INFO:teuthology.lock.ops:Updating trial020.front.sepia.ceph.com on lock server
2026-02-23T06:00:32.270 INFO:teuthology.lock.ops:Updating [trial068.front.sepia.ceph.com]: set os type and version on server
2026-02-23T06:00:32.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial068.front.sepia.ceph.com'
2026-02-23T06:00:32.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T06:00:32.331 DEBUG:teuthology.orchestra.run.trial068:> true
2026-02-23T06:00:32.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial068.front.sepia.ceph.com'
2026-02-23T06:00:32.406 DEBUG:teuthology.orchestra.run.trial068:> uname -m
2026-02-23T06:00:32.462 INFO:teuthology.orchestra.run.trial068.stdout:x86_64
2026-02-23T06:00:32.462 DEBUG:teuthology.orchestra.run.trial068:> cat /etc/os-release
2026-02-23T06:00:32.519 INFO:teuthology.orchestra.run.trial068.stdout:NAME="CentOS Stream"
2026-02-23T06:00:32.519 INFO:teuthology.orchestra.run.trial068.stdout:VERSION="9"
2026-02-23T06:00:32.519 INFO:teuthology.orchestra.run.trial068.stdout:ID="centos"
2026-02-23T06:00:32.519 INFO:teuthology.orchestra.run.trial068.stdout:ID_LIKE="rhel fedora"
2026-02-23T06:00:32.519 INFO:teuthology.orchestra.run.trial068.stdout:VERSION_ID="9"
2026-02-23T06:00:32.519 INFO:teuthology.orchestra.run.trial068.stdout:PLATFORM_ID="platform:el9"
2026-02-23T06:00:32.519 INFO:teuthology.orchestra.run.trial068.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T06:00:32.520 INFO:teuthology.orchestra.run.trial068.stdout:ANSI_COLOR="0;31"
2026-02-23T06:00:32.520 INFO:teuthology.orchestra.run.trial068.stdout:LOGO="fedora-logo-icon"
2026-02-23T06:00:32.520 INFO:teuthology.orchestra.run.trial068.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T06:00:32.520 INFO:teuthology.orchestra.run.trial068.stdout:HOME_URL="https://centos.org/"
2026-02-23T06:00:32.520 INFO:teuthology.orchestra.run.trial068.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T06:00:32.520 INFO:teuthology.orchestra.run.trial068.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T06:00:32.520 INFO:teuthology.orchestra.run.trial068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T06:00:32.521 INFO:teuthology.lock.ops:Updating trial068.front.sepia.ceph.com on lock server
2026-02-23T06:00:32.626 INFO:teuthology.lock.ops:Updating [trial080.front.sepia.ceph.com]: set os type and version on server
2026-02-23T06:00:32.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com'
2026-02-23T06:00:32.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T06:00:32.688 DEBUG:teuthology.orchestra.run.trial080:> true
2026-02-23T06:00:32.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial080.front.sepia.ceph.com'
2026-02-23T06:00:32.763 DEBUG:teuthology.orchestra.run.trial080:> uname -m
2026-02-23T06:00:32.818 INFO:teuthology.orchestra.run.trial080.stdout:x86_64
2026-02-23T06:00:32.818 DEBUG:teuthology.orchestra.run.trial080:> cat /etc/os-release
2026-02-23T06:00:32.874 INFO:teuthology.orchestra.run.trial080.stdout:NAME="CentOS Stream"
2026-02-23T06:00:32.874 INFO:teuthology.orchestra.run.trial080.stdout:VERSION="9"
2026-02-23T06:00:32.874 INFO:teuthology.orchestra.run.trial080.stdout:ID="centos"
2026-02-23T06:00:32.874 INFO:teuthology.orchestra.run.trial080.stdout:ID_LIKE="rhel fedora"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_ID="9"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:PLATFORM_ID="platform:el9"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:ANSI_COLOR="0;31"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:LOGO="fedora-logo-icon"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:HOME_URL="https://centos.org/"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T06:00:32.875 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T06:00:32.876 INFO:teuthology.lock.ops:Updating trial080.front.sepia.ceph.com on lock server
2026-02-23T06:00:32.971 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:00:33.059 INFO:teuthology.dispatcher.supervisor:Running job 64956
2026-02-23T06:00:33.059 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64956 --name vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64956/orig.config.yaml
2026-02-23T06:00:33.060 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64956
2026-02-23T06:00:33.060 INFO:teuthology.dispatcher.supervisor:Job PID: 2149843
2026-02-23T06:00:33.060 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T06:02:33.092 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:04:33.288 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:06:33.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:08:33.705 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:10:33.931 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:12:34.148 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:14:34.348 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:16:34.531 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:18:34.693 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:20:34.891 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:22:35.075 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:24:35.290 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:26:38.597 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T06:26:38.685 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-23T06:26:38.884 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T06:26:39.622 INFO:teuthology.orchestra.console.trial068:Power off
2026-02-23T06:26:39.622 DEBUG:teuthology.orchestra.console.trial068:pexpect command: ipmitool -H trial068.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T06:26:39.636 INFO:teuthology.orchestra.console.trial020:Power off
2026-02-23T06:26:39.636 DEBUG:teuthology.orchestra.console.trial020:pexpect command: ipmitool -H trial020.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T06:26:39.648 INFO:teuthology.orchestra.console.trial080:Power off
2026-02-23T06:26:39.648 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T06:26:39.665 DEBUG:teuthology.orchestra.console.trial068:power off output: Chassis Power Control: Down/Off
2026-02-23T06:26:39.675 DEBUG:teuthology.orchestra.console.trial020:power off output: Chassis Power Control: Down/Off
2026-02-23T06:26:39.686 DEBUG:teuthology.orchestra.console.trial080:power off output: Chassis Power Control: Down/Off
2026-02-23T06:26:43.670 DEBUG:teuthology.orchestra.console.trial068:pexpect command: ipmitool -H trial068.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T06:26:43.678 DEBUG:teuthology.orchestra.console.trial020:pexpect command: ipmitool -H trial020.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T06:26:43.688 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T06:26:43.781 DEBUG:teuthology.orchestra.console.trial068:check power output: Chassis Power is on
2026-02-23T06:26:43.787 DEBUG:teuthology.orchestra.console.trial020:check power output: Chassis Power is on
2026-02-23T06:26:43.797 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is on
2026-02-23T06:26:47.786 DEBUG:teuthology.orchestra.console.trial068:pexpect command: ipmitool -H trial068.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T06:26:47.795 DEBUG:teuthology.orchestra.console.trial020:pexpect command: ipmitool -H trial020.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T06:26:47.804 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T06:26:47.898 DEBUG:teuthology.orchestra.console.trial068:check power output: Chassis Power is off
2026-02-23T06:26:47.898 INFO:teuthology.orchestra.console.trial068:Power off completed
2026-02-23T06:26:47.906 DEBUG:teuthology.orchestra.console.trial020:check power output: Chassis Power is off
2026-02-23T06:26:47.906 INFO:teuthology.orchestra.console.trial020:Power off completed
2026-02-23T06:26:47.914 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is off
2026-02-23T06:26:47.914 INFO:teuthology.orchestra.console.trial080:Power off completed
2026-02-23T06:26:48.186 INFO:teuthology.lock.ops:unlocked: trial068.front.sepia.ceph.com
2026-02-23T06:26:48.195 INFO:teuthology.lock.ops:unlocked: trial020.front.sepia.ceph.com
2026-02-23T06:26:48.198 INFO:teuthology.lock.ops:unlocked: trial080.front.sepia.ceph.com