2026-02-23T04:57:41.962 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T04:57:41.962 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:57:42.036 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T04:57:42.231 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x762e8ef3f7a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x762e8e789260>, signals=[15])
2026-02-23T04:57:42.231 INFO:teuthology.lock.ops:Start node 'trial026.front.sepia.ceph.com' reimaging
2026-02-23T04:57:42.231 INFO:teuthology.lock.ops:Updating [trial026.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T04:57:42.231 INFO:teuthology.lock.ops:Updating trial026.front.sepia.ceph.com on lock server
2026-02-23T04:57:42.289 INFO:teuthology.lock.ops:Start node 'trial164.front.sepia.ceph.com' reimaging
2026-02-23T04:57:42.289 INFO:teuthology.lock.ops:Updating [trial164.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T04:57:42.289 INFO:teuthology.lock.ops:Updating trial164.front.sepia.ceph.com on lock server
2026-02-23T04:57:42.504 DEBUG:teuthology.provision.fog.trial026:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T04:57:42.514 DEBUG:teuthology.provision.fog.trial164:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T04:57:42.544 INFO:teuthology.provision.fog.trial026:Scheduling deploy of centos 9.stream
2026-02-23T04:57:42.565 INFO:teuthology.provision.fog.trial164:Scheduling deploy of centos 9.stream
2026-02-23T04:57:44.107 INFO:teuthology.orchestra.console.trial026:Power off
2026-02-23T04:57:44.107 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T04:57:44.117 INFO:teuthology.orchestra.console.trial164:Power off
2026-02-23T04:57:44.117 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T04:57:44.145 DEBUG:teuthology.orchestra.console.trial026:power off output: Chassis Power Control: Down/Off
2026-02-23T04:57:44.154 DEBUG:teuthology.orchestra.console.trial164:power off output: Chassis Power Control: Down/Off
2026-02-23T04:57:48.150 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:57:48.158 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:57:48.260 DEBUG:teuthology.orchestra.console.trial026:check power output: Chassis Power is off
2026-02-23T04:57:48.260 INFO:teuthology.orchestra.console.trial026:Power off completed
2026-02-23T04:57:48.267 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is off
2026-02-23T04:57:48.267 INFO:teuthology.orchestra.console.trial164:Power off completed
2026-02-23T04:57:48.361 INFO:teuthology.orchestra.console.trial026:Power on
2026-02-23T04:57:48.362 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T04:57:48.370 INFO:teuthology.orchestra.console.trial164:Power on
2026-02-23T04:57:48.370 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T04:57:48.401 DEBUG:teuthology.orchestra.console.trial026:power on output: Chassis Power Control: Up/On
2026-02-23T04:57:48.410 DEBUG:teuthology.orchestra.console.trial164:power on output: Chassis Power Control: Up/On
2026-02-23T04:57:52.406 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:57:52.413 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:57:52.515 DEBUG:teuthology.orchestra.console.trial026:check power output: Chassis Power is on
2026-02-23T04:57:52.515 INFO:teuthology.orchestra.console.trial026:Power on completed
2026-02-23T04:57:52.521 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is off
2026-02-23T04:57:52.616 INFO:teuthology.provision.fog.trial026:Waiting for deploy to finish
2026-02-23T04:57:56.525 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T04:57:56.635 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is on
2026-02-23T04:57:56.636 INFO:teuthology.orchestra.console.trial164:Power on completed
2026-02-23T04:57:56.736 INFO:teuthology.provision.fog.trial164:Waiting for deploy to finish
2026-02-23T04:59:40.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:59:40.242 ERROR:teuthology.orchestra.connection:Error authenticating with trial026.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-23T04:59:44.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:59:47.264 WARNING:teuthology.provision.fog.trial164:[Errno None] Unable to connect to port 22 on 10.20.193.164
2026-02-23T04:59:53.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T04:59:56.351 WARNING:teuthology.provision.fog.trial164:[Errno None] Unable to connect to port 22 on 10.20.193.164
2026-02-23T05:00:02.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:00:05.440 WARNING:teuthology.provision.fog.trial164:[Errno None] Unable to connect to port 22 on 10.20.193.164
2026-02-23T05:00:11.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:00:14.528 WARNING:teuthology.provision.fog.trial164:[Errno None] Unable to connect to port 22 on 10.20.193.164
2026-02-23T05:00:20.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:00:23.616 WARNING:teuthology.provision.fog.trial164:[Errno None] Unable to connect to port 22 on 10.20.193.164
2026-02-23T05:00:29.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:00:44.243 WARNING:teuthology.provision.fog.trial026:timed out
2026-02-23T05:00:50.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:00:57.567 ERROR:teuthology.orchestra.connection:Error authenticating with trial026.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T05:01:01.681 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T05:01:01.681 DEBUG:teuthology.orchestra.run.trial026:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T05:01:05.401 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T05:01:05.402 DEBUG:teuthology.orchestra.run.trial164:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T05:01:05.748 INFO:teuthology.provision.fog.trial164:Node is ready
2026-02-23T05:01:05.748 DEBUG:teuthology.orchestra.run.trial164:> hostname
2026-02-23T05:01:05.805 INFO:teuthology.orchestra.run.trial164.stdout:trial164.front.sepia.ceph.com
2026-02-23T05:01:05.805 DEBUG:teuthology.orchestra.run.trial164:> grep trial164.front.sepia.ceph.com /etc/hosts
2026-02-23T05:01:05.862 INFO:teuthology.orchestra.run.trial164.stdout:10.20.193.164 trial164.front.sepia.ceph.com trial164
2026-02-23T05:01:05.862 DEBUG:teuthology.orchestra.run.trial164:> sudo hostname trial164
2026-02-23T05:01:05.934 DEBUG:teuthology.orchestra.run.trial164:> sudo sed -i -e 's/trial164.front.sepia.ceph.com/trial164/g' /etc/hosts
2026-02-23T05:01:06.000 DEBUG:teuthology.orchestra.run.trial164:> sudo sed -i -e 's/10.20.193.164/10.20.193.164/g' /etc/hosts
2026-02-23T05:01:06.067 DEBUG:teuthology.orchestra.run.trial164:> sudo sed -i -e 's/trial164.front.sepia.ceph.com/trial164/g' /etc/hostname
2026-02-23T05:01:06.132 DEBUG:teuthology.orchestra.run.trial164:> sudo hostname trial164
2026-02-23T05:01:06.198 DEBUG:teuthology.orchestra.run.trial164:> cat /etc/os-release
2026-02-23T05:01:06.255 INFO:teuthology.orchestra.run.trial164.stdout:NAME="CentOS Stream"
2026-02-23T05:01:06.255 INFO:teuthology.orchestra.run.trial164.stdout:VERSION="9"
2026-02-23T05:01:06.255 INFO:teuthology.orchestra.run.trial164.stdout:ID="centos"
2026-02-23T05:01:06.255 INFO:teuthology.orchestra.run.trial164.stdout:ID_LIKE="rhel fedora"
2026-02-23T05:01:06.255 INFO:teuthology.orchestra.run.trial164.stdout:VERSION_ID="9"
2026-02-23T05:01:06.255 INFO:teuthology.orchestra.run.trial164.stdout:PLATFORM_ID="platform:el9"
2026-02-23T05:01:06.255 INFO:teuthology.orchestra.run.trial164.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T05:01:06.256 INFO:teuthology.orchestra.run.trial164.stdout:ANSI_COLOR="0;31"
2026-02-23T05:01:06.256 INFO:teuthology.orchestra.run.trial164.stdout:LOGO="fedora-logo-icon"
2026-02-23T05:01:06.256 INFO:teuthology.orchestra.run.trial164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T05:01:06.256 INFO:teuthology.orchestra.run.trial164.stdout:HOME_URL="https://centos.org/"
2026-02-23T05:01:06.256 INFO:teuthology.orchestra.run.trial164.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T05:01:06.256 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T05:01:06.256 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T05:01:06.257 INFO:teuthology.provision.fog.trial164:Deploy complete!
2026-02-23T05:01:06.259 DEBUG:teuthology.parallel:result is None
2026-02-23T05:01:06.881 INFO:teuthology.provision.fog.trial026:Node is ready
2026-02-23T05:01:06.882 DEBUG:teuthology.orchestra.run.trial026:> hostname
2026-02-23T05:01:06.902 INFO:teuthology.orchestra.run.trial026.stdout:trial026.front.sepia.ceph.com
2026-02-23T05:01:06.903 DEBUG:teuthology.orchestra.run.trial026:> grep trial026.front.sepia.ceph.com /etc/hosts
2026-02-23T05:01:06.961 INFO:teuthology.orchestra.run.trial026.stdout:10.20.193.26 trial026.front.sepia.ceph.com trial026
2026-02-23T05:01:06.961 DEBUG:teuthology.orchestra.run.trial026:> sudo hostname trial026
2026-02-23T05:01:07.031 DEBUG:teuthology.orchestra.run.trial026:> sudo sed -i -e 's/trial026.front.sepia.ceph.com/trial026/g' /etc/hosts
2026-02-23T05:01:07.096 DEBUG:teuthology.orchestra.run.trial026:> sudo sed -i -e 's/10.20.193.26/10.20.193.26/g' /etc/hosts
2026-02-23T05:01:07.161 DEBUG:teuthology.orchestra.run.trial026:> sudo sed -i -e 's/trial026.front.sepia.ceph.com/trial026/g' /etc/hostname
2026-02-23T05:01:07.225 DEBUG:teuthology.orchestra.run.trial026:> sudo hostname trial026
2026-02-23T05:01:07.288 DEBUG:teuthology.orchestra.run.trial026:> cat /etc/os-release
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:NAME="CentOS Stream"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:VERSION="9"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:ID="centos"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:ID_LIKE="rhel fedora"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:VERSION_ID="9"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:PLATFORM_ID="platform:el9"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:ANSI_COLOR="0;31"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:LOGO="fedora-logo-icon"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T05:01:07.345 INFO:teuthology.orchestra.run.trial026.stdout:HOME_URL="https://centos.org/"
2026-02-23T05:01:07.346 INFO:teuthology.orchestra.run.trial026.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T05:01:07.346 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T05:01:07.346 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T05:01:07.346 INFO:teuthology.provision.fog.trial026:Deploy complete!
2026-02-23T05:01:07.347 DEBUG:teuthology.parallel:result is None
2026-02-23T05:01:07.733 INFO:teuthology.lock.ops:Checking trial026.front.sepia.ceph.com
2026-02-23T05:01:07.733 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T05:01:07.822 INFO:teuthology.lock.ops:Checking trial164.front.sepia.ceph.com
2026-02-23T05:01:07.823 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T05:01:07.884 INFO:teuthology.lock.ops:Updating [trial026.front.sepia.ceph.com]: set os type and version on server
2026-02-23T05:01:07.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com'
2026-02-23T05:01:07.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:01:07.947 DEBUG:teuthology.orchestra.run.trial026:> true
2026-02-23T05:01:08.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com'
2026-02-23T05:01:08.020 DEBUG:teuthology.orchestra.run.trial026:> uname -m
2026-02-23T05:01:08.075 INFO:teuthology.orchestra.run.trial026.stdout:x86_64
2026-02-23T05:01:08.075 DEBUG:teuthology.orchestra.run.trial026:> cat /etc/os-release
2026-02-23T05:01:08.131 INFO:teuthology.orchestra.run.trial026.stdout:NAME="CentOS Stream"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:VERSION="9"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:ID="centos"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:ID_LIKE="rhel fedora"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:VERSION_ID="9"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:PLATFORM_ID="platform:el9"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:ANSI_COLOR="0;31"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:LOGO="fedora-logo-icon"
2026-02-23T05:01:08.132 INFO:teuthology.orchestra.run.trial026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T05:01:08.133 INFO:teuthology.orchestra.run.trial026.stdout:HOME_URL="https://centos.org/"
2026-02-23T05:01:08.133 INFO:teuthology.orchestra.run.trial026.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T05:01:08.133 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T05:01:08.133 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T05:01:08.134 INFO:teuthology.lock.ops:Updating trial026.front.sepia.ceph.com on lock server
2026-02-23T05:01:08.239 INFO:teuthology.lock.ops:Updating [trial164.front.sepia.ceph.com]: set os type and version on server
2026-02-23T05:01:08.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com'
2026-02-23T05:01:08.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T05:01:08.309 DEBUG:teuthology.orchestra.run.trial164:> true
2026-02-23T05:01:08.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com'
2026-02-23T05:01:08.392 DEBUG:teuthology.orchestra.run.trial164:> uname -m
2026-02-23T05:01:08.448 INFO:teuthology.orchestra.run.trial164.stdout:x86_64
2026-02-23T05:01:08.449 DEBUG:teuthology.orchestra.run.trial164:> cat /etc/os-release
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:NAME="CentOS Stream"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:VERSION="9"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:ID="centos"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:ID_LIKE="rhel fedora"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:VERSION_ID="9"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:PLATFORM_ID="platform:el9"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:ANSI_COLOR="0;31"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:LOGO="fedora-logo-icon"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:HOME_URL="https://centos.org/"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T05:01:08.504 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T05:01:08.505 INFO:teuthology.lock.ops:Updating trial164.front.sepia.ceph.com on lock server
2026-02-23T05:01:08.571 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:01:08.663 INFO:teuthology.dispatcher.supervisor:Running job 64873
2026-02-23T05:01:08.663 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64873 --name vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/exports 2-workunit/fs/snaps}} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64873/orig.config.yaml
2026-02-23T05:01:08.664 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-23_04:04:18-fs-wip-vshankar-testing-20260222.101816-testing-default-trial/64873
2026-02-23T05:01:08.664 INFO:teuthology.dispatcher.supervisor:Job PID: 1775408
2026-02-23T05:01:08.664 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T05:03:08.664 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:05:08.753 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:07:08.881 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:09:09.005 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:11:09.113 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:13:09.401 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:15:09.476 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:17:09.571 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:19:09.652 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:21:09.777 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:23:09.865 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:25:09.990 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:27:10.109 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:29:10.215 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:31:10.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:33:10.460 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:35:10.661 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:37:10.781 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:39:10.905 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:41:11.026 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:43:11.146 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:45:11.224 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:47:11.342 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:49:11.462 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T05:49:11.545 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-23T05:49:11.661 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T05:49:12.188 INFO:teuthology.orchestra.console.trial164:Power off
2026-02-23T05:49:12.188 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T05:49:12.200 INFO:teuthology.orchestra.console.trial026:Power off
2026-02-23T05:49:12.200 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T05:49:12.227 DEBUG:teuthology.orchestra.console.trial164:power off output: Chassis Power Control: Down/Off
2026-02-23T05:49:12.237 DEBUG:teuthology.orchestra.console.trial026:power off output: Chassis Power Control: Down/Off
2026-02-23T05:49:16.227 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:49:16.238 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:49:16.339 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is on
2026-02-23T05:49:16.349 DEBUG:teuthology.orchestra.console.trial026:check power output: Chassis Power is on
2026-02-23T05:49:20.339 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:49:20.349 DEBUG:teuthology.orchestra.console.trial026:pexpect command: ipmitool -H trial026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T05:49:20.448 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is off
2026-02-23T05:49:20.448 INFO:teuthology.orchestra.console.trial164:Power off completed
2026-02-23T05:49:20.457 DEBUG:teuthology.orchestra.console.trial026:check power output: Chassis Power is off
2026-02-23T05:49:20.457 INFO:teuthology.orchestra.console.trial026:Power off completed
2026-02-23T05:49:20.652 INFO:teuthology.lock.ops:unlocked: trial164.front.sepia.ceph.com
2026-02-23T05:49:20.664 INFO:teuthology.lock.ops:unlocked: trial026.front.sepia.ceph.com