2026-02-14T01:14:55.927 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-14T01:14:55.927 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:14:56.001 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:14:56.278 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x743d5ef07200>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x743d5eeae700>, signals=[15])
2026-02-14T01:14:56.278 INFO:teuthology.lock.ops:Start node 'trial096.front.sepia.ceph.com' reimaging
2026-02-14T01:14:56.278 INFO:teuthology.lock.ops:Updating [trial096.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:14:56.278 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server
2026-02-14T01:14:56.337 INFO:teuthology.lock.ops:Start node 'trial122.front.sepia.ceph.com' reimaging
2026-02-14T01:14:56.337 INFO:teuthology.lock.ops:Updating [trial122.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:14:56.337 INFO:teuthology.lock.ops:Updating trial122.front.sepia.ceph.com on lock server
2026-02-14T01:14:56.398 INFO:teuthology.lock.ops:Start node 'trial164.front.sepia.ceph.com' reimaging
2026-02-14T01:14:56.398 INFO:teuthology.lock.ops:Updating [trial164.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:14:56.398 INFO:teuthology.lock.ops:Updating trial164.front.sepia.ceph.com on lock server
2026-02-14T01:14:56.643 DEBUG:teuthology.provision.fog.trial122:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:14:56.644 DEBUG:teuthology.provision.fog.trial096:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:14:56.674 INFO:teuthology.provision.fog.trial122:Scheduling deploy of centos 9.stream
2026-02-14T01:14:56.697 INFO:teuthology.provision.fog.trial096:Scheduling deploy of centos 9.stream
2026-02-14T01:14:56.700 DEBUG:teuthology.provision.fog.trial164:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:14:56.748 INFO:teuthology.provision.fog.trial164:Scheduling deploy of centos 9.stream
2026-02-14T01:14:58.085 INFO:teuthology.orchestra.console.trial122:Power off
2026-02-14T01:14:58.086 DEBUG:teuthology.orchestra.console.trial122:pexpect command: ipmitool -H trial122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:14:58.097 INFO:teuthology.orchestra.console.trial164:Power off
2026-02-14T01:14:58.097 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:14:58.105 INFO:teuthology.orchestra.console.trial096:Power off
2026-02-14T01:14:58.105 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:14:58.152 DEBUG:teuthology.orchestra.console.trial122:power off output: Chassis Power Control: Down/Off
2026-02-14T01:14:58.180 DEBUG:teuthology.orchestra.console.trial096:power off output: Chassis Power Control: Down/Off
2026-02-14T01:14:58.191 DEBUG:teuthology.orchestra.console.trial164:power off output: Chassis Power Control: Down/Off
2026-02-14T01:15:02.156 DEBUG:teuthology.orchestra.console.trial122:pexpect command: ipmitool -H trial122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:15:02.181 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:15:02.193 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:15:02.265 DEBUG:teuthology.orchestra.console.trial122:check power output: Chassis Power is off
2026-02-14T01:15:02.265 INFO:teuthology.orchestra.console.trial122:Power off completed
2026-02-14T01:15:02.290 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off
2026-02-14T01:15:02.291 INFO:teuthology.orchestra.console.trial096:Power off completed
2026-02-14T01:15:02.301 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is off
2026-02-14T01:15:02.302 INFO:teuthology.orchestra.console.trial164:Power off completed
2026-02-14T01:15:02.366 INFO:teuthology.orchestra.console.trial122:Power on
2026-02-14T01:15:02.367 DEBUG:teuthology.orchestra.console.trial122:pexpect command: ipmitool -H trial122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:15:02.392 INFO:teuthology.orchestra.console.trial096:Power on
2026-02-14T01:15:02.393 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:15:02.402 INFO:teuthology.orchestra.console.trial164:Power on
2026-02-14T01:15:02.403 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:15:02.412 DEBUG:teuthology.orchestra.console.trial122:power on output: Chassis Power Control: Up/On
2026-02-14T01:15:02.431 DEBUG:teuthology.orchestra.console.trial096:power on output: Chassis Power Control: Up/On
2026-02-14T01:15:02.443 DEBUG:teuthology.orchestra.console.trial164:power on output: Chassis Power Control: Up/On
2026-02-14T01:15:06.417 DEBUG:teuthology.orchestra.console.trial122:pexpect command: ipmitool -H trial122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:15:06.432 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:15:06.443 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:15:06.527 DEBUG:teuthology.orchestra.console.trial122:check power output: Chassis Power is on
2026-02-14T01:15:06.527 INFO:teuthology.orchestra.console.trial122:Power on completed
2026-02-14T01:15:06.542 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is on
2026-02-14T01:15:06.542 INFO:teuthology.orchestra.console.trial096:Power on completed
2026-02-14T01:15:06.553 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is on
2026-02-14T01:15:06.553 INFO:teuthology.orchestra.console.trial164:Power on completed
2026-02-14T01:15:06.629 INFO:teuthology.provision.fog.trial122:Waiting for deploy to finish
2026-02-14T01:15:06.643 INFO:teuthology.provision.fog.trial096:Waiting for deploy to finish
2026-02-14T01:15:06.654 INFO:teuthology.provision.fog.trial164:Waiting for deploy to finish
2026-02-14T01:16:54.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:16:54.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:16:54.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:16:54.409 ERROR:teuthology.orchestra.connection:Error authenticating with trial164.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-14T01:16:57.373 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96
2026-02-14T01:16:57.373 WARNING:teuthology.provision.fog.trial122:[Errno None] Unable to connect to port 22 on 10.20.193.122
2026-02-14T01:17:03.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:03.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:06.461 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96
2026-02-14T01:17:06.461 WARNING:teuthology.provision.fog.trial122:[Errno None] Unable to connect to port 22 on 10.20.193.122
2026-02-14T01:17:12.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:12.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:15.549 WARNING:teuthology.provision.fog.trial122:[Errno None] Unable to connect to port 22 on 10.20.193.122
2026-02-14T01:17:15.549 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96
2026-02-14T01:17:21.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:21.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:24.637 WARNING:teuthology.provision.fog.trial122:[Errno None] Unable to connect to port 22 on 10.20.193.122
2026-02-14T01:17:24.637 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96
2026-02-14T01:17:30.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:30.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:33.725 WARNING:teuthology.provision.fog.trial122:[Errno None] Unable to connect to port 22 on 10.20.193.122
2026-02-14T01:17:33.725 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96
2026-02-14T01:17:39.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:39.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:17:58.411 WARNING:teuthology.provision.fog.trial164:timed out
2026-02-14T01:18:04.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:18:09.698 ERROR:teuthology.orchestra.connection:Error authenticating with trial164.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T01:18:13.811 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:18:13.811 DEBUG:teuthology.orchestra.run.trial164:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:18:15.828 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:18:15.829 DEBUG:teuthology.orchestra.run.trial096:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:18:15.848 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:18:15.848 DEBUG:teuthology.orchestra.run.trial122:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:18:15.954 INFO:teuthology.provision.fog.trial096:Node is ready
2026-02-14T01:18:15.954 DEBUG:teuthology.orchestra.run.trial096:> hostname
2026-02-14T01:18:16.009 INFO:teuthology.orchestra.run.trial096.stdout:trial096.front.sepia.ceph.com
2026-02-14T01:18:16.009 DEBUG:teuthology.orchestra.run.trial096:> grep trial096.front.sepia.ceph.com /etc/hosts
2026-02-14T01:18:16.063 INFO:teuthology.orchestra.run.trial096.stdout:10.20.193.96 trial096.front.sepia.ceph.com trial096
2026-02-14T01:18:16.063 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname trial096
2026-02-14T01:18:16.086 INFO:teuthology.provision.fog.trial122:Node is ready
2026-02-14T01:18:16.086 DEBUG:teuthology.orchestra.run.trial122:> hostname
2026-02-14T01:18:16.140 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/trial096.front.sepia.ceph.com/trial096/g' /etc/hosts
2026-02-14T01:18:16.143 INFO:teuthology.orchestra.run.trial122.stdout:trial122.front.sepia.ceph.com
2026-02-14T01:18:16.143 DEBUG:teuthology.orchestra.run.trial122:> grep trial122.front.sepia.ceph.com /etc/hosts
2026-02-14T01:18:16.199 INFO:teuthology.orchestra.run.trial122.stdout:10.20.193.122 trial122.front.sepia.ceph.com trial122
2026-02-14T01:18:16.200 DEBUG:teuthology.orchestra.run.trial122:> sudo hostname trial122
2026-02-14T01:18:16.204 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/10.20.193.96/10.20.193.96/g' /etc/hosts
2026-02-14T01:18:16.268 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/trial096.front.sepia.ceph.com/trial096/g' /etc/hostname
2026-02-14T01:18:16.269 DEBUG:teuthology.orchestra.run.trial122:> sudo sed -i -e 's/trial122.front.sepia.ceph.com/trial122/g' /etc/hosts
2026-02-14T01:18:16.333 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname trial096
2026-02-14T01:18:16.335 DEBUG:teuthology.orchestra.run.trial122:> sudo sed -i -e 's/10.20.193.122/10.20.193.122/g' /etc/hosts
2026-02-14T01:18:16.397 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release
2026-02-14T01:18:16.397 DEBUG:teuthology.orchestra.run.trial122:> sudo sed -i -e 's/trial122.front.sepia.ceph.com/trial122/g' /etc/hostname
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:18:16.453 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:18:16.453 INFO:teuthology.provision.fog.trial096:Deploy complete!
2026-02-14T01:18:16.454 DEBUG:teuthology.parallel:result is None
2026-02-14T01:18:16.461 DEBUG:teuthology.orchestra.run.trial122:> sudo hostname trial122
2026-02-14T01:18:16.526 DEBUG:teuthology.orchestra.run.trial122:> cat /etc/os-release
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:NAME="CentOS Stream"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:VERSION="9"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:ID="centos"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:VERSION_ID="9"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:ANSI_COLOR="0;31"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:18:16.580 INFO:teuthology.orchestra.run.trial122.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:18:16.581 INFO:teuthology.orchestra.run.trial122.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:18:16.581 INFO:teuthology.orchestra.run.trial122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:18:16.581 INFO:teuthology.orchestra.run.trial122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:18:16.581 INFO:teuthology.provision.fog.trial122:Deploy complete!
2026-02-14T01:18:16.581 DEBUG:teuthology.parallel:result is None
2026-02-14T01:18:18.852 INFO:teuthology.provision.fog.trial164:Node is ready
2026-02-14T01:18:18.852 DEBUG:teuthology.orchestra.run.trial164:> hostname
2026-02-14T01:18:18.870 INFO:teuthology.orchestra.run.trial164.stdout:trial164.front.sepia.ceph.com
2026-02-14T01:18:18.871 DEBUG:teuthology.orchestra.run.trial164:> grep trial164.front.sepia.ceph.com /etc/hosts
2026-02-14T01:18:18.928 INFO:teuthology.orchestra.run.trial164.stdout:10.20.193.164 trial164.front.sepia.ceph.com trial164
2026-02-14T01:18:18.929 DEBUG:teuthology.orchestra.run.trial164:> sudo hostname trial164
2026-02-14T01:18:19.001 DEBUG:teuthology.orchestra.run.trial164:> sudo sed -i -e 's/trial164.front.sepia.ceph.com/trial164/g' /etc/hosts
2026-02-14T01:18:19.066 DEBUG:teuthology.orchestra.run.trial164:> sudo sed -i -e 's/10.20.193.164/10.20.193.164/g' /etc/hosts
2026-02-14T01:18:19.132 DEBUG:teuthology.orchestra.run.trial164:> sudo sed -i -e 's/trial164.front.sepia.ceph.com/trial164/g' /etc/hostname
2026-02-14T01:18:19.197 DEBUG:teuthology.orchestra.run.trial164:> sudo hostname trial164
2026-02-14T01:18:19.262 DEBUG:teuthology.orchestra.run.trial164:> cat /etc/os-release
2026-02-14T01:18:19.319 INFO:teuthology.orchestra.run.trial164.stdout:NAME="CentOS Stream"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:VERSION="9"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:ID="centos"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:VERSION_ID="9"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:ANSI_COLOR="0;31"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:18:19.320 INFO:teuthology.orchestra.run.trial164.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:18:19.321 INFO:teuthology.orchestra.run.trial164.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:18:19.321 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:18:19.321 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:18:19.321 INFO:teuthology.provision.fog.trial164:Deploy complete!
2026-02-14T01:18:19.322 DEBUG:teuthology.parallel:result is None
2026-02-14T01:18:19.842 INFO:teuthology.lock.ops:Checking trial096.front.sepia.ceph.com
2026-02-14T01:18:19.843 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:18:19.963 INFO:teuthology.lock.ops:Checking trial122.front.sepia.ceph.com
2026-02-14T01:18:19.964 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:18:20.022 INFO:teuthology.lock.ops:Checking trial164.front.sepia.ceph.com
2026-02-14T01:18:20.022 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:18:20.079 INFO:teuthology.lock.ops:Updating [trial096.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:18:20.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial096.front.sepia.ceph.com'
2026-02-14T01:18:20.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:18:20.140 DEBUG:teuthology.orchestra.run.trial096:> true
2026-02-14T01:18:20.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial096.front.sepia.ceph.com'
2026-02-14T01:18:20.217 DEBUG:teuthology.orchestra.run.trial096:> uname -m
2026-02-14T01:18:20.273 INFO:teuthology.orchestra.run.trial096.stdout:x86_64
2026-02-14T01:18:20.273 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release
2026-02-14T01:18:20.329 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream"
2026-02-14T01:18:20.329 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9"
2026-02-14T01:18:20.329 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:18:20.330 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:18:20.331 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server
2026-02-14T01:18:20.426 INFO:teuthology.lock.ops:Updating [trial122.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:18:20.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial122.front.sepia.ceph.com'
2026-02-14T01:18:20.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:18:20.491 DEBUG:teuthology.orchestra.run.trial122:> true
2026-02-14T01:18:20.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial122.front.sepia.ceph.com'
2026-02-14T01:18:20.573 DEBUG:teuthology.orchestra.run.trial122:> uname -m
2026-02-14T01:18:20.629 INFO:teuthology.orchestra.run.trial122.stdout:x86_64
2026-02-14T01:18:20.629 DEBUG:teuthology.orchestra.run.trial122:> cat /etc/os-release
2026-02-14T01:18:20.685 INFO:teuthology.orchestra.run.trial122.stdout:NAME="CentOS Stream"
2026-02-14T01:18:20.685 INFO:teuthology.orchestra.run.trial122.stdout:VERSION="9"
2026-02-14T01:18:20.685 INFO:teuthology.orchestra.run.trial122.stdout:ID="centos"
2026-02-14T01:18:20.685 INFO:teuthology.orchestra.run.trial122.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:18:20.685 INFO:teuthology.orchestra.run.trial122.stdout:VERSION_ID="9"
2026-02-14T01:18:20.685 INFO:teuthology.orchestra.run.trial122.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:18:20.685 INFO:teuthology.orchestra.run.trial122.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:18:20.685 INFO:teuthology.orchestra.run.trial122.stdout:ANSI_COLOR="0;31"
2026-02-14T01:18:20.686 INFO:teuthology.orchestra.run.trial122.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:18:20.686 INFO:teuthology.orchestra.run.trial122.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:18:20.686 INFO:teuthology.orchestra.run.trial122.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:18:20.686 INFO:teuthology.orchestra.run.trial122.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:18:20.686 INFO:teuthology.orchestra.run.trial122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:18:20.686 INFO:teuthology.orchestra.run.trial122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:18:20.687 INFO:teuthology.lock.ops:Updating trial122.front.sepia.ceph.com on lock server
2026-02-14T01:18:20.790 INFO:teuthology.lock.ops:Updating [trial164.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:18:20.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial164.front.sepia.ceph.com'
2026-02-14T01:18:20.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:18:20.862 DEBUG:teuthology.orchestra.run.trial164:> true
2026-02-14T01:18:20.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial164.front.sepia.ceph.com'
2026-02-14T01:18:20.938 DEBUG:teuthology.orchestra.run.trial164:> uname -m
2026-02-14T01:18:20.994 INFO:teuthology.orchestra.run.trial164.stdout:x86_64
2026-02-14T01:18:20.994 DEBUG:teuthology.orchestra.run.trial164:> cat /etc/os-release
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:NAME="CentOS Stream"
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:VERSION="9"
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:ID="centos"
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:VERSION_ID="9"
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:ANSI_COLOR="0;31"
2026-02-14T01:18:21.050 INFO:teuthology.orchestra.run.trial164.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:18:21.051 INFO:teuthology.orchestra.run.trial164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:18:21.051 INFO:teuthology.orchestra.run.trial164.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:18:21.051 INFO:teuthology.orchestra.run.trial164.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:18:21.051 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:18:21.051 INFO:teuthology.orchestra.run.trial164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:18:21.052 INFO:teuthology.lock.ops:Updating trial164.front.sepia.ceph.com on lock server
2026-02-14T01:18:21.156 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:18:21.252 INFO:teuthology.dispatcher.supervisor:Running job 50542
2026-02-14T01:18:21.252 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50542 --name jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50542/orig.config.yaml
2026-02-14T01:18:21.252 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50542
2026-02-14T01:18:21.252 INFO:teuthology.dispatcher.supervisor:Job PID: 1494874
2026-02-14T01:18:21.252 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-14T01:20:21.253 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:22:21.374 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:24:21.495 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:26:21.614 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:28:21.738 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:30:21.859 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:32:21.983 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:34:22.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:36:22.178 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:38:22.291 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:40:22.390 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:42:22.519 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:44:22.593 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:46:22.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:48:22.762 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:50:22.861 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:52:22.980 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:54:23.059 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:56:23.171 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:58:23.295 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:00:23.418 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:02:23.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:04:23.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:06:23.790 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:08:25.502 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:08:25.619 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-14T02:08:25.797 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-14T02:08:26.536 INFO:teuthology.orchestra.console.trial122:Power off
2026-02-14T02:08:26.536 DEBUG:teuthology.orchestra.console.trial122:pexpect command: ipmitool -H trial122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:08:26.545 INFO:teuthology.orchestra.console.trial164:Power off
2026-02-14T02:08:26.545 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:08:26.567 INFO:teuthology.orchestra.console.trial096:Power off
2026-02-14T02:08:26.567 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:08:26.577 DEBUG:teuthology.orchestra.console.trial122:power off output: Chassis Power Control: Down/Off
2026-02-14T02:08:26.586 DEBUG:teuthology.orchestra.console.trial164:power off output: Chassis Power Control: Down/Off
2026-02-14T02:08:26.606 DEBUG:teuthology.orchestra.console.trial096:power off output: Chassis Power Control: Down/Off
2026-02-14T02:08:30.578 DEBUG:teuthology.orchestra.console.trial122:pexpect command: ipmitool -H trial122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:08:30.587 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:08:30.607 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:08:30.688 DEBUG:teuthology.orchestra.console.trial122:check power output: Chassis Power is on
2026-02-14T02:08:30.696 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is on
2026-02-14T02:08:30.714 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is on
2026-02-14T02:08:34.689 DEBUG:teuthology.orchestra.console.trial122:pexpect command: ipmitool -H trial122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:08:34.696 DEBUG:teuthology.orchestra.console.trial164:pexpect command: ipmitool -H trial164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:08:34.715 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:08:34.798 DEBUG:teuthology.orchestra.console.trial122:check power output: Chassis Power is off
2026-02-14T02:08:34.798 INFO:teuthology.orchestra.console.trial122:Power off completed
2026-02-14T02:08:34.805 DEBUG:teuthology.orchestra.console.trial164:check power output: Chassis Power is off
2026-02-14T02:08:34.805 INFO:teuthology.orchestra.console.trial164:Power off completed
2026-02-14T02:08:34.824 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off
2026-02-14T02:08:34.824 INFO:teuthology.orchestra.console.trial096:Power off completed
2026-02-14T02:08:35.089 INFO:teuthology.lock.ops:unlocked: trial122.front.sepia.ceph.com
2026-02-14T02:08:35.099 INFO:teuthology.lock.ops:unlocked: trial164.front.sepia.ceph.com
2026-02-14T02:08:35.103 INFO:teuthology.lock.ops:unlocked: trial096.front.sepia.ceph.com