2026-02-17T20:27:19.669 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T20:27:19.669 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:27:19.743 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:27:19.998 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7473231203b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x747323075c60>, signals=[15])
2026-02-17T20:27:19.998 INFO:teuthology.lock.ops:Start node 'trial027.front.sepia.ceph.com' reimaging
2026-02-17T20:27:19.998 INFO:teuthology.lock.ops:Updating [trial027.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T20:27:19.998 INFO:teuthology.lock.ops:Updating trial027.front.sepia.ceph.com on lock server
2026-02-17T20:27:20.057 INFO:teuthology.lock.ops:Start node 'trial099.front.sepia.ceph.com' reimaging
2026-02-17T20:27:20.057 INFO:teuthology.lock.ops:Updating [trial099.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T20:27:20.057 INFO:teuthology.lock.ops:Updating trial099.front.sepia.ceph.com on lock server
2026-02-17T20:27:20.115 INFO:teuthology.lock.ops:Start node 'trial125.front.sepia.ceph.com' reimaging
2026-02-17T20:27:20.115 INFO:teuthology.lock.ops:Updating [trial125.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T20:27:20.115 INFO:teuthology.lock.ops:Updating trial125.front.sepia.ceph.com on lock server
2026-02-17T20:27:20.352 DEBUG:teuthology.provision.fog.trial027:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T20:27:20.353 DEBUG:teuthology.provision.fog.trial099:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T20:27:20.406 INFO:teuthology.provision.fog.trial099:Scheduling deploy of centos 9.stream
2026-02-17T20:27:20.422 INFO:teuthology.provision.fog.trial027:Scheduling deploy of centos 9.stream
2026-02-17T20:27:20.426 DEBUG:teuthology.provision.fog.trial125:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T20:27:20.476 INFO:teuthology.provision.fog.trial125:Scheduling deploy of centos 9.stream
2026-02-17T20:27:21.718 INFO:teuthology.orchestra.console.trial027:Power off
2026-02-17T20:27:21.718 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T20:27:21.730 INFO:teuthology.orchestra.console.trial125:Power off
2026-02-17T20:27:21.731 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T20:27:21.738 INFO:teuthology.orchestra.console.trial099:Power off
2026-02-17T20:27:21.738 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T20:27:21.757 DEBUG:teuthology.orchestra.console.trial027:power off output: Chassis Power Control: Down/Off
2026-02-17T20:27:21.768 DEBUG:teuthology.orchestra.console.trial125:power off output: Chassis Power Control: Down/Off
2026-02-17T20:27:21.773 DEBUG:teuthology.orchestra.console.trial099:power off output: Chassis Power Control: Down/Off
2026-02-17T20:27:25.761 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:27:25.768 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:27:25.774 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:27:25.876 DEBUG:teuthology.orchestra.console.trial125:check power output: Chassis Power is off
2026-02-17T20:27:25.876 INFO:teuthology.orchestra.console.trial125:Power off completed
2026-02-17T20:27:25.881 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is off
2026-02-17T20:27:25.881 INFO:teuthology.orchestra.console.trial099:Power off completed
2026-02-17T20:27:25.977 INFO:teuthology.orchestra.console.trial125:Power on
2026-02-17T20:27:25.977 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T20:27:25.987 INFO:teuthology.orchestra.console.trial099:Power on
2026-02-17T20:27:25.987 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T20:27:26.018 DEBUG:teuthology.orchestra.console.trial125:power on output: Chassis Power Control: Up/On
2026-02-17T20:27:26.027 DEBUG:teuthology.orchestra.console.trial099:power on output: Chassis Power Control: Up/On
2026-02-17T20:27:30.022 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:27:30.031 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:27:30.134 DEBUG:teuthology.orchestra.console.trial125:check power output: Chassis Power is on
2026-02-17T20:27:30.135 INFO:teuthology.orchestra.console.trial125:Power on completed
2026-02-17T20:27:30.142 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is on
2026-02-17T20:27:30.142 INFO:teuthology.orchestra.console.trial099:Power on completed
2026-02-17T20:27:30.236 INFO:teuthology.provision.fog.trial125:Waiting for deploy to finish
2026-02-17T20:27:30.243 INFO:teuthology.provision.fog.trial099:Waiting for deploy to finish
2026-02-17T20:27:31.824 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is off
2026-02-17T20:27:31.824 INFO:teuthology.orchestra.console.trial027:Power off completed
2026-02-17T20:27:31.924 INFO:teuthology.orchestra.console.trial027:Power on
2026-02-17T20:27:31.925 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T20:27:31.965 DEBUG:teuthology.orchestra.console.trial027:power on output: Chassis Power Control: Up/On
2026-02-17T20:27:35.970 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:27:36.080 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is on
2026-02-17T20:27:36.080 INFO:teuthology.orchestra.console.trial027:Power on completed
2026-02-17T20:27:36.181 INFO:teuthology.provision.fog.trial027:Waiting for deploy to finish
2026-02-17T20:29:17.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:17.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:17.799 ERROR:teuthology.orchestra.connection:Error authenticating with trial099.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T20:29:20.704 WARNING:teuthology.provision.fog.trial125:[Errno None] Unable to connect to port 22 on 10.20.193.125
2026-02-17T20:29:23.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:26.400 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-17T20:29:26.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:29.792 WARNING:teuthology.provision.fog.trial125:[Errno None] Unable to connect to port 22 on 10.20.193.125
2026-02-17T20:29:32.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:35.488 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-17T20:29:35.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:38.880 WARNING:teuthology.provision.fog.trial125:[Errno None] Unable to connect to port 22 on 10.20.193.125
2026-02-17T20:29:41.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:44.576 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-17T20:29:44.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:47.968 WARNING:teuthology.provision.fog.trial125:[Errno None] Unable to connect to port 22 on 10.20.193.125
2026-02-17T20:29:50.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:53.665 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-17T20:29:53.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:29:57.057 WARNING:teuthology.provision.fog.trial125:[Errno None] Unable to connect to port 22 on 10.20.193.125
2026-02-17T20:29:59.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:30:02.752 WARNING:teuthology.provision.fog.trial027:[Errno None] Unable to connect to port 22 on 10.20.193.27
2026-02-17T20:30:03.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:30:08.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:30:21.801 WARNING:teuthology.provision.fog.trial099:timed out
2026-02-17T20:30:27.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:30:31.046 ERROR:teuthology.orchestra.connection:Error authenticating with trial099.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T20:30:35.157 ERROR:teuthology.orchestra.connection:Error authenticating with trial099.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T20:30:39.065 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T20:30:39.065 DEBUG:teuthology.orchestra.run.trial125:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T20:30:39.354 INFO:teuthology.provision.fog.trial125:Node is ready
2026-02-17T20:30:39.354 DEBUG:teuthology.orchestra.run.trial125:> hostname
2026-02-17T20:30:39.413 INFO:teuthology.orchestra.run.trial125.stdout:trial125.front.sepia.ceph.com
2026-02-17T20:30:39.414 DEBUG:teuthology.orchestra.run.trial125:> grep trial125.front.sepia.ceph.com /etc/hosts
2026-02-17T20:30:39.446 INFO:teuthology.orchestra.run.trial125.stdout:10.20.193.125 trial125.front.sepia.ceph.com trial125
2026-02-17T20:30:39.446 DEBUG:teuthology.orchestra.run.trial125:> sudo hostname trial125
2026-02-17T20:30:39.516 DEBUG:teuthology.orchestra.run.trial125:> sudo sed -i -e 's/trial125.front.sepia.ceph.com/trial125/g' /etc/hosts
2026-02-17T20:30:39.582 DEBUG:teuthology.orchestra.run.trial125:> sudo sed -i -e 's/10.20.193.125/10.20.193.125/g' /etc/hosts
2026-02-17T20:30:39.646 DEBUG:teuthology.orchestra.run.trial125:> sudo sed -i -e 's/trial125.front.sepia.ceph.com/trial125/g' /etc/hostname
2026-02-17T20:30:39.712 DEBUG:teuthology.orchestra.run.trial125:> sudo hostname trial125
2026-02-17T20:30:39.777 DEBUG:teuthology.orchestra.run.trial125:> cat /etc/os-release
2026-02-17T20:30:39.832 INFO:teuthology.orchestra.run.trial125.stdout:NAME="CentOS Stream"
2026-02-17T20:30:39.832 INFO:teuthology.orchestra.run.trial125.stdout:VERSION="9"
2026-02-17T20:30:39.832 INFO:teuthology.orchestra.run.trial125.stdout:ID="centos"
2026-02-17T20:30:39.832 INFO:teuthology.orchestra.run.trial125.stdout:ID_LIKE="rhel fedora"
2026-02-17T20:30:39.832 INFO:teuthology.orchestra.run.trial125.stdout:VERSION_ID="9"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:PLATFORM_ID="platform:el9"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:ANSI_COLOR="0;31"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:LOGO="fedora-logo-icon"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:HOME_URL="https://centos.org/"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T20:30:39.833 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T20:30:39.833 INFO:teuthology.provision.fog.trial125:Deploy complete!
2026-02-17T20:30:39.834 DEBUG:teuthology.parallel:result is None
2026-02-17T20:30:42.263 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T20:30:42.263 DEBUG:teuthology.orchestra.run.trial099:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T20:30:42.422 INFO:teuthology.provision.fog.trial099:Node is ready
2026-02-17T20:30:42.423 DEBUG:teuthology.orchestra.run.trial099:> hostname
2026-02-17T20:30:42.478 INFO:teuthology.orchestra.run.trial099.stdout:trial099.front.sepia.ceph.com
2026-02-17T20:30:42.478 DEBUG:teuthology.orchestra.run.trial099:> grep trial099.front.sepia.ceph.com /etc/hosts
2026-02-17T20:30:42.534 INFO:teuthology.orchestra.run.trial099.stdout:10.20.193.99 trial099.front.sepia.ceph.com trial099
2026-02-17T20:30:42.535 DEBUG:teuthology.orchestra.run.trial099:> sudo hostname trial099
2026-02-17T20:30:42.603 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/trial099.front.sepia.ceph.com/trial099/g' /etc/hosts
2026-02-17T20:30:42.667 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/10.20.193.99/10.20.193.99/g' /etc/hosts
2026-02-17T20:30:42.731 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i -e 's/trial099.front.sepia.ceph.com/trial099/g' /etc/hostname
2026-02-17T20:30:42.795 DEBUG:teuthology.orchestra.run.trial099:> sudo hostname trial099
2026-02-17T20:30:42.858 DEBUG:teuthology.orchestra.run.trial099:> cat /etc/os-release
2026-02-17T20:30:42.914 INFO:teuthology.orchestra.run.trial099.stdout:NAME="CentOS Stream"
2026-02-17T20:30:42.914 INFO:teuthology.orchestra.run.trial099.stdout:VERSION="9"
2026-02-17T20:30:42.914 INFO:teuthology.orchestra.run.trial099.stdout:ID="centos"
2026-02-17T20:30:42.914 INFO:teuthology.orchestra.run.trial099.stdout:ID_LIKE="rhel fedora"
2026-02-17T20:30:42.914 INFO:teuthology.orchestra.run.trial099.stdout:VERSION_ID="9"
2026-02-17T20:30:42.914 INFO:teuthology.orchestra.run.trial099.stdout:PLATFORM_ID="platform:el9"
2026-02-17T20:30:42.915 INFO:teuthology.orchestra.run.trial099.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T20:30:42.915 INFO:teuthology.orchestra.run.trial099.stdout:ANSI_COLOR="0;31"
2026-02-17T20:30:42.915 INFO:teuthology.orchestra.run.trial099.stdout:LOGO="fedora-logo-icon"
2026-02-17T20:30:42.915 INFO:teuthology.orchestra.run.trial099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T20:30:42.915 INFO:teuthology.orchestra.run.trial099.stdout:HOME_URL="https://centos.org/"
2026-02-17T20:30:42.915 INFO:teuthology.orchestra.run.trial099.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T20:30:42.915 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T20:30:42.915 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T20:30:42.916 INFO:teuthology.provision.fog.trial099:Deploy complete!
2026-02-17T20:30:42.916 DEBUG:teuthology.parallel:result is None
2026-02-17T20:30:44.721 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T20:30:44.721 DEBUG:teuthology.orchestra.run.trial027:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T20:30:44.938 INFO:teuthology.provision.fog.trial027:Node is ready
2026-02-17T20:30:44.939 DEBUG:teuthology.orchestra.run.trial027:> hostname
2026-02-17T20:30:44.995 INFO:teuthology.orchestra.run.trial027.stdout:trial027.front.sepia.ceph.com
2026-02-17T20:30:44.995 DEBUG:teuthology.orchestra.run.trial027:> grep trial027.front.sepia.ceph.com /etc/hosts
2026-02-17T20:30:45.051 INFO:teuthology.orchestra.run.trial027.stdout:10.20.193.27 trial027.front.sepia.ceph.com trial027
2026-02-17T20:30:45.051 DEBUG:teuthology.orchestra.run.trial027:> sudo hostname trial027
2026-02-17T20:30:45.122 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/trial027.front.sepia.ceph.com/trial027/g' /etc/hosts
2026-02-17T20:30:45.188 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/10.20.193.27/10.20.193.27/g' /etc/hosts
2026-02-17T20:30:45.253 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i -e 's/trial027.front.sepia.ceph.com/trial027/g' /etc/hostname
2026-02-17T20:30:45.321 DEBUG:teuthology.orchestra.run.trial027:> sudo hostname trial027
2026-02-17T20:30:45.384 DEBUG:teuthology.orchestra.run.trial027:> cat /etc/os-release
2026-02-17T20:30:45.441 INFO:teuthology.orchestra.run.trial027.stdout:NAME="CentOS Stream"
2026-02-17T20:30:45.441 INFO:teuthology.orchestra.run.trial027.stdout:VERSION="9"
2026-02-17T20:30:45.441 INFO:teuthology.orchestra.run.trial027.stdout:ID="centos"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:ID_LIKE="rhel fedora"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:VERSION_ID="9"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:PLATFORM_ID="platform:el9"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:ANSI_COLOR="0;31"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:LOGO="fedora-logo-icon"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:HOME_URL="https://centos.org/"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T20:30:45.442 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T20:30:45.443 INFO:teuthology.provision.fog.trial027:Deploy complete!
2026-02-17T20:30:45.444 DEBUG:teuthology.parallel:result is None
2026-02-17T20:30:45.967 INFO:teuthology.lock.ops:Checking trial027.front.sepia.ceph.com
2026-02-17T20:30:45.967 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T20:30:46.073 INFO:teuthology.lock.ops:Checking trial099.front.sepia.ceph.com
2026-02-17T20:30:46.073 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T20:30:46.141 INFO:teuthology.lock.ops:Checking trial125.front.sepia.ceph.com
2026-02-17T20:30:46.141 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T20:30:46.198 INFO:teuthology.lock.ops:Updating [trial027.front.sepia.ceph.com]: set os type and version on server
2026-02-17T20:30:46.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial027.front.sepia.ceph.com'
2026-02-17T20:30:46.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:30:46.259 DEBUG:teuthology.orchestra.run.trial027:> true
2026-02-17T20:30:46.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial027.front.sepia.ceph.com'
2026-02-17T20:30:46.339 DEBUG:teuthology.orchestra.run.trial027:> uname -m
2026-02-17T20:30:46.394 INFO:teuthology.orchestra.run.trial027.stdout:x86_64
2026-02-17T20:30:46.394 DEBUG:teuthology.orchestra.run.trial027:> cat /etc/os-release
2026-02-17T20:30:46.451 INFO:teuthology.orchestra.run.trial027.stdout:NAME="CentOS Stream"
2026-02-17T20:30:46.451 INFO:teuthology.orchestra.run.trial027.stdout:VERSION="9"
2026-02-17T20:30:46.451 INFO:teuthology.orchestra.run.trial027.stdout:ID="centos"
2026-02-17T20:30:46.451 INFO:teuthology.orchestra.run.trial027.stdout:ID_LIKE="rhel fedora"
2026-02-17T20:30:46.451 INFO:teuthology.orchestra.run.trial027.stdout:VERSION_ID="9"
2026-02-17T20:30:46.451 INFO:teuthology.orchestra.run.trial027.stdout:PLATFORM_ID="platform:el9"
2026-02-17T20:30:46.451 INFO:teuthology.orchestra.run.trial027.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T20:30:46.452 INFO:teuthology.orchestra.run.trial027.stdout:ANSI_COLOR="0;31"
2026-02-17T20:30:46.452 INFO:teuthology.orchestra.run.trial027.stdout:LOGO="fedora-logo-icon"
2026-02-17T20:30:46.452 INFO:teuthology.orchestra.run.trial027.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T20:30:46.452 INFO:teuthology.orchestra.run.trial027.stdout:HOME_URL="https://centos.org/"
2026-02-17T20:30:46.452 INFO:teuthology.orchestra.run.trial027.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T20:30:46.452 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T20:30:46.452 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T20:30:46.453 INFO:teuthology.lock.ops:Updating trial027.front.sepia.ceph.com on lock server
2026-02-17T20:30:46.555 INFO:teuthology.lock.ops:Updating [trial099.front.sepia.ceph.com]: set os type and version on server
2026-02-17T20:30:46.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial099.front.sepia.ceph.com'
2026-02-17T20:30:46.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:30:46.626 DEBUG:teuthology.orchestra.run.trial099:> true
2026-02-17T20:30:46.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial099.front.sepia.ceph.com'
2026-02-17T20:30:46.700 DEBUG:teuthology.orchestra.run.trial099:> uname -m
2026-02-17T20:30:46.755 INFO:teuthology.orchestra.run.trial099.stdout:x86_64
2026-02-17T20:30:46.756 DEBUG:teuthology.orchestra.run.trial099:> cat /etc/os-release
2026-02-17T20:30:46.812 INFO:teuthology.orchestra.run.trial099.stdout:NAME="CentOS Stream"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:VERSION="9"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:ID="centos"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:ID_LIKE="rhel fedora"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:VERSION_ID="9"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:PLATFORM_ID="platform:el9"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:ANSI_COLOR="0;31"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:LOGO="fedora-logo-icon"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T20:30:46.813 INFO:teuthology.orchestra.run.trial099.stdout:HOME_URL="https://centos.org/"
2026-02-17T20:30:46.814 INFO:teuthology.orchestra.run.trial099.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T20:30:46.814 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T20:30:46.814 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T20:30:46.814 INFO:teuthology.lock.ops:Updating trial099.front.sepia.ceph.com on lock server
2026-02-17T20:30:46.917 INFO:teuthology.lock.ops:Updating [trial125.front.sepia.ceph.com]: set os type and version on server
2026-02-17T20:30:46.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial125.front.sepia.ceph.com'
2026-02-17T20:30:46.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T20:30:46.987 DEBUG:teuthology.orchestra.run.trial125:> true
2026-02-17T20:30:47.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial125.front.sepia.ceph.com'
2026-02-17T20:30:47.059 DEBUG:teuthology.orchestra.run.trial125:> uname -m
2026-02-17T20:30:47.115 INFO:teuthology.orchestra.run.trial125.stdout:x86_64
2026-02-17T20:30:47.115 DEBUG:teuthology.orchestra.run.trial125:> cat /etc/os-release
2026-02-17T20:30:47.171 INFO:teuthology.orchestra.run.trial125.stdout:NAME="CentOS Stream"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:VERSION="9"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:ID="centos"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:ID_LIKE="rhel fedora"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:VERSION_ID="9"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:PLATFORM_ID="platform:el9"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:ANSI_COLOR="0;31"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:LOGO="fedora-logo-icon"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:HOME_URL="https://centos.org/"
2026-02-17T20:30:47.172 INFO:teuthology.orchestra.run.trial125.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T20:30:47.173 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T20:30:47.173 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T20:30:47.173 INFO:teuthology.lock.ops:Updating trial125.front.sepia.ceph.com on lock server
2026-02-17T20:30:47.275 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:30:47.372 INFO:teuthology.dispatcher.supervisor:Running job 52884
2026-02-17T20:30:47.372 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52884 --name jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/pjd}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52884/orig.config.yaml
2026-02-17T20:30:47.372 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52884
2026-02-17T20:30:47.372 INFO:teuthology.dispatcher.supervisor:Job PID: 1403781
2026-02-17T20:30:47.372 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T20:32:47.373 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:34:47.494 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:36:47.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:38:47.742 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:40:48.016 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:42:48.139 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:44:48.228 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:46:48.348 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:48:48.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:50:48.558 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:52:48.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:54:48.755 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T20:54:48.854 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T20:54:49.048 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T20:54:49.650 INFO:teuthology.orchestra.console.trial125:Power off
2026-02-17T20:54:49.650 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T20:54:49.709 DEBUG:teuthology.orchestra.console.trial125:power off output: Chassis Power Control: Down/Off
2026-02-17T20:54:49.861 INFO:teuthology.orchestra.console.trial099:Power off
2026-02-17T20:54:49.861 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T20:54:49.882 INFO:teuthology.orchestra.console.trial027:Power off
2026-02-17T20:54:49.882 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T20:54:49.901 DEBUG:teuthology.orchestra.console.trial099:power off output: Chassis Power Control: Down/Off
2026-02-17T20:54:49.921 DEBUG:teuthology.orchestra.console.trial027:power off output: Chassis Power Control: Down/Off
2026-02-17T20:54:53.710 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:54:53.821 DEBUG:teuthology.orchestra.console.trial125:check power output: Chassis Power is on
2026-02-17T20:54:53.902 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:54:53.922 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:54:54.012 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is on
2026-02-17T20:54:54.033 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is on
2026-02-17T20:54:57.823 DEBUG:teuthology.orchestra.console.trial125:pexpect command: ipmitool -H trial125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:54:57.933 DEBUG:teuthology.orchestra.console.trial125:check power output: Chassis Power is off
2026-02-17T20:54:57.934 INFO:teuthology.orchestra.console.trial125:Power off completed
2026-02-17T20:54:58.013 DEBUG:teuthology.orchestra.console.trial099:pexpect command: ipmitool -H trial099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:54:58.033 DEBUG:teuthology.orchestra.console.trial027:pexpect command: ipmitool -H trial027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T20:54:58.134 DEBUG:teuthology.orchestra.console.trial099:check power output: Chassis Power is off
2026-02-17T20:54:58.134 INFO:teuthology.orchestra.console.trial099:Power off completed
2026-02-17T20:54:58.143 DEBUG:teuthology.orchestra.console.trial027:check power output: Chassis Power is off
2026-02-17T20:54:58.143 INFO:teuthology.orchestra.console.trial027:Power off completed
2026-02-17T20:54:58.146 INFO:teuthology.lock.ops:unlocked: trial125.front.sepia.ceph.com
2026-02-17T20:54:58.364 INFO:teuthology.lock.ops:unlocked: trial099.front.sepia.ceph.com
2026-02-17T20:54:58.376 INFO:teuthology.lock.ops:unlocked: trial027.front.sepia.ceph.com