2026-02-14T02:06:04.759 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-14T02:06:04.759 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:06:04.832 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:06:05.094 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7882611efd10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x78826099a0c0>, signals=[15])
2026-02-14T02:06:05.094 INFO:teuthology.lock.ops:Start node 'trial034.front.sepia.ceph.com' reimaging
2026-02-14T02:06:05.094 INFO:teuthology.lock.ops:Updating [trial034.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T02:06:05.094 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server
2026-02-14T02:06:05.151 INFO:teuthology.lock.ops:Start node 'trial151.front.sepia.ceph.com' reimaging
2026-02-14T02:06:05.151 INFO:teuthology.lock.ops:Updating [trial151.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T02:06:05.151 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server
2026-02-14T02:06:05.207 INFO:teuthology.lock.ops:Start node 'trial163.front.sepia.ceph.com' reimaging
2026-02-14T02:06:05.207 INFO:teuthology.lock.ops:Updating [trial163.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T02:06:05.207 INFO:teuthology.lock.ops:Updating trial163.front.sepia.ceph.com on lock server
2026-02-14T02:06:05.441 DEBUG:teuthology.provision.fog.trial151:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T02:06:05.441 DEBUG:teuthology.provision.fog.trial034:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T02:06:05.461 INFO:teuthology.provision.fog.trial034:Scheduling deploy of centos 9.stream
2026-02-14T02:06:05.494 INFO:teuthology.provision.fog.trial151:Scheduling deploy of centos 9.stream
2026-02-14T02:06:05.497 DEBUG:teuthology.provision.fog.trial163:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T02:06:05.544 INFO:teuthology.provision.fog.trial163:Scheduling deploy of centos 9.stream
2026-02-14T02:06:06.687 INFO:teuthology.orchestra.console.trial034:Power off
2026-02-14T02:06:06.687 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:06:06.701 INFO:teuthology.orchestra.console.trial163:Power off
2026-02-14T02:06:06.702 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:06:06.708 INFO:teuthology.orchestra.console.trial151:Power off
2026-02-14T02:06:06.709 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:06:06.727 DEBUG:teuthology.orchestra.console.trial034:power off output: Chassis Power Control: Down/Off
2026-02-14T02:06:06.745 DEBUG:teuthology.orchestra.console.trial163:power off output: Chassis Power Control: Down/Off
2026-02-14T02:06:06.745 DEBUG:teuthology.orchestra.console.trial151:power off output: Chassis Power Control: Down/Off
2026-02-14T02:06:10.731 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:06:10.747 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:06:10.754 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:06:10.840 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is off
2026-02-14T02:06:10.841 INFO:teuthology.orchestra.console.trial034:Power off completed
2026-02-14T02:06:10.856 DEBUG:teuthology.orchestra.console.trial163:check power output: Chassis Power is off
2026-02-14T02:06:10.856 INFO:teuthology.orchestra.console.trial163:Power off completed
2026-02-14T02:06:10.862 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is off
2026-02-14T02:06:10.862 INFO:teuthology.orchestra.console.trial151:Power off completed
2026-02-14T02:06:10.942 INFO:teuthology.orchestra.console.trial034:Power on
2026-02-14T02:06:10.942 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T02:06:10.957 INFO:teuthology.orchestra.console.trial163:Power on
2026-02-14T02:06:10.958 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T02:06:10.966 INFO:teuthology.orchestra.console.trial151:Power on
2026-02-14T02:06:10.966 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T02:06:10.981 DEBUG:teuthology.orchestra.console.trial034:power on output: Chassis Power Control: Up/On
2026-02-14T02:06:10.998 DEBUG:teuthology.orchestra.console.trial163:power on output: Chassis Power Control: Up/On
2026-02-14T02:06:11.006 DEBUG:teuthology.orchestra.console.trial151:power on output: Chassis Power Control: Up/On
2026-02-14T02:06:14.986 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:06:14.999 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:06:15.007 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:06:15.096 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is on
2026-02-14T02:06:15.097 INFO:teuthology.orchestra.console.trial034:Power on completed
2026-02-14T02:06:15.108 DEBUG:teuthology.orchestra.console.trial163:check power output: Chassis Power is on
2026-02-14T02:06:15.108 INFO:teuthology.orchestra.console.trial163:Power on completed
2026-02-14T02:06:15.116 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is on
2026-02-14T02:06:15.116 INFO:teuthology.orchestra.console.trial151:Power on completed
2026-02-14T02:06:15.198 INFO:teuthology.provision.fog.trial034:Waiting for deploy to finish
2026-02-14T02:06:15.210 INFO:teuthology.provision.fog.trial163:Waiting for deploy to finish
2026-02-14T02:06:15.217 INFO:teuthology.provision.fog.trial151:Waiting for deploy to finish
2026-02-14T02:08:02.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:02.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:02.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:03.100 ERROR:teuthology.orchestra.connection:Error authenticating with trial151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-14T02:08:17.181 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-14T02:08:17.245 WARNING:teuthology.provision.fog.trial163:[Errno None] Unable to connect to port 22 on 10.20.193.163
2026-02-14T02:08:23.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:23.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:26.269 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-14T02:08:26.333 WARNING:teuthology.provision.fog.trial163:[Errno None] Unable to connect to port 22 on 10.20.193.163
2026-02-14T02:08:32.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:32.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:35.357 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-14T02:08:35.421 WARNING:teuthology.provision.fog.trial163:[Errno None] Unable to connect to port 22 on 10.20.193.163
2026-02-14T02:08:41.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:41.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:44.445 WARNING:teuthology.provision.fog.trial034:[Errno None] Unable to connect to port 22 on 10.20.193.34
2026-02-14T02:08:44.509 WARNING:teuthology.provision.fog.trial163:[Errno None] Unable to connect to port 22 on 10.20.193.163
2026-02-14T02:08:50.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:08:50.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:09:07.103 WARNING:teuthology.provision.fog.trial151:timed out
2026-02-14T02:09:13.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:09:16.324 ERROR:teuthology.orchestra.connection:Error authenticating with trial151.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T02:09:20.468 ERROR:teuthology.orchestra.connection:Error authenticating with trial151.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T02:09:26.346 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T02:09:26.346 DEBUG:teuthology.orchestra.run.trial163:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T02:09:26.347 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T02:09:26.347 DEBUG:teuthology.orchestra.run.trial034:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T02:09:26.496 INFO:teuthology.provision.fog.trial034:Node is ready
2026-02-14T02:09:26.496 DEBUG:teuthology.orchestra.run.trial034:> hostname
2026-02-14T02:09:26.552 INFO:teuthology.orchestra.run.trial034.stdout:trial034.front.sepia.ceph.com
2026-02-14T02:09:26.552 DEBUG:teuthology.orchestra.run.trial034:> grep trial034.front.sepia.ceph.com /etc/hosts
2026-02-14T02:09:26.608 INFO:teuthology.orchestra.run.trial034.stdout:10.20.193.34 trial034.front.sepia.ceph.com trial034
2026-02-14T02:09:26.608 DEBUG:teuthology.orchestra.run.trial034:> sudo hostname trial034
2026-02-14T02:09:26.646 INFO:teuthology.provision.fog.trial163:Node is ready
2026-02-14T02:09:26.646 DEBUG:teuthology.orchestra.run.trial163:> hostname
2026-02-14T02:09:26.676 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/trial034.front.sepia.ceph.com/trial034/g' /etc/hosts
2026-02-14T02:09:26.704 INFO:teuthology.orchestra.run.trial163.stdout:trial163.front.sepia.ceph.com
2026-02-14T02:09:26.704 DEBUG:teuthology.orchestra.run.trial163:> grep trial163.front.sepia.ceph.com /etc/hosts
2026-02-14T02:09:26.742 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/10.20.193.34/10.20.193.34/g' /etc/hosts
2026-02-14T02:09:26.761 INFO:teuthology.orchestra.run.trial163.stdout:10.20.193.163 trial163.front.sepia.ceph.com trial163
2026-02-14T02:09:26.762 DEBUG:teuthology.orchestra.run.trial163:> sudo hostname trial163
2026-02-14T02:09:26.805 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i -e 's/trial034.front.sepia.ceph.com/trial034/g' /etc/hostname
2026-02-14T02:09:26.832 DEBUG:teuthology.orchestra.run.trial163:> sudo sed -i -e 's/trial163.front.sepia.ceph.com/trial163/g' /etc/hosts
2026-02-14T02:09:26.869 DEBUG:teuthology.orchestra.run.trial034:> sudo hostname trial034
2026-02-14T02:09:26.899 DEBUG:teuthology.orchestra.run.trial163:> sudo sed -i -e 's/10.20.193.163/10.20.193.163/g' /etc/hosts
2026-02-14T02:09:26.933 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release
2026-02-14T02:09:26.965 DEBUG:teuthology.orchestra.run.trial163:> sudo sed -i -e 's/trial163.front.sepia.ceph.com/trial163/g' /etc/hostname
2026-02-14T02:09:26.988 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T02:09:26.989 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/"
2026-02-14T02:09:26.990 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T02:09:26.990 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T02:09:26.990 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T02:09:26.991 INFO:teuthology.provision.fog.trial034:Deploy complete!
2026-02-14T02:09:26.992 DEBUG:teuthology.parallel:result is None
2026-02-14T02:09:27.031 DEBUG:teuthology.orchestra.run.trial163:> sudo hostname trial163
2026-02-14T02:09:27.097 DEBUG:teuthology.orchestra.run.trial163:> cat /etc/os-release
2026-02-14T02:09:27.153 INFO:teuthology.orchestra.run.trial163.stdout:NAME="CentOS Stream"
2026-02-14T02:09:27.153 INFO:teuthology.orchestra.run.trial163.stdout:VERSION="9"
2026-02-14T02:09:27.153 INFO:teuthology.orchestra.run.trial163.stdout:ID="centos"
2026-02-14T02:09:27.153 INFO:teuthology.orchestra.run.trial163.stdout:ID_LIKE="rhel fedora"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:VERSION_ID="9"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:PLATFORM_ID="platform:el9"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:ANSI_COLOR="0;31"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:LOGO="fedora-logo-icon"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:HOME_URL="https://centos.org/"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T02:09:27.154 INFO:teuthology.orchestra.run.trial163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T02:09:27.155 INFO:teuthology.provision.fog.trial163:Deploy complete!
2026-02-14T02:09:27.156 DEBUG:teuthology.parallel:result is None
2026-02-14T02:09:27.571 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T02:09:27.571 DEBUG:teuthology.orchestra.run.trial151:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T02:09:27.748 INFO:teuthology.provision.fog.trial151:Node is ready
2026-02-14T02:09:27.748 DEBUG:teuthology.orchestra.run.trial151:> hostname
2026-02-14T02:09:27.806 INFO:teuthology.orchestra.run.trial151.stdout:trial151.front.sepia.ceph.com
2026-02-14T02:09:27.806 DEBUG:teuthology.orchestra.run.trial151:> grep trial151.front.sepia.ceph.com /etc/hosts
2026-02-14T02:09:27.864 INFO:teuthology.orchestra.run.trial151.stdout:10.20.193.151 trial151.front.sepia.ceph.com trial151
2026-02-14T02:09:27.864 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname trial151
2026-02-14T02:09:27.934 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/trial151.front.sepia.ceph.com/trial151/g' /etc/hosts
2026-02-14T02:09:28.000 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/10.20.193.151/10.20.193.151/g' /etc/hosts
2026-02-14T02:09:28.065 DEBUG:teuthology.orchestra.run.trial151:> sudo sed -i -e 's/trial151.front.sepia.ceph.com/trial151/g' /etc/hostname
2026-02-14T02:09:28.129 DEBUG:teuthology.orchestra.run.trial151:> sudo hostname trial151
2026-02-14T02:09:28.193 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release
2026-02-14T02:09:28.249 INFO:teuthology.orchestra.run.trial151.stdout:NAME="CentOS Stream"
2026-02-14T02:09:28.249 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="9"
2026-02-14T02:09:28.249 INFO:teuthology.orchestra.run.trial151.stdout:ID="centos"
2026-02-14T02:09:28.249 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel fedora"
2026-02-14T02:09:28.249 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="9"
2026-02-14T02:09:28.249 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el9"
2026-02-14T02:09:28.250 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T02:09:28.250 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;31"
2026-02-14T02:09:28.250 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon"
2026-02-14T02:09:28.250 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T02:09:28.250 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://centos.org/"
2026-02-14T02:09:28.250 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T02:09:28.250 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T02:09:28.250 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T02:09:28.251 INFO:teuthology.provision.fog.trial151:Deploy complete!
2026-02-14T02:09:28.251 DEBUG:teuthology.parallel:result is None
2026-02-14T02:09:28.770 INFO:teuthology.lock.ops:Checking trial034.front.sepia.ceph.com
2026-02-14T02:09:28.771 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T02:09:28.878 INFO:teuthology.lock.ops:Checking trial151.front.sepia.ceph.com
2026-02-14T02:09:28.878 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T02:09:28.945 INFO:teuthology.lock.ops:Checking trial163.front.sepia.ceph.com
2026-02-14T02:09:28.945 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T02:09:29.003 INFO:teuthology.lock.ops:Updating [trial034.front.sepia.ceph.com]: set os type and version on server
2026-02-14T02:09:29.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial034.front.sepia.ceph.com'
2026-02-14T02:09:29.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:09:29.062 DEBUG:teuthology.orchestra.run.trial034:> true
2026-02-14T02:09:29.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial034.front.sepia.ceph.com'
2026-02-14T02:09:29.139 DEBUG:teuthology.orchestra.run.trial034:> uname -m
2026-02-14T02:09:29.195 INFO:teuthology.orchestra.run.trial034.stdout:x86_64
2026-02-14T02:09:29.195 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release
2026-02-14T02:09:29.251 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon"
2026-02-14T02:09:29.252 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T02:09:29.253 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/"
2026-02-14T02:09:29.253 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T02:09:29.253 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T02:09:29.253 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T02:09:29.253 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server
2026-02-14T02:09:29.355 INFO:teuthology.lock.ops:Updating [trial151.front.sepia.ceph.com]: set os type and version on server
2026-02-14T02:09:29.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial151.front.sepia.ceph.com'
2026-02-14T02:09:29.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:09:29.423 DEBUG:teuthology.orchestra.run.trial151:> true
2026-02-14T02:09:29.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial151.front.sepia.ceph.com'
2026-02-14T02:09:29.503 DEBUG:teuthology.orchestra.run.trial151:> uname -m
2026-02-14T02:09:29.558 INFO:teuthology.orchestra.run.trial151.stdout:x86_64
2026-02-14T02:09:29.558 DEBUG:teuthology.orchestra.run.trial151:> cat /etc/os-release
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:NAME="CentOS Stream"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:VERSION="9"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:ID="centos"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:ID_LIKE="rhel fedora"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:VERSION_ID="9"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:PLATFORM_ID="platform:el9"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:ANSI_COLOR="0;31"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:LOGO="fedora-logo-icon"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:HOME_URL="https://centos.org/"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T02:09:29.613 INFO:teuthology.orchestra.run.trial151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T02:09:29.614 INFO:teuthology.lock.ops:Updating trial151.front.sepia.ceph.com on lock server
2026-02-14T02:09:29.687 INFO:teuthology.lock.ops:Updating [trial163.front.sepia.ceph.com]: set os type and version on server
2026-02-14T02:09:29.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com'
2026-02-14T02:09:29.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T02:09:29.749 DEBUG:teuthology.orchestra.run.trial163:> true
2026-02-14T02:09:29.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com'
2026-02-14T02:09:29.826 DEBUG:teuthology.orchestra.run.trial163:> uname -m
2026-02-14T02:09:29.882 INFO:teuthology.orchestra.run.trial163.stdout:x86_64
2026-02-14T02:09:29.883 DEBUG:teuthology.orchestra.run.trial163:> cat /etc/os-release
2026-02-14T02:09:29.939 INFO:teuthology.orchestra.run.trial163.stdout:NAME="CentOS Stream"
2026-02-14T02:09:29.939 INFO:teuthology.orchestra.run.trial163.stdout:VERSION="9"
2026-02-14T02:09:29.939 INFO:teuthology.orchestra.run.trial163.stdout:ID="centos"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:ID_LIKE="rhel fedora"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:VERSION_ID="9"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:PLATFORM_ID="platform:el9"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:ANSI_COLOR="0;31"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:LOGO="fedora-logo-icon"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:HOME_URL="https://centos.org/"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T02:09:29.940 INFO:teuthology.orchestra.run.trial163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T02:09:29.941 INFO:teuthology.lock.ops:Updating trial163.front.sepia.ceph.com on lock server
2026-02-14T02:09:30.043 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:09:30.139 INFO:teuthology.dispatcher.supervisor:Running job 50621
2026-02-14T02:09:30.139 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50621 --name jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/postgres}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50621/orig.config.yaml
2026-02-14T02:09:30.140 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50621
2026-02-14T02:09:30.140 INFO:teuthology.dispatcher.supervisor:Job PID: 1757464
2026-02-14T02:09:30.140 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-14T02:11:30.140 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:13:30.240 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:15:30.359 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:17:30.485 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:19:30.604 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:21:30.726 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:23:30.848 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:25:30.969 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:27:31.092 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:29:31.213 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:31:31.336 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:33:31.469 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:35:31.595 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:37:31.714 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:39:31.831 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:41:31.958 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:43:32.082 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:45:32.202 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T02:45:32.324 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-14T02:45:32.498 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-14T02:45:33.162 INFO:teuthology.orchestra.console.trial034:Power off
2026-02-14T02:45:33.162 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:45:33.183 INFO:teuthology.orchestra.console.trial163:Power off
2026-02-14T02:45:33.183 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:45:33.201 DEBUG:teuthology.orchestra.console.trial034:power off output: Chassis Power Control: Down/Off
2026-02-14T02:45:33.220 DEBUG:teuthology.orchestra.console.trial163:power off output: Chassis Power Control: Down/Off
2026-02-14T02:45:33.648 INFO:teuthology.orchestra.console.trial151:Power off
2026-02-14T02:45:33.648 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T02:45:33.686 DEBUG:teuthology.orchestra.console.trial151:power off output: Chassis Power Control: Down/Off
2026-02-14T02:45:37.202 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:45:37.221 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:45:37.312 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is on
2026-02-14T02:45:37.329 DEBUG:teuthology.orchestra.console.trial163:check power output: Chassis Power is on
2026-02-14T02:45:37.687 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:45:37.796 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is on
2026-02-14T02:45:41.314 DEBUG:teuthology.orchestra.console.trial034:pexpect command: ipmitool -H trial034.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:45:41.329 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:45:41.423 DEBUG:teuthology.orchestra.console.trial034:check power output: Chassis Power is off
2026-02-14T02:45:41.423 INFO:teuthology.orchestra.console.trial034:Power off completed
2026-02-14T02:45:41.437 DEBUG:teuthology.orchestra.console.trial163:check power output: Chassis Power is off
2026-02-14T02:45:41.437 INFO:teuthology.orchestra.console.trial163:Power off completed
2026-02-14T02:45:41.672 INFO:teuthology.lock.ops:unlocked: trial034.front.sepia.ceph.com
2026-02-14T02:45:41.683 INFO:teuthology.lock.ops:unlocked: trial163.front.sepia.ceph.com
2026-02-14T02:45:41.797 DEBUG:teuthology.orchestra.console.trial151:pexpect command: ipmitool -H trial151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T02:45:41.903 DEBUG:teuthology.orchestra.console.trial151:check power output: Chassis Power is off
2026-02-14T02:45:41.903 INFO:teuthology.orchestra.console.trial151:Power off completed
2026-02-14T02:45:42.111 INFO:teuthology.lock.ops:unlocked: trial151.front.sepia.ceph.com