2026-02-13T23:28:51.205 INFO:root:teuthology version: 1.2.4.dev6+g76f36e686
2026-02-13T23:28:51.205 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:28:51.278 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:28:51.531 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x72a00d923380>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x72a00d3ac400>, signals=[15])
2026-02-13T23:28:51.531 INFO:teuthology.lock.ops:Start node 'trial079.front.sepia.ceph.com' reimaging
2026-02-13T23:28:51.531 INFO:teuthology.lock.ops:Updating [trial079.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T23:28:51.531 INFO:teuthology.lock.ops:Updating trial079.front.sepia.ceph.com on lock server
2026-02-13T23:28:51.592 INFO:teuthology.lock.ops:Start node 'trial085.front.sepia.ceph.com' reimaging
2026-02-13T23:28:51.593 INFO:teuthology.lock.ops:Updating [trial085.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T23:28:51.593 INFO:teuthology.lock.ops:Updating trial085.front.sepia.ceph.com on lock server
2026-02-13T23:28:51.651 INFO:teuthology.lock.ops:Start node 'trial168.front.sepia.ceph.com' reimaging
2026-02-13T23:28:51.651 INFO:teuthology.lock.ops:Updating [trial168.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T23:28:51.651 INFO:teuthology.lock.ops:Updating trial168.front.sepia.ceph.com on lock server
2026-02-13T23:28:51.884 DEBUG:teuthology.provision.fog.trial085:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T23:28:51.884 DEBUG:teuthology.provision.fog.trial079:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T23:28:51.908 INFO:teuthology.provision.fog.trial079:Scheduling deploy of centos 9.stream
2026-02-13T23:28:51.918 DEBUG:teuthology.provision.fog.trial168:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T23:28:51.937 INFO:teuthology.provision.fog.trial085:Scheduling deploy of centos 9.stream
2026-02-13T23:28:51.967 INFO:teuthology.provision.fog.trial168:Scheduling deploy of centos 9.stream
2026-02-13T23:28:53.008 INFO:teuthology.orchestra.console.trial085:Power off
2026-02-13T23:28:53.008 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:28:53.066 INFO:teuthology.orchestra.console.trial168:Power off
2026-02-13T23:28:53.066 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:28:53.072 DEBUG:teuthology.orchestra.console.trial085:power off output: Chassis Power Control: Down/Off
2026-02-13T23:28:53.086 INFO:teuthology.orchestra.console.trial079:Power off
2026-02-13T23:28:53.086 DEBUG:teuthology.orchestra.console.trial079:pexpect command: ipmitool -H trial079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:28:53.104 DEBUG:teuthology.orchestra.console.trial168:power off output: Chassis Power Control: Down/Off
2026-02-13T23:28:53.123 DEBUG:teuthology.orchestra.console.trial079:power off output: Chassis Power Control: Down/Off
2026-02-13T23:28:57.077 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:57.105 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:57.124 DEBUG:teuthology.orchestra.console.trial079:pexpect command: ipmitool -H trial079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:57.186 DEBUG:teuthology.orchestra.console.trial085:check power output: Chassis Power is off
2026-02-13T23:28:57.187 INFO:teuthology.orchestra.console.trial085:Power off completed
2026-02-13T23:28:57.214 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is off
2026-02-13T23:28:57.214 INFO:teuthology.orchestra.console.trial168:Power off completed
2026-02-13T23:28:57.234 DEBUG:teuthology.orchestra.console.trial079:check power output: Chassis Power is off
2026-02-13T23:28:57.235 INFO:teuthology.orchestra.console.trial079:Power off completed
2026-02-13T23:28:57.288 INFO:teuthology.orchestra.console.trial085:Power on
2026-02-13T23:28:57.288 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T23:28:57.315 INFO:teuthology.orchestra.console.trial168:Power on
2026-02-13T23:28:57.316 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T23:28:57.330 DEBUG:teuthology.orchestra.console.trial085:power on output: Chassis Power Control: Up/On
2026-02-13T23:28:57.336 INFO:teuthology.orchestra.console.trial079:Power on
2026-02-13T23:28:57.336 DEBUG:teuthology.orchestra.console.trial079:pexpect command: ipmitool -H trial079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T23:28:57.360 DEBUG:teuthology.orchestra.console.trial168:power on output: Chassis Power Control: Up/On
2026-02-13T23:28:57.375 DEBUG:teuthology.orchestra.console.trial079:power on output: Chassis Power Control: Up/On
2026-02-13T23:29:01.333 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:29:01.361 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:29:01.376 DEBUG:teuthology.orchestra.console.trial079:pexpect command: ipmitool -H trial079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:29:01.443 DEBUG:teuthology.orchestra.console.trial085:check power output: Chassis Power is on
2026-02-13T23:29:01.443 INFO:teuthology.orchestra.console.trial085:Power on completed
2026-02-13T23:29:01.472 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is on
2026-02-13T23:29:01.473 INFO:teuthology.orchestra.console.trial168:Power on completed
2026-02-13T23:29:01.487 DEBUG:teuthology.orchestra.console.trial079:check power output: Chassis Power is on
2026-02-13T23:29:01.488 INFO:teuthology.orchestra.console.trial079:Power on completed
2026-02-13T23:29:01.544 INFO:teuthology.provision.fog.trial085:Waiting for deploy to finish
2026-02-13T23:29:01.573 INFO:teuthology.provision.fog.trial168:Waiting for deploy to finish
2026-02-13T23:29:01.589 INFO:teuthology.provision.fog.trial079:Waiting for deploy to finish
2026-02-13T23:30:49.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:49.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:49.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:49.378 ERROR:teuthology.orchestra.connection:Error authenticating with trial079.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-13T23:30:49.480 ERROR:teuthology.orchestra.connection:Error authenticating with trial168.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-13T23:30:52.317 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T23:30:58.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:01.405 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T23:31:07.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:10.493 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T23:31:16.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:19.581 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T23:31:25.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:28.669 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T23:31:34.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:53.380 WARNING:teuthology.provision.fog.trial079:timed out
2026-02-13T23:31:53.482 WARNING:teuthology.provision.fog.trial168:timed out
2026-02-13T23:31:59.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:59.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:32:03.717 ERROR:teuthology.orchestra.connection:Error authenticating with trial168.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T23:32:04.596 ERROR:teuthology.orchestra.connection:Error authenticating with trial079.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T23:32:07.855 ERROR:teuthology.orchestra.connection:Error authenticating with trial168.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T23:32:08.716 ERROR:teuthology.orchestra.connection:Error authenticating with trial079.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T23:32:10.653 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T23:32:10.653 DEBUG:teuthology.orchestra.run.trial085:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T23:32:10.794 INFO:teuthology.provision.fog.trial085:Node is ready
2026-02-13T23:32:10.794 DEBUG:teuthology.orchestra.run.trial085:> hostname
2026-02-13T23:32:10.850 INFO:teuthology.orchestra.run.trial085.stdout:trial085.front.sepia.ceph.com
2026-02-13T23:32:10.850 DEBUG:teuthology.orchestra.run.trial085:> grep trial085.front.sepia.ceph.com /etc/hosts
2026-02-13T23:32:10.905 INFO:teuthology.orchestra.run.trial085.stdout:10.20.193.85 trial085.front.sepia.ceph.com trial085
2026-02-13T23:32:10.905 DEBUG:teuthology.orchestra.run.trial085:> sudo hostname trial085
2026-02-13T23:32:10.974 DEBUG:teuthology.orchestra.run.trial085:> sudo sed -i -e 's/trial085.front.sepia.ceph.com/trial085/g' /etc/hosts
2026-02-13T23:32:11.040 DEBUG:teuthology.orchestra.run.trial085:> sudo sed -i -e 's/10.20.193.85/10.20.193.85/g' /etc/hosts
2026-02-13T23:32:11.105 DEBUG:teuthology.orchestra.run.trial085:> sudo sed -i -e 's/trial085.front.sepia.ceph.com/trial085/g' /etc/hostname
2026-02-13T23:32:11.168 DEBUG:teuthology.orchestra.run.trial085:> sudo hostname trial085
2026-02-13T23:32:11.231 DEBUG:teuthology.orchestra.run.trial085:> cat /etc/os-release
2026-02-13T23:32:11.288 INFO:teuthology.orchestra.run.trial085.stdout:NAME="CentOS Stream"
2026-02-13T23:32:11.288 INFO:teuthology.orchestra.run.trial085.stdout:VERSION="9"
2026-02-13T23:32:11.288 INFO:teuthology.orchestra.run.trial085.stdout:ID="centos"
2026-02-13T23:32:11.288 INFO:teuthology.orchestra.run.trial085.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:11.288 INFO:teuthology.orchestra.run.trial085.stdout:VERSION_ID="9"
2026-02-13T23:32:11.288 INFO:teuthology.orchestra.run.trial085.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:11.288 INFO:teuthology.orchestra.run.trial085.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:11.288 INFO:teuthology.orchestra.run.trial085.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:11.289 INFO:teuthology.orchestra.run.trial085.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:11.289 INFO:teuthology.orchestra.run.trial085.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:11.289 INFO:teuthology.orchestra.run.trial085.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:11.289 INFO:teuthology.orchestra.run.trial085.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:11.289 INFO:teuthology.orchestra.run.trial085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:11.289 INFO:teuthology.orchestra.run.trial085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:11.290 INFO:teuthology.provision.fog.trial085:Deploy complete!
2026-02-13T23:32:11.291 DEBUG:teuthology.parallel:result is None
2026-02-13T23:32:14.958 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T23:32:14.958 DEBUG:teuthology.orchestra.run.trial168:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T23:32:15.114 INFO:teuthology.provision.fog.trial168:Node is ready
2026-02-13T23:32:15.114 DEBUG:teuthology.orchestra.run.trial168:> hostname
2026-02-13T23:32:15.171 INFO:teuthology.orchestra.run.trial168.stdout:trial168.front.sepia.ceph.com
2026-02-13T23:32:15.172 DEBUG:teuthology.orchestra.run.trial168:> grep trial168.front.sepia.ceph.com /etc/hosts
2026-02-13T23:32:15.227 INFO:teuthology.orchestra.run.trial168.stdout:10.20.193.168 trial168.front.sepia.ceph.com trial168
2026-02-13T23:32:15.227 DEBUG:teuthology.orchestra.run.trial168:> sudo hostname trial168
2026-02-13T23:32:15.296 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/trial168.front.sepia.ceph.com/trial168/g' /etc/hosts
2026-02-13T23:32:15.362 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/10.20.193.168/10.20.193.168/g' /etc/hosts
2026-02-13T23:32:15.426 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/trial168.front.sepia.ceph.com/trial168/g' /etc/hostname
2026-02-13T23:32:15.491 DEBUG:teuthology.orchestra.run.trial168:> sudo hostname trial168
2026-02-13T23:32:15.556 DEBUG:teuthology.orchestra.run.trial168:> cat /etc/os-release
2026-02-13T23:32:15.612 INFO:teuthology.orchestra.run.trial168.stdout:NAME="CentOS Stream"
2026-02-13T23:32:15.612 INFO:teuthology.orchestra.run.trial168.stdout:VERSION="9"
2026-02-13T23:32:15.612 INFO:teuthology.orchestra.run.trial168.stdout:ID="centos"
2026-02-13T23:32:15.612 INFO:teuthology.orchestra.run.trial168.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:15.612 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_ID="9"
2026-02-13T23:32:15.612 INFO:teuthology.orchestra.run.trial168.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:15.612 INFO:teuthology.orchestra.run.trial168.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:15.613 INFO:teuthology.orchestra.run.trial168.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:15.613 INFO:teuthology.orchestra.run.trial168.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:15.613 INFO:teuthology.orchestra.run.trial168.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:15.613 INFO:teuthology.orchestra.run.trial168.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:15.613 INFO:teuthology.orchestra.run.trial168.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:15.613 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:15.613 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:15.614 INFO:teuthology.provision.fog.trial168:Deploy complete!
2026-02-13T23:32:15.614 DEBUG:teuthology.parallel:result is None
2026-02-13T23:32:15.826 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T23:32:15.827 DEBUG:teuthology.orchestra.run.trial079:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T23:32:16.018 INFO:teuthology.provision.fog.trial079:Node is ready
2026-02-13T23:32:16.019 DEBUG:teuthology.orchestra.run.trial079:> hostname
2026-02-13T23:32:16.072 INFO:teuthology.orchestra.run.trial079.stdout:trial079.front.sepia.ceph.com
2026-02-13T23:32:16.073 DEBUG:teuthology.orchestra.run.trial079:> grep trial079.front.sepia.ceph.com /etc/hosts
2026-02-13T23:32:16.128 INFO:teuthology.orchestra.run.trial079.stdout:10.20.193.79 trial079.front.sepia.ceph.com trial079
2026-02-13T23:32:16.128 DEBUG:teuthology.orchestra.run.trial079:> sudo hostname trial079
2026-02-13T23:32:16.196 DEBUG:teuthology.orchestra.run.trial079:> sudo sed -i -e 's/trial079.front.sepia.ceph.com/trial079/g' /etc/hosts
2026-02-13T23:32:16.259 DEBUG:teuthology.orchestra.run.trial079:> sudo sed -i -e 's/10.20.193.79/10.20.193.79/g' /etc/hosts
2026-02-13T23:32:16.320 DEBUG:teuthology.orchestra.run.trial079:> sudo sed -i -e 's/trial079.front.sepia.ceph.com/trial079/g' /etc/hostname
2026-02-13T23:32:16.381 DEBUG:teuthology.orchestra.run.trial079:> sudo hostname trial079
2026-02-13T23:32:16.445 DEBUG:teuthology.orchestra.run.trial079:> cat /etc/os-release
2026-02-13T23:32:16.501 INFO:teuthology.orchestra.run.trial079.stdout:NAME="CentOS Stream"
2026-02-13T23:32:16.501 INFO:teuthology.orchestra.run.trial079.stdout:VERSION="9"
2026-02-13T23:32:16.501 INFO:teuthology.orchestra.run.trial079.stdout:ID="centos"
2026-02-13T23:32:16.501 INFO:teuthology.orchestra.run.trial079.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:16.501 INFO:teuthology.orchestra.run.trial079.stdout:VERSION_ID="9"
2026-02-13T23:32:16.501 INFO:teuthology.orchestra.run.trial079.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:16.502 INFO:teuthology.orchestra.run.trial079.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:16.502 INFO:teuthology.orchestra.run.trial079.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:16.502 INFO:teuthology.orchestra.run.trial079.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:16.502 INFO:teuthology.orchestra.run.trial079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:16.502 INFO:teuthology.orchestra.run.trial079.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:16.502 INFO:teuthology.orchestra.run.trial079.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:16.502 INFO:teuthology.orchestra.run.trial079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:16.502 INFO:teuthology.orchestra.run.trial079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:16.503 INFO:teuthology.provision.fog.trial079:Deploy complete!
2026-02-13T23:32:16.503 DEBUG:teuthology.parallel:result is None
2026-02-13T23:32:17.030 INFO:teuthology.lock.ops:Checking trial079.front.sepia.ceph.com
2026-02-13T23:32:17.030 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T23:32:17.102 INFO:teuthology.lock.ops:Checking trial085.front.sepia.ceph.com
2026-02-13T23:32:17.103 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T23:32:17.164 INFO:teuthology.lock.ops:Checking trial168.front.sepia.ceph.com
2026-02-13T23:32:17.164 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T23:32:17.221 INFO:teuthology.lock.ops:Updating [trial079.front.sepia.ceph.com]: set os type and version on server
2026-02-13T23:32:17.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial079.front.sepia.ceph.com'
2026-02-13T23:32:17.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:32:17.282 DEBUG:teuthology.orchestra.run.trial079:> true
2026-02-13T23:32:17.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial079.front.sepia.ceph.com'
2026-02-13T23:32:17.355 DEBUG:teuthology.orchestra.run.trial079:> uname -m
2026-02-13T23:32:17.410 INFO:teuthology.orchestra.run.trial079.stdout:x86_64
2026-02-13T23:32:17.410 DEBUG:teuthology.orchestra.run.trial079:> cat /etc/os-release
2026-02-13T23:32:17.463 INFO:teuthology.orchestra.run.trial079.stdout:NAME="CentOS Stream"
2026-02-13T23:32:17.463 INFO:teuthology.orchestra.run.trial079.stdout:VERSION="9"
2026-02-13T23:32:17.463 INFO:teuthology.orchestra.run.trial079.stdout:ID="centos"
2026-02-13T23:32:17.463 INFO:teuthology.orchestra.run.trial079.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:VERSION_ID="9"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:17.464 INFO:teuthology.orchestra.run.trial079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:17.464 INFO:teuthology.lock.ops:Updating trial079.front.sepia.ceph.com on lock server
2026-02-13T23:32:17.522 INFO:teuthology.lock.ops:Updating [trial085.front.sepia.ceph.com]: set os type and version on server
2026-02-13T23:32:17.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial085.front.sepia.ceph.com'
2026-02-13T23:32:17.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:32:17.584 DEBUG:teuthology.orchestra.run.trial085:> true
2026-02-13T23:32:17.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial085.front.sepia.ceph.com'
2026-02-13T23:32:17.664 DEBUG:teuthology.orchestra.run.trial085:> uname -m
2026-02-13T23:32:17.720 INFO:teuthology.orchestra.run.trial085.stdout:x86_64
2026-02-13T23:32:17.720 DEBUG:teuthology.orchestra.run.trial085:> cat /etc/os-release
2026-02-13T23:32:17.776 INFO:teuthology.orchestra.run.trial085.stdout:NAME="CentOS Stream"
2026-02-13T23:32:17.776 INFO:teuthology.orchestra.run.trial085.stdout:VERSION="9"
2026-02-13T23:32:17.776 INFO:teuthology.orchestra.run.trial085.stdout:ID="centos"
2026-02-13T23:32:17.776 INFO:teuthology.orchestra.run.trial085.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:17.776 INFO:teuthology.orchestra.run.trial085.stdout:VERSION_ID="9"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:17.777 INFO:teuthology.orchestra.run.trial085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:17.778 INFO:teuthology.lock.ops:Updating trial085.front.sepia.ceph.com on lock server
2026-02-13T23:32:17.883 INFO:teuthology.lock.ops:Updating [trial168.front.sepia.ceph.com]: set os type and version on server
2026-02-13T23:32:17.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com'
2026-02-13T23:32:17.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:32:17.948 DEBUG:teuthology.orchestra.run.trial168:> true
2026-02-13T23:32:18.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com'
2026-02-13T23:32:18.019 DEBUG:teuthology.orchestra.run.trial168:> uname -m
2026-02-13T23:32:18.074 INFO:teuthology.orchestra.run.trial168.stdout:x86_64
2026-02-13T23:32:18.075 DEBUG:teuthology.orchestra.run.trial168:> cat /etc/os-release
2026-02-13T23:32:18.130 INFO:teuthology.orchestra.run.trial168.stdout:NAME="CentOS Stream"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:VERSION="9"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:ID="centos"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_ID="9"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:18.131 INFO:teuthology.orchestra.run.trial168.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:18.132 INFO:teuthology.lock.ops:Updating trial168.front.sepia.ceph.com on lock server
2026-02-13T23:32:18.235 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:32:18.333 INFO:teuthology.dispatcher.supervisor:Running job 50023
2026-02-13T23:32:18.333 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50023 --name pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/postgres}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50023/orig.config.yaml
2026-02-13T23:32:18.334 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50023
2026-02-13T23:32:18.334 INFO:teuthology.dispatcher.supervisor:Job PID: 769562
2026-02-13T23:32:18.334 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T23:34:18.335 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:36:18.428 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:38:18.551 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:40:18.674 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:42:18.747 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:44:18.818 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:46:18.938 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:48:19.060 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:50:19.167 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:52:19.289 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:52:19.416 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T23:52:19.606 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T23:52:20.356 INFO:teuthology.orchestra.console.trial085:Power off
2026-02-13T23:52:20.356 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:52:20.365 INFO:teuthology.orchestra.console.trial079:Power off
2026-02-13T23:52:20.365 DEBUG:teuthology.orchestra.console.trial079:pexpect command: ipmitool -H trial079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:52:20.385 INFO:teuthology.orchestra.console.trial168:Power off
2026-02-13T23:52:20.385 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:52:20.393 DEBUG:teuthology.orchestra.console.trial085:power off output: Chassis Power Control: Down/Off
2026-02-13T23:52:20.402 DEBUG:teuthology.orchestra.console.trial079:power off output: Chassis Power Control: Down/Off
2026-02-13T23:52:20.424 DEBUG:teuthology.orchestra.console.trial168:power off output: Chassis Power Control: Down/Off
2026-02-13T23:52:24.394 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:24.403 DEBUG:teuthology.orchestra.console.trial079:pexpect command: ipmitool -H trial079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:24.425 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:24.503 DEBUG:teuthology.orchestra.console.trial085:check power output: Chassis Power is on
2026-02-13T23:52:24.511 DEBUG:teuthology.orchestra.console.trial079:check power output: Chassis Power is on
2026-02-13T23:52:24.533 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is on
2026-02-13T23:52:28.503 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:28.512 DEBUG:teuthology.orchestra.console.trial079:pexpect command: ipmitool -H trial079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:28.534 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:28.611 DEBUG:teuthology.orchestra.console.trial085:check power output: Chassis Power is off
2026-02-13T23:52:28.612 INFO:teuthology.orchestra.console.trial085:Power off completed
2026-02-13T23:52:28.619 DEBUG:teuthology.orchestra.console.trial079:check power output: Chassis Power is off
2026-02-13T23:52:28.620 INFO:teuthology.orchestra.console.trial079:Power off completed
2026-02-13T23:52:28.641 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is off
2026-02-13T23:52:28.642 INFO:teuthology.orchestra.console.trial168:Power off completed
2026-02-13T23:52:28.868 INFO:teuthology.lock.ops:unlocked: trial085.front.sepia.ceph.com
2026-02-13T23:52:28.882 INFO:teuthology.lock.ops:unlocked: trial168.front.sepia.ceph.com
2026-02-13T23:52:28.883 INFO:teuthology.lock.ops:unlocked: trial079.front.sepia.ceph.com