2026-02-13T23:28:00.203 INFO:root:teuthology version: 1.2.4.dev6+g76f36e686
2026-02-13T23:28:00.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:28:00.277 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:28:00.529 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7c87fe64fa40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7c87fdea9120>, signals=[15])
2026-02-13T23:28:00.529 INFO:teuthology.lock.ops:Start node 'trial110.front.sepia.ceph.com' reimaging
2026-02-13T23:28:00.529 INFO:teuthology.lock.ops:Updating [trial110.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T23:28:00.529 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server
2026-02-13T23:28:00.587 INFO:teuthology.lock.ops:Start node 'trial137.front.sepia.ceph.com' reimaging
2026-02-13T23:28:00.587 INFO:teuthology.lock.ops:Updating [trial137.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T23:28:00.587 INFO:teuthology.lock.ops:Updating trial137.front.sepia.ceph.com on lock server
2026-02-13T23:28:00.645 INFO:teuthology.lock.ops:Start node 'trial145.front.sepia.ceph.com' reimaging
2026-02-13T23:28:00.646 INFO:teuthology.lock.ops:Updating [trial145.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T23:28:00.646 INFO:teuthology.lock.ops:Updating trial145.front.sepia.ceph.com on lock server
2026-02-13T23:28:00.878 DEBUG:teuthology.provision.fog.trial137:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T23:28:00.878 DEBUG:teuthology.provision.fog.trial110:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T23:28:00.921 DEBUG:teuthology.provision.fog.trial145:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T23:28:00.926 INFO:teuthology.provision.fog.trial137:Scheduling deploy of centos 9.stream
2026-02-13T23:28:00.932 INFO:teuthology.provision.fog.trial110:Scheduling deploy of centos 9.stream
2026-02-13T23:28:00.973 INFO:teuthology.provision.fog.trial145:Scheduling deploy of centos 9.stream
2026-02-13T23:28:02.136 INFO:teuthology.orchestra.console.trial137:Power off
2026-02-13T23:28:02.136 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:28:02.149 INFO:teuthology.orchestra.console.trial145:Power off
2026-02-13T23:28:02.149 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:28:02.158 INFO:teuthology.orchestra.console.trial110:Power off
2026-02-13T23:28:02.158 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:28:02.174 DEBUG:teuthology.orchestra.console.trial137:power off output: Chassis Power Control: Down/Off
2026-02-13T23:28:02.185 DEBUG:teuthology.orchestra.console.trial145:power off output: Chassis Power Control: Down/Off
2026-02-13T23:28:02.197 DEBUG:teuthology.orchestra.console.trial110:power off output: Chassis Power Control: Down/Off
2026-02-13T23:28:06.179 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:06.186 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:06.198 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:06.288 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is off
2026-02-13T23:28:06.288 INFO:teuthology.orchestra.console.trial137:Power off completed
2026-02-13T23:28:06.294 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is off
2026-02-13T23:28:06.294 INFO:teuthology.orchestra.console.trial145:Power off completed
2026-02-13T23:28:06.305 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-13T23:28:06.305 INFO:teuthology.orchestra.console.trial110:Power off completed
2026-02-13T23:28:06.389 INFO:teuthology.orchestra.console.trial137:Power on
2026-02-13T23:28:06.389 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T23:28:06.398 INFO:teuthology.orchestra.console.trial145:Power on
2026-02-13T23:28:06.399 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T23:28:06.407 INFO:teuthology.orchestra.console.trial110:Power on
2026-02-13T23:28:06.408 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T23:28:06.430 DEBUG:teuthology.orchestra.console.trial137:power on output: Chassis Power Control: Up/On
2026-02-13T23:28:06.439 DEBUG:teuthology.orchestra.console.trial145:power on output: Chassis Power Control: Up/On
2026-02-13T23:28:06.447 DEBUG:teuthology.orchestra.console.trial110:power on output: Chassis Power Control: Up/On
2026-02-13T23:28:10.436 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:10.443 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:10.449 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:10.545 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is off
2026-02-13T23:28:10.551 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is on
2026-02-13T23:28:10.551 INFO:teuthology.orchestra.console.trial145:Power on completed
2026-02-13T23:28:10.558 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is on
2026-02-13T23:28:10.558 INFO:teuthology.orchestra.console.trial110:Power on completed
2026-02-13T23:28:10.652 INFO:teuthology.provision.fog.trial145:Waiting for deploy to finish
2026-02-13T23:28:10.658 INFO:teuthology.provision.fog.trial110:Waiting for deploy to finish
2026-02-13T23:28:14.549 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:28:14.659 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is on
2026-02-13T23:28:14.660 INFO:teuthology.orchestra.console.trial137:Power on completed
2026-02-13T23:28:14.760 INFO:teuthology.provision.fog.trial137:Waiting for deploy to finish
2026-02-13T23:29:58.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:01.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:04.765 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-13T23:30:10.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:13.853 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-13T23:30:19.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:22.941 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-13T23:30:28.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:32.029 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-13T23:30:38.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:41.117 WARNING:teuthology.provision.fog.trial137:[Errno None] Unable to connect to port 22 on 10.20.193.137
2026-02-13T23:30:47.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:30:58.044 WARNING:teuthology.provision.fog.trial145:timed out
2026-02-13T23:30:59.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:02.301 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T23:31:04.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:08.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:11.389 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T23:31:11.417 ERROR:teuthology.orchestra.connection:Error authenticating with trial145.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T23:31:15.622 ERROR:teuthology.orchestra.connection:Error authenticating with trial145.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T23:31:17.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:20.477 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T23:31:22.736 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T23:31:22.737 DEBUG:teuthology.orchestra.run.trial145:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T23:31:22.904 INFO:teuthology.provision.fog.trial145:Node is ready
2026-02-13T23:31:22.904 DEBUG:teuthology.orchestra.run.trial145:> hostname
2026-02-13T23:31:23.035 INFO:teuthology.orchestra.run.trial145.stdout:trial145.front.sepia.ceph.com
2026-02-13T23:31:23.036 DEBUG:teuthology.orchestra.run.trial145:> grep trial145.front.sepia.ceph.com /etc/hosts
2026-02-13T23:31:23.036 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T23:31:23.036 DEBUG:teuthology.orchestra.run.trial137:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T23:31:23.092 INFO:teuthology.orchestra.run.trial145.stdout:10.20.193.145 trial145.front.sepia.ceph.com trial145
2026-02-13T23:31:23.092 DEBUG:teuthology.orchestra.run.trial145:> sudo hostname trial145
2026-02-13T23:31:23.163 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/trial145.front.sepia.ceph.com/trial145/g' /etc/hosts
2026-02-13T23:31:23.228 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/10.20.193.145/10.20.193.145/g' /etc/hosts
2026-02-13T23:31:23.293 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/trial145.front.sepia.ceph.com/trial145/g' /etc/hostname
2026-02-13T23:31:23.356 DEBUG:teuthology.orchestra.run.trial145:> sudo hostname trial145
2026-02-13T23:31:23.421 DEBUG:teuthology.orchestra.run.trial145:> cat /etc/os-release
2026-02-13T23:31:23.454 INFO:teuthology.provision.fog.trial137:Node is ready
2026-02-13T23:31:23.455 DEBUG:teuthology.orchestra.run.trial137:> hostname
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:NAME="CentOS Stream"
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:VERSION="9"
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:ID="centos"
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:VERSION_ID="9"
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:ANSI_COLOR="0;31"
2026-02-13T23:31:23.478 INFO:teuthology.orchestra.run.trial145.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:31:23.479 INFO:teuthology.orchestra.run.trial145.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:31:23.479 INFO:teuthology.orchestra.run.trial145.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:31:23.479 INFO:teuthology.orchestra.run.trial145.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:31:23.479 INFO:teuthology.orchestra.run.trial145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:31:23.479 INFO:teuthology.orchestra.run.trial145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:31:23.480 INFO:teuthology.provision.fog.trial145:Deploy complete!
2026-02-13T23:31:23.481 DEBUG:teuthology.parallel:result is None
2026-02-13T23:31:23.507 INFO:teuthology.orchestra.run.trial137.stdout:trial137.front.sepia.ceph.com
2026-02-13T23:31:23.508 DEBUG:teuthology.orchestra.run.trial137:> grep trial137.front.sepia.ceph.com /etc/hosts
2026-02-13T23:31:23.561 INFO:teuthology.orchestra.run.trial137.stdout:10.20.193.137 trial137.front.sepia.ceph.com trial137
2026-02-13T23:31:23.562 DEBUG:teuthology.orchestra.run.trial137:> sudo hostname trial137
2026-02-13T23:31:23.630 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/trial137.front.sepia.ceph.com/trial137/g' /etc/hosts
2026-02-13T23:31:23.692 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/10.20.193.137/10.20.193.137/g' /etc/hosts
2026-02-13T23:31:23.753 DEBUG:teuthology.orchestra.run.trial137:> sudo sed -i -e 's/trial137.front.sepia.ceph.com/trial137/g' /etc/hostname
2026-02-13T23:31:23.815 DEBUG:teuthology.orchestra.run.trial137:> sudo hostname trial137
2026-02-13T23:31:23.875 DEBUG:teuthology.orchestra.run.trial137:> cat /etc/os-release
2026-02-13T23:31:23.929 INFO:teuthology.orchestra.run.trial137.stdout:NAME="CentOS Stream"
2026-02-13T23:31:23.929 INFO:teuthology.orchestra.run.trial137.stdout:VERSION="9"
2026-02-13T23:31:23.929 INFO:teuthology.orchestra.run.trial137.stdout:ID="centos"
2026-02-13T23:31:23.929 INFO:teuthology.orchestra.run.trial137.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:31:23.929 INFO:teuthology.orchestra.run.trial137.stdout:VERSION_ID="9"
2026-02-13T23:31:23.929 INFO:teuthology.orchestra.run.trial137.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:31:23.929 INFO:teuthology.orchestra.run.trial137.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:31:23.930 INFO:teuthology.orchestra.run.trial137.stdout:ANSI_COLOR="0;31"
2026-02-13T23:31:23.930 INFO:teuthology.orchestra.run.trial137.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:31:23.930 INFO:teuthology.orchestra.run.trial137.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:31:23.930 INFO:teuthology.orchestra.run.trial137.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:31:23.930 INFO:teuthology.orchestra.run.trial137.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:31:23.930 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:31:23.930 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:31:23.931 INFO:teuthology.provision.fog.trial137:Deploy complete!
2026-02-13T23:31:23.931 DEBUG:teuthology.parallel:result is None
2026-02-13T23:31:26.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:31:29.565 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T23:31:35.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:32:11.686 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T23:32:11.686 DEBUG:teuthology.orchestra.run.trial110:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T23:32:11.854 INFO:teuthology.provision.fog.trial110:Node is ready
2026-02-13T23:32:11.854 DEBUG:teuthology.orchestra.run.trial110:> hostname
2026-02-13T23:32:11.911 INFO:teuthology.orchestra.run.trial110.stdout:trial110.front.sepia.ceph.com
2026-02-13T23:32:11.911 DEBUG:teuthology.orchestra.run.trial110:> grep trial110.front.sepia.ceph.com /etc/hosts
2026-02-13T23:32:11.968 INFO:teuthology.orchestra.run.trial110.stdout:10.20.193.110 trial110.front.sepia.ceph.com trial110
2026-02-13T23:32:11.968 DEBUG:teuthology.orchestra.run.trial110:> sudo hostname trial110
2026-02-13T23:32:12.036 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/trial110.front.sepia.ceph.com/trial110/g' /etc/hosts
2026-02-13T23:32:12.101 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/10.20.193.110/10.20.193.110/g' /etc/hosts
2026-02-13T23:32:12.166 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/trial110.front.sepia.ceph.com/trial110/g' /etc/hostname
2026-02-13T23:32:12.230 DEBUG:teuthology.orchestra.run.trial110:> sudo hostname trial110
2026-02-13T23:32:12.296 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:NAME="CentOS Stream"
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="9"
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:ID="centos"
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="9"
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:12.352 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:12.353 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:12.353 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:12.353 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:12.353 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:12.353 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:12.353 INFO:teuthology.provision.fog.trial110:Deploy complete!
2026-02-13T23:32:12.354 DEBUG:teuthology.parallel:result is None
2026-02-13T23:32:12.890 INFO:teuthology.lock.ops:Checking trial110.front.sepia.ceph.com
2026-02-13T23:32:12.890 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T23:32:12.991 INFO:teuthology.lock.ops:Checking trial137.front.sepia.ceph.com
2026-02-13T23:32:12.992 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T23:32:13.061 INFO:teuthology.lock.ops:Checking trial145.front.sepia.ceph.com
2026-02-13T23:32:13.061 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T23:32:13.119 INFO:teuthology.lock.ops:Updating [trial110.front.sepia.ceph.com]: set os type and version on server
2026-02-13T23:32:13.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial110.front.sepia.ceph.com'
2026-02-13T23:32:13.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:32:13.185 DEBUG:teuthology.orchestra.run.trial110:> true
2026-02-13T23:32:13.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial110.front.sepia.ceph.com'
2026-02-13T23:32:13.262 DEBUG:teuthology.orchestra.run.trial110:> uname -m
2026-02-13T23:32:13.318 INFO:teuthology.orchestra.run.trial110.stdout:x86_64
2026-02-13T23:32:13.318 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release
2026-02-13T23:32:13.373 INFO:teuthology.orchestra.run.trial110.stdout:NAME="CentOS Stream"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="9"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:ID="centos"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="9"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:13.374 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:13.375 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:13.375 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:13.375 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server
2026-02-13T23:32:13.479 INFO:teuthology.lock.ops:Updating [trial137.front.sepia.ceph.com]: set os type and version on server
2026-02-13T23:32:13.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial137.front.sepia.ceph.com'
2026-02-13T23:32:13.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:32:13.547 DEBUG:teuthology.orchestra.run.trial137:> true
2026-02-13T23:32:13.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial137.front.sepia.ceph.com'
2026-02-13T23:32:13.695 DEBUG:teuthology.orchestra.run.trial137:> uname -m
2026-02-13T23:32:13.752 INFO:teuthology.orchestra.run.trial137.stdout:x86_64
2026-02-13T23:32:13.752 DEBUG:teuthology.orchestra.run.trial137:> cat /etc/os-release
2026-02-13T23:32:13.808 INFO:teuthology.orchestra.run.trial137.stdout:NAME="CentOS Stream"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:VERSION="9"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:ID="centos"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:VERSION_ID="9"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:13.809 INFO:teuthology.orchestra.run.trial137.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:13.810 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:13.810 INFO:teuthology.orchestra.run.trial137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:13.810 INFO:teuthology.lock.ops:Updating trial137.front.sepia.ceph.com on lock server
2026-02-13T23:32:13.916 INFO:teuthology.lock.ops:Updating [trial145.front.sepia.ceph.com]: set os type and version on server
2026-02-13T23:32:13.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial145.front.sepia.ceph.com'
2026-02-13T23:32:13.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T23:32:13.988 DEBUG:teuthology.orchestra.run.trial145:> true
2026-02-13T23:32:14.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial145.front.sepia.ceph.com'
2026-02-13T23:32:14.061 DEBUG:teuthology.orchestra.run.trial145:> uname -m
2026-02-13T23:32:14.119 INFO:teuthology.orchestra.run.trial145.stdout:x86_64
2026-02-13T23:32:14.120 DEBUG:teuthology.orchestra.run.trial145:> cat /etc/os-release
2026-02-13T23:32:14.176 INFO:teuthology.orchestra.run.trial145.stdout:NAME="CentOS Stream"
2026-02-13T23:32:14.176 INFO:teuthology.orchestra.run.trial145.stdout:VERSION="9"
2026-02-13T23:32:14.176 INFO:teuthology.orchestra.run.trial145.stdout:ID="centos"
2026-02-13T23:32:14.176 INFO:teuthology.orchestra.run.trial145.stdout:ID_LIKE="rhel fedora"
2026-02-13T23:32:14.176 INFO:teuthology.orchestra.run.trial145.stdout:VERSION_ID="9"
2026-02-13T23:32:14.176 INFO:teuthology.orchestra.run.trial145.stdout:PLATFORM_ID="platform:el9"
2026-02-13T23:32:14.177 INFO:teuthology.orchestra.run.trial145.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T23:32:14.177 INFO:teuthology.orchestra.run.trial145.stdout:ANSI_COLOR="0;31"
2026-02-13T23:32:14.177 INFO:teuthology.orchestra.run.trial145.stdout:LOGO="fedora-logo-icon"
2026-02-13T23:32:14.177 INFO:teuthology.orchestra.run.trial145.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T23:32:14.177 INFO:teuthology.orchestra.run.trial145.stdout:HOME_URL="https://centos.org/"
2026-02-13T23:32:14.177 INFO:teuthology.orchestra.run.trial145.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T23:32:14.177 INFO:teuthology.orchestra.run.trial145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T23:32:14.177 INFO:teuthology.orchestra.run.trial145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T23:32:14.178 INFO:teuthology.lock.ops:Updating trial145.front.sepia.ceph.com on lock server
2026-02-13T23:32:14.290 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:32:14.376 INFO:teuthology.dispatcher.supervisor:Running job 50022
2026-02-13T23:32:14.376 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50022 --name pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/misc}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50022/orig.config.yaml
2026-02-13T23:32:14.376 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_19:09:57-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/50022
2026-02-13T23:32:14.376 INFO:teuthology.dispatcher.supervisor:Job PID: 769049
2026-02-13T23:32:14.376 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T23:34:14.476 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:36:14.633 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:38:14.821 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:40:15.002 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:42:15.185 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:44:15.365 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:46:15.551 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:48:15.715 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:50:15.917 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:52:16.073 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T23:52:16.166 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T23:52:16.342 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T23:52:17.097 INFO:teuthology.orchestra.console.trial110:Power off
2026-02-13T23:52:17.097 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:52:17.110 INFO:teuthology.orchestra.console.trial145:Power off
2026-02-13T23:52:17.110 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:52:17.122 INFO:teuthology.orchestra.console.trial137:Power off
2026-02-13T23:52:17.122 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T23:52:17.135 DEBUG:teuthology.orchestra.console.trial110:power off output: Chassis Power Control: Down/Off
2026-02-13T23:52:17.150 DEBUG:teuthology.orchestra.console.trial145:power off output: Chassis Power Control: Down/Off
2026-02-13T23:52:17.163 DEBUG:teuthology.orchestra.console.trial137:power off output: Chassis Power Control: Down/Off
2026-02-13T23:52:21.140 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:21.150 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:21.164 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:21.249 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is on
2026-02-13T23:52:21.259 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is on
2026-02-13T23:52:21.272 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is on
2026-02-13T23:52:25.255 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:25.264 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:25.273 DEBUG:teuthology.orchestra.console.trial137:pexpect command: ipmitool -H trial137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T23:52:25.365 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-13T23:52:25.366 INFO:teuthology.orchestra.console.trial110:Power off completed
2026-02-13T23:52:25.374 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is off
2026-02-13T23:52:25.374 INFO:teuthology.orchestra.console.trial145:Power off completed
2026-02-13T23:52:25.382 DEBUG:teuthology.orchestra.console.trial137:check power output: Chassis Power is off
2026-02-13T23:52:25.382 INFO:teuthology.orchestra.console.trial137:Power off completed
2026-02-13T23:52:25.657 INFO:teuthology.lock.ops:unlocked: trial110.front.sepia.ceph.com
2026-02-13T23:52:25.666 INFO:teuthology.lock.ops:unlocked: trial145.front.sepia.ceph.com
2026-02-13T23:52:25.670 INFO:teuthology.lock.ops:unlocked: trial137.front.sepia.ceph.com