2026-02-13T21:20:28.516 INFO:root:teuthology version: 1.2.4.dev6+g76f36e686
2026-02-13T21:20:28.516 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:20:28.589 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:20:28.845 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x721e768aae70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x721e760b1620>, signals=[15])
2026-02-13T21:20:28.845 INFO:teuthology.lock.ops:Start node 'trial080.front.sepia.ceph.com' reimaging
2026-02-13T21:20:28.845 INFO:teuthology.lock.ops:Updating [trial080.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T21:20:28.845 INFO:teuthology.lock.ops:Updating trial080.front.sepia.ceph.com on lock server
2026-02-13T21:20:28.902 INFO:teuthology.lock.ops:Start node 'trial110.front.sepia.ceph.com' reimaging
2026-02-13T21:20:28.903 INFO:teuthology.lock.ops:Updating [trial110.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T21:20:28.903 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server
2026-02-13T21:20:28.960 INFO:teuthology.lock.ops:Start node 'trial191.front.sepia.ceph.com' reimaging
2026-02-13T21:20:28.960 INFO:teuthology.lock.ops:Updating [trial191.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T21:20:28.960 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server
2026-02-13T21:20:29.192 DEBUG:teuthology.provision.fog.trial080:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T21:20:29.192 DEBUG:teuthology.provision.fog.trial110:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T21:20:29.220 INFO:teuthology.provision.fog.trial110:Scheduling deploy of centos 9.stream
2026-02-13T21:20:29.245 INFO:teuthology.provision.fog.trial080:Scheduling deploy of centos 9.stream
2026-02-13T21:20:29.262 DEBUG:teuthology.provision.fog.trial191:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T21:20:29.320 INFO:teuthology.provision.fog.trial191:Scheduling deploy of centos 9.stream
2026-02-13T21:20:30.473 INFO:teuthology.orchestra.console.trial080:Power off
2026-02-13T21:20:30.473 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T21:20:30.493 INFO:teuthology.orchestra.console.trial110:Power off
2026-02-13T21:20:30.493 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T21:20:30.504 INFO:teuthology.orchestra.console.trial191:Power off
2026-02-13T21:20:30.504 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T21:20:30.512 DEBUG:teuthology.orchestra.console.trial080:power off output: Chassis Power Control: Down/Off
2026-02-13T21:20:30.530 DEBUG:teuthology.orchestra.console.trial110:power off output: Chassis Power Control: Down/Off
2026-02-13T21:20:30.543 DEBUG:teuthology.orchestra.console.trial191:power off output: Chassis Power Control: Down/Off
2026-02-13T21:20:34.514 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:20:34.531 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:20:34.544 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:20:34.623 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is off
2026-02-13T21:20:34.623 INFO:teuthology.orchestra.console.trial080:Power off completed
2026-02-13T21:20:34.640 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-13T21:20:34.640 INFO:teuthology.orchestra.console.trial110:Power off completed
2026-02-13T21:20:34.652 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off
2026-02-13T21:20:34.652 INFO:teuthology.orchestra.console.trial191:Power off completed
2026-02-13T21:20:34.724 INFO:teuthology.orchestra.console.trial080:Power on
2026-02-13T21:20:34.725 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T21:20:34.742 INFO:teuthology.orchestra.console.trial110:Power on
2026-02-13T21:20:34.742 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T21:20:34.753 INFO:teuthology.orchestra.console.trial191:Power on
2026-02-13T21:20:34.753 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T21:20:34.765 DEBUG:teuthology.orchestra.console.trial080:power on output: Chassis Power Control: Up/On
2026-02-13T21:20:34.782 DEBUG:teuthology.orchestra.console.trial110:power on output: Chassis Power Control: Up/On
2026-02-13T21:20:34.793 DEBUG:teuthology.orchestra.console.trial191:power on output: Chassis Power Control: Up/On
2026-02-13T21:20:38.770 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:20:38.783 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:20:38.795 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:20:38.881 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is off
2026-02-13T21:20:38.895 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-13T21:20:38.905 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is on
2026-02-13T21:20:38.905 INFO:teuthology.orchestra.console.trial191:Power on completed
2026-02-13T21:20:39.005 INFO:teuthology.provision.fog.trial191:Waiting for deploy to finish
2026-02-13T21:20:42.886 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:20:42.896 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:20:42.997 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is on
2026-02-13T21:20:42.997 INFO:teuthology.orchestra.console.trial080:Power on completed
2026-02-13T21:20:43.005 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is on
2026-02-13T21:20:43.005 INFO:teuthology.orchestra.console.trial110:Power on completed
2026-02-13T21:20:43.098 INFO:teuthology.provision.fog.trial080:Waiting for deploy to finish
2026-02-13T21:20:43.106 INFO:teuthology.provision.fog.trial110:Waiting for deploy to finish
2026-02-13T21:22:26.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:22:26.753 ERROR:teuthology.orchestra.connection:Error authenticating with trial191.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-13T21:22:30.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:22:30.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:22:33.629 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-13T21:22:33.629 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T21:22:39.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:22:39.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:22:42.717 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-13T21:22:42.717 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T21:22:48.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:22:48.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:22:51.806 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-13T21:22:51.806 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T21:22:57.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:22:57.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:23:00.893 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-13T21:23:00.893 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T21:23:06.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:23:06.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:23:09.981 WARNING:teuthology.provision.fog.trial080:[Errno None] Unable to connect to port 22 on 10.20.193.80
2026-02-13T21:23:09.981 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T21:23:15.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:23:15.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:23:19.069 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-13T21:23:25.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:23:30.757 WARNING:teuthology.provision.fog.trial191:timed out
2026-02-13T21:23:36.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:23:41.032 ERROR:teuthology.orchestra.connection:Error authenticating with trial191.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T21:23:45.149 ERROR:teuthology.orchestra.connection:Error authenticating with trial191.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T21:23:52.241 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T21:23:52.241 DEBUG:teuthology.orchestra.run.trial080:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T21:23:52.255 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T21:23:52.255 DEBUG:teuthology.orchestra.run.trial191:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T21:23:52.371 INFO:teuthology.provision.fog.trial080:Node is ready
2026-02-13T21:23:52.372 DEBUG:teuthology.orchestra.run.trial080:> hostname
2026-02-13T21:23:52.414 INFO:teuthology.provision.fog.trial191:Node is ready
2026-02-13T21:23:52.415 DEBUG:teuthology.orchestra.run.trial191:> hostname
2026-02-13T21:23:52.427 INFO:teuthology.orchestra.run.trial080.stdout:trial080.front.sepia.ceph.com
2026-02-13T21:23:52.428 DEBUG:teuthology.orchestra.run.trial080:> grep trial080.front.sepia.ceph.com /etc/hosts
2026-02-13T21:23:52.475 INFO:teuthology.orchestra.run.trial191.stdout:trial191.front.sepia.ceph.com
2026-02-13T21:23:52.475 DEBUG:teuthology.orchestra.run.trial191:> grep trial191.front.sepia.ceph.com /etc/hosts
2026-02-13T21:23:52.484 INFO:teuthology.orchestra.run.trial080.stdout:10.20.193.80 trial080.front.sepia.ceph.com trial080
2026-02-13T21:23:52.485 DEBUG:teuthology.orchestra.run.trial080:> sudo hostname trial080
2026-02-13T21:23:52.535 INFO:teuthology.orchestra.run.trial191.stdout:10.20.193.191 trial191.front.sepia.ceph.com trial191
2026-02-13T21:23:52.535 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname trial191
2026-02-13T21:23:52.555 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/trial080.front.sepia.ceph.com/trial080/g' /etc/hosts
2026-02-13T21:23:52.606 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/trial191.front.sepia.ceph.com/trial191/g' /etc/hosts
2026-02-13T21:23:52.619 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/10.20.193.80/10.20.193.80/g' /etc/hosts
2026-02-13T21:23:52.672 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/10.20.193.191/10.20.193.191/g' /etc/hosts
2026-02-13T21:23:52.682 DEBUG:teuthology.orchestra.run.trial080:> sudo sed -i -e 's/trial080.front.sepia.ceph.com/trial080/g' /etc/hostname
2026-02-13T21:23:52.736 DEBUG:teuthology.orchestra.run.trial191:> sudo sed -i -e 's/trial191.front.sepia.ceph.com/trial191/g' /etc/hostname
2026-02-13T21:23:52.748 DEBUG:teuthology.orchestra.run.trial080:> sudo hostname trial080
2026-02-13T21:23:52.801 DEBUG:teuthology.orchestra.run.trial191:> sudo hostname trial191
2026-02-13T21:23:52.811 DEBUG:teuthology.orchestra.run.trial080:> cat /etc/os-release
2026-02-13T21:23:52.865 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release
2026-02-13T21:23:52.867 INFO:teuthology.orchestra.run.trial080.stdout:NAME="CentOS Stream"
2026-02-13T21:23:52.867 INFO:teuthology.orchestra.run.trial080.stdout:VERSION="9"
2026-02-13T21:23:52.867 INFO:teuthology.orchestra.run.trial080.stdout:ID="centos"
2026-02-13T21:23:52.867 INFO:teuthology.orchestra.run.trial080.stdout:ID_LIKE="rhel fedora"
2026-02-13T21:23:52.867 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_ID="9"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:PLATFORM_ID="platform:el9"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:ANSI_COLOR="0;31"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:LOGO="fedora-logo-icon"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:HOME_URL="https://centos.org/"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T21:23:52.868 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T21:23:52.870 INFO:teuthology.provision.fog.trial080:Deploy complete!
2026-02-13T21:23:52.871 DEBUG:teuthology.parallel:result is None
2026-02-13T21:23:52.921 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream"
2026-02-13T21:23:52.921 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9"
2026-02-13T21:23:52.921 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos"
2026-02-13T21:23:52.921 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T21:23:52.922 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T21:23:52.923 INFO:teuthology.provision.fog.trial191:Deploy complete!
2026-02-13T21:23:52.924 DEBUG:teuthology.parallel:result is None
2026-02-13T21:24:00.915 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T21:24:00.916 DEBUG:teuthology.orchestra.run.trial110:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T21:24:01.159 INFO:teuthology.provision.fog.trial110:Node is ready
2026-02-13T21:24:01.159 DEBUG:teuthology.orchestra.run.trial110:> hostname
2026-02-13T21:24:01.215 INFO:teuthology.orchestra.run.trial110.stdout:trial110.front.sepia.ceph.com
2026-02-13T21:24:01.215 DEBUG:teuthology.orchestra.run.trial110:> grep trial110.front.sepia.ceph.com /etc/hosts
2026-02-13T21:24:01.272 INFO:teuthology.orchestra.run.trial110.stdout:10.20.193.110 trial110.front.sepia.ceph.com trial110
2026-02-13T21:24:01.272 DEBUG:teuthology.orchestra.run.trial110:> sudo hostname trial110
2026-02-13T21:24:01.342 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/trial110.front.sepia.ceph.com/trial110/g' /etc/hosts
2026-02-13T21:24:01.408 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/10.20.193.110/10.20.193.110/g' /etc/hosts
2026-02-13T21:24:01.474 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/trial110.front.sepia.ceph.com/trial110/g' /etc/hostname
2026-02-13T21:24:01.559 DEBUG:teuthology.orchestra.run.trial110:> sudo hostname trial110
2026-02-13T21:24:01.667 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release
2026-02-13T21:24:01.711 INFO:teuthology.orchestra.run.trial110.stdout:NAME="CentOS Stream"
2026-02-13T21:24:01.711 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="9"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:ID="centos"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel fedora"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="9"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el9"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;31"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://centos.org/"
2026-02-13T21:24:01.712 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T21:24:01.713 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T21:24:01.713 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T21:24:01.713 INFO:teuthology.provision.fog.trial110:Deploy complete!
2026-02-13T21:24:01.714 DEBUG:teuthology.parallel:result is None
2026-02-13T21:24:02.245 INFO:teuthology.lock.ops:Checking trial080.front.sepia.ceph.com
2026-02-13T21:24:02.245 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T21:24:02.350 INFO:teuthology.lock.ops:Checking trial110.front.sepia.ceph.com
2026-02-13T21:24:02.350 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T21:24:02.414 INFO:teuthology.lock.ops:Checking trial191.front.sepia.ceph.com
2026-02-13T21:24:02.415 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T21:24:02.472 INFO:teuthology.lock.ops:Updating [trial080.front.sepia.ceph.com]: set os type and version on server
2026-02-13T21:24:02.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial080.front.sepia.ceph.com'
2026-02-13T21:24:02.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:24:02.533 DEBUG:teuthology.orchestra.run.trial080:> true
2026-02-13T21:24:02.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial080.front.sepia.ceph.com'
2026-02-13T21:24:02.611 DEBUG:teuthology.orchestra.run.trial080:> uname -m
2026-02-13T21:24:02.666 INFO:teuthology.orchestra.run.trial080.stdout:x86_64
2026-02-13T21:24:02.667 DEBUG:teuthology.orchestra.run.trial080:> cat /etc/os-release
2026-02-13T21:24:02.723 INFO:teuthology.orchestra.run.trial080.stdout:NAME="CentOS Stream"
2026-02-13T21:24:02.723 INFO:teuthology.orchestra.run.trial080.stdout:VERSION="9"
2026-02-13T21:24:02.723 INFO:teuthology.orchestra.run.trial080.stdout:ID="centos"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:ID_LIKE="rhel fedora"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:VERSION_ID="9"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:PLATFORM_ID="platform:el9"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:ANSI_COLOR="0;31"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:LOGO="fedora-logo-icon"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:HOME_URL="https://centos.org/"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T21:24:02.724 INFO:teuthology.orchestra.run.trial080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T21:24:02.725 INFO:teuthology.lock.ops:Updating trial080.front.sepia.ceph.com on lock server
2026-02-13T21:24:02.828 INFO:teuthology.lock.ops:Updating [trial110.front.sepia.ceph.com]: set os type and version on server
2026-02-13T21:24:02.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial110.front.sepia.ceph.com'
2026-02-13T21:24:02.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:24:02.897 DEBUG:teuthology.orchestra.run.trial110:> true
2026-02-13T21:24:02.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial110.front.sepia.ceph.com'
2026-02-13T21:24:02.974 DEBUG:teuthology.orchestra.run.trial110:> uname -m
2026-02-13T21:24:03.030 INFO:teuthology.orchestra.run.trial110.stdout:x86_64
2026-02-13T21:24:03.030 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release
2026-02-13T21:24:03.086 INFO:teuthology.orchestra.run.trial110.stdout:NAME="CentOS Stream"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="9"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:ID="centos"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel fedora"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="9"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el9"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;31"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon"
2026-02-13T21:24:03.087 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T21:24:03.088 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://centos.org/"
2026-02-13T21:24:03.088 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T21:24:03.088 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T21:24:03.088 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T21:24:03.088 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server
2026-02-13T21:24:03.197 INFO:teuthology.lock.ops:Updating [trial191.front.sepia.ceph.com]: set os type and version on server
2026-02-13T21:24:03.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial191.front.sepia.ceph.com'
2026-02-13T21:24:03.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T21:24:03.262 DEBUG:teuthology.orchestra.run.trial191:> true
2026-02-13T21:24:03.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial191.front.sepia.ceph.com'
2026-02-13T21:24:03.407 DEBUG:teuthology.orchestra.run.trial191:> uname -m
2026-02-13T21:24:03.463 INFO:teuthology.orchestra.run.trial191.stdout:x86_64
2026-02-13T21:24:03.463 DEBUG:teuthology.orchestra.run.trial191:> cat /etc/os-release
2026-02-13T21:24:03.519 INFO:teuthology.orchestra.run.trial191.stdout:NAME="CentOS Stream"
2026-02-13T21:24:03.519 INFO:teuthology.orchestra.run.trial191.stdout:VERSION="9"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:ID="centos"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:ID_LIKE="rhel fedora"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:VERSION_ID="9"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:PLATFORM_ID="platform:el9"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:ANSI_COLOR="0;31"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:LOGO="fedora-logo-icon"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:HOME_URL="https://centos.org/"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T21:24:03.520 INFO:teuthology.orchestra.run.trial191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T21:24:03.521 INFO:teuthology.lock.ops:Updating trial191.front.sepia.ceph.com on lock server
2026-02-13T21:24:03.625 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:24:03.722 INFO:teuthology.dispatcher.supervisor:Running job 50113
2026-02-13T21:24:03.722 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_76f36e6865be4ddcb29d455f126a084282247ea4/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50113 --name pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50113/orig.config.yaml
2026-02-13T21:24:03.723 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_20:31:39-fs-wip-jcollin-testing-20260213.155635-tentacle-distro-default-trial/50113
2026-02-13T21:24:03.723 INFO:teuthology.dispatcher.supervisor:Job PID: 46761
2026-02-13T21:24:03.723 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T21:26:03.723 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:28:03.856 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:30:03.971 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:32:04.054 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:34:04.180 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:36:04.281 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:38:04.361 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:40:04.482 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:42:04.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T21:42:04.730 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T21:42:04.909 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T21:42:05.636 INFO:teuthology.orchestra.console.trial110:Power off
2026-02-13T21:42:05.636 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T21:42:05.648 INFO:teuthology.orchestra.console.trial080:Power off
2026-02-13T21:42:05.648 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T21:42:05.657 INFO:teuthology.orchestra.console.trial191:Power off
2026-02-13T21:42:05.657 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T21:42:05.675 DEBUG:teuthology.orchestra.console.trial110:power off output: Chassis Power Control: Down/Off
2026-02-13T21:42:05.687 DEBUG:teuthology.orchestra.console.trial080:power off output: Chassis Power Control: Down/Off
2026-02-13T21:42:05.696 DEBUG:teuthology.orchestra.console.trial191:power off output: Chassis Power Control: Down/Off
2026-02-13T21:42:09.675 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:42:09.689 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:42:09.697 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:42:09.785 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is on
2026-02-13T21:42:09.798 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is on
2026-02-13T21:42:09.807 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is on
2026-02-13T21:42:13.786 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:42:13.799 DEBUG:teuthology.orchestra.console.trial080:pexpect command: ipmitool -H trial080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:42:13.808 DEBUG:teuthology.orchestra.console.trial191:pexpect command: ipmitool -H trial191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T21:42:13.897 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-13T21:42:13.898 INFO:teuthology.orchestra.console.trial110:Power off completed
2026-02-13T21:42:13.909 DEBUG:teuthology.orchestra.console.trial080:check power output: Chassis Power is off
2026-02-13T21:42:13.909 INFO:teuthology.orchestra.console.trial080:Power off completed
2026-02-13T21:42:13.918 DEBUG:teuthology.orchestra.console.trial191:check power output: Chassis Power is off
2026-02-13T21:42:13.918 INFO:teuthology.orchestra.console.trial191:Power off completed
2026-02-13T21:42:14.159 INFO:teuthology.lock.ops:unlocked: trial110.front.sepia.ceph.com
2026-02-13T21:42:14.169 INFO:teuthology.lock.ops:unlocked: trial080.front.sepia.ceph.com
2026-02-13T21:42:14.177 INFO:teuthology.lock.ops:unlocked: trial191.front.sepia.ceph.com