2026-02-14T01:23:37.463 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-14T01:23:37.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:23:37.537 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:23:37.804 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7353c365dac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7353c2ea04a0>, signals=[15])
2026-02-14T01:23:37.804 INFO:teuthology.lock.ops:Start node 'trial044.front.sepia.ceph.com' reimaging
2026-02-14T01:23:37.804 INFO:teuthology.lock.ops:Updating [trial044.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:23:37.804 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server
2026-02-14T01:23:37.873 INFO:teuthology.lock.ops:Start node 'trial102.front.sepia.ceph.com' reimaging
2026-02-14T01:23:37.873 INFO:teuthology.lock.ops:Updating [trial102.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:23:37.873 INFO:teuthology.lock.ops:Updating trial102.front.sepia.ceph.com on lock server
2026-02-14T01:23:37.938 INFO:teuthology.lock.ops:Start node 'trial124.front.sepia.ceph.com' reimaging
2026-02-14T01:23:37.938 INFO:teuthology.lock.ops:Updating [trial124.front.sepia.ceph.com]: reset os type and version on server
2026-02-14T01:23:37.938 INFO:teuthology.lock.ops:Updating trial124.front.sepia.ceph.com on lock server
2026-02-14T01:23:38.116 DEBUG:teuthology.provision.fog.trial102:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:23:38.176 INFO:teuthology.provision.fog.trial102:Scheduling deploy of centos 9.stream
2026-02-14T01:23:38.176 DEBUG:teuthology.provision.fog.trial044:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:23:38.228 INFO:teuthology.provision.fog.trial044:Scheduling deploy of centos 9.stream
2026-02-14T01:23:38.233 DEBUG:teuthology.provision.fog.trial124:Requesting image trial_centos_9.stream (ID 3)
2026-02-14T01:23:38.285 INFO:teuthology.provision.fog.trial124:Scheduling deploy of centos 9.stream
2026-02-14T01:23:39.326 INFO:teuthology.orchestra.console.trial102:Power off
2026-02-14T01:23:39.326 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:23:39.390 INFO:teuthology.orchestra.console.trial044:Power off
2026-02-14T01:23:39.391 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:23:39.396 DEBUG:teuthology.orchestra.console.trial102:power off output: Chassis Power Control: Down/Off
2026-02-14T01:23:39.409 INFO:teuthology.orchestra.console.trial124:Power off
2026-02-14T01:23:39.409 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:23:39.428 DEBUG:teuthology.orchestra.console.trial044:power off output: Chassis Power Control: Down/Off
2026-02-14T01:23:39.447 DEBUG:teuthology.orchestra.console.trial124:power off output: Chassis Power Control: Down/Off
2026-02-14T01:23:43.400 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:23:43.429 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:23:43.448 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:23:43.510 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is off
2026-02-14T01:23:43.510 INFO:teuthology.orchestra.console.trial102:Power off completed
2026-02-14T01:23:43.538 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-14T01:23:43.538 INFO:teuthology.orchestra.console.trial044:Power off completed
2026-02-14T01:23:43.557 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is off
2026-02-14T01:23:43.557 INFO:teuthology.orchestra.console.trial124:Power off completed
2026-02-14T01:23:43.611 INFO:teuthology.orchestra.console.trial102:Power on
2026-02-14T01:23:43.611 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:23:43.639 INFO:teuthology.orchestra.console.trial044:Power on
2026-02-14T01:23:43.640 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:23:43.653 DEBUG:teuthology.orchestra.console.trial102:power on output: Chassis Power Control: Up/On
2026-02-14T01:23:43.658 INFO:teuthology.orchestra.console.trial124:Power on
2026-02-14T01:23:43.658 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-14T01:23:43.680 DEBUG:teuthology.orchestra.console.trial044:power on output: Chassis Power Control: Up/On
2026-02-14T01:23:43.698 DEBUG:teuthology.orchestra.console.trial124:power on output: Chassis Power Control: Up/On
2026-02-14T01:23:47.658 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:23:47.681 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:23:47.700 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:23:47.768 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is on
2026-02-14T01:23:47.768 INFO:teuthology.orchestra.console.trial102:Power on completed
2026-02-14T01:23:47.790 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-14T01:23:47.811 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is on
2026-02-14T01:23:47.811 INFO:teuthology.orchestra.console.trial124:Power on completed
2026-02-14T01:23:47.870 INFO:teuthology.provision.fog.trial102:Waiting for deploy to finish
2026-02-14T01:23:47.912 INFO:teuthology.provision.fog.trial124:Waiting for deploy to finish
2026-02-14T01:23:51.795 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:23:51.907 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is on
2026-02-14T01:23:51.908 INFO:teuthology.orchestra.console.trial044:Power on completed
2026-02-14T01:23:52.008 INFO:teuthology.provision.fog.trial044:Waiting for deploy to finish
2026-02-14T01:25:35.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:35.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:35.263 ERROR:teuthology.orchestra.connection:Error authenticating with trial102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-14T01:25:38.205 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-14T01:25:38.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:42.045 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-14T01:25:44.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:47.293 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-14T01:25:48.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:51.133 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-14T01:25:53.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:25:56.381 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-14T01:25:57.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:00.221 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-14T01:26:02.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:05.469 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-14T01:26:06.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:09.309 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-14T01:26:11.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:14.557 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-14T01:26:15.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:18.397 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-14T01:26:20.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:24.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:39.266 WARNING:teuthology.provision.fog.trial102:timed out
2026-02-14T01:26:45.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:26:48.621 ERROR:teuthology.orchestra.connection:Error authenticating with trial102.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T01:26:52.734 ERROR:teuthology.orchestra.connection:Error authenticating with trial102.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-14T01:26:56.544 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:26:56.544 DEBUG:teuthology.orchestra.run.trial124:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:26:59.847 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:26:59.847 DEBUG:teuthology.orchestra.run.trial102:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:27:00.005 INFO:teuthology.provision.fog.trial102:Node is ready
2026-02-14T01:27:00.005 DEBUG:teuthology.orchestra.run.trial102:> hostname
2026-02-14T01:27:00.062 INFO:teuthology.orchestra.run.trial102.stdout:trial102.front.sepia.ceph.com
2026-02-14T01:27:00.063 DEBUG:teuthology.orchestra.run.trial102:> grep trial102.front.sepia.ceph.com /etc/hosts
2026-02-14T01:27:00.119 INFO:teuthology.orchestra.run.trial102.stdout:10.20.193.102 trial102.front.sepia.ceph.com trial102
2026-02-14T01:27:00.119 DEBUG:teuthology.orchestra.run.trial102:> sudo hostname trial102
2026-02-14T01:27:00.187 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/trial102.front.sepia.ceph.com/trial102/g' /etc/hosts
2026-02-14T01:27:00.254 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/10.20.193.102/10.20.193.102/g' /etc/hosts
2026-02-14T01:27:00.318 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/trial102.front.sepia.ceph.com/trial102/g' /etc/hostname
2026-02-14T01:27:00.384 DEBUG:teuthology.orchestra.run.trial102:> sudo hostname trial102
2026-02-14T01:27:00.447 DEBUG:teuthology.orchestra.run.trial102:> cat /etc/os-release
2026-02-14T01:27:00.502 INFO:teuthology.orchestra.run.trial102.stdout:NAME="CentOS Stream"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:VERSION="9"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:ID="centos"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:VERSION_ID="9"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:ANSI_COLOR="0;31"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:27:00.503 INFO:teuthology.orchestra.run.trial102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:27:00.504 INFO:teuthology.orchestra.run.trial102.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:27:00.504 INFO:teuthology.orchestra.run.trial102.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:27:00.504 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:27:00.504 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:27:00.505 INFO:teuthology.provision.fog.trial102:Deploy complete!
2026-02-14T01:27:00.506 DEBUG:teuthology.parallel:result is None
2026-02-14T01:27:00.633 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-14T01:27:00.634 DEBUG:teuthology.orchestra.run.trial044:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-14T01:27:00.791 INFO:teuthology.provision.fog.trial044:Node is ready
2026-02-14T01:27:00.791 DEBUG:teuthology.orchestra.run.trial044:> hostname
2026-02-14T01:27:00.847 INFO:teuthology.orchestra.run.trial044.stdout:trial044.front.sepia.ceph.com
2026-02-14T01:27:00.848 DEBUG:teuthology.orchestra.run.trial044:> grep trial044.front.sepia.ceph.com /etc/hosts
2026-02-14T01:27:00.905 INFO:teuthology.orchestra.run.trial044.stdout:10.20.193.44 trial044.front.sepia.ceph.com trial044
2026-02-14T01:27:00.905 DEBUG:teuthology.orchestra.run.trial044:> sudo hostname trial044
2026-02-14T01:27:00.974 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/trial044.front.sepia.ceph.com/trial044/g' /etc/hosts
2026-02-14T01:27:01.039 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/10.20.193.44/10.20.193.44/g' /etc/hosts
2026-02-14T01:27:01.103 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/trial044.front.sepia.ceph.com/trial044/g' /etc/hostname
2026-02-14T01:27:01.169 DEBUG:teuthology.orchestra.run.trial044:> sudo hostname trial044
2026-02-14T01:27:01.232 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release
2026-02-14T01:27:01.288 INFO:teuthology.orchestra.run.trial044.stdout:NAME="CentOS Stream"
2026-02-14T01:27:01.288 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="9"
2026-02-14T01:27:01.288 INFO:teuthology.orchestra.run.trial044.stdout:ID="centos"
2026-02-14T01:27:01.288 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:27:01.288 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="9"
2026-02-14T01:27:01.288 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:27:01.288 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:27:01.288 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;31"
2026-02-14T01:27:01.289 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:27:01.289 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:27:01.289 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:27:01.289 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:27:01.289 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:27:01.289 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:27:01.290 INFO:teuthology.provision.fog.trial044:Deploy complete!
2026-02-14T01:27:01.290 DEBUG:teuthology.parallel:result is None
2026-02-14T01:27:01.711 INFO:teuthology.provision.fog.trial124:Node is ready
2026-02-14T01:27:01.712 DEBUG:teuthology.orchestra.run.trial124:> hostname
2026-02-14T01:27:01.729 INFO:teuthology.orchestra.run.trial124.stdout:trial124.front.sepia.ceph.com
2026-02-14T01:27:01.730 DEBUG:teuthology.orchestra.run.trial124:> grep trial124.front.sepia.ceph.com /etc/hosts
2026-02-14T01:27:01.786 INFO:teuthology.orchestra.run.trial124.stdout:10.20.193.124 trial124.front.sepia.ceph.com trial124
2026-02-14T01:27:01.787 DEBUG:teuthology.orchestra.run.trial124:> sudo hostname trial124
2026-02-14T01:27:01.858 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/trial124.front.sepia.ceph.com/trial124/g' /etc/hosts
2026-02-14T01:27:01.921 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/10.20.193.124/10.20.193.124/g' /etc/hosts
2026-02-14T01:27:01.987 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/trial124.front.sepia.ceph.com/trial124/g' /etc/hostname
2026-02-14T01:27:02.052 DEBUG:teuthology.orchestra.run.trial124:> sudo hostname trial124
2026-02-14T01:27:02.114 DEBUG:teuthology.orchestra.run.trial124:> cat /etc/os-release
2026-02-14T01:27:02.171 INFO:teuthology.orchestra.run.trial124.stdout:NAME="CentOS Stream"
2026-02-14T01:27:02.171 INFO:teuthology.orchestra.run.trial124.stdout:VERSION="9"
2026-02-14T01:27:02.171 INFO:teuthology.orchestra.run.trial124.stdout:ID="centos"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_ID="9"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:ANSI_COLOR="0;31"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:27:02.172 INFO:teuthology.orchestra.run.trial124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:27:02.173 INFO:teuthology.provision.fog.trial124:Deploy complete!
2026-02-14T01:27:02.174 DEBUG:teuthology.parallel:result is None
2026-02-14T01:27:02.710 INFO:teuthology.lock.ops:Checking trial044.front.sepia.ceph.com
2026-02-14T01:27:02.710 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:27:02.820 INFO:teuthology.lock.ops:Checking trial102.front.sepia.ceph.com
2026-02-14T01:27:02.820 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:27:02.886 INFO:teuthology.lock.ops:Checking trial124.front.sepia.ceph.com
2026-02-14T01:27:02.887 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-14T01:27:02.945 INFO:teuthology.lock.ops:Updating [trial044.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:27:02.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial044.front.sepia.ceph.com'
2026-02-14T01:27:02.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:27:03.007 DEBUG:teuthology.orchestra.run.trial044:> true
2026-02-14T01:27:03.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial044.front.sepia.ceph.com'
2026-02-14T01:27:03.079 DEBUG:teuthology.orchestra.run.trial044:> uname -m
2026-02-14T01:27:03.135 INFO:teuthology.orchestra.run.trial044.stdout:x86_64
2026-02-14T01:27:03.135 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release
2026-02-14T01:27:03.191 INFO:teuthology.orchestra.run.trial044.stdout:NAME="CentOS Stream"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="9"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:ID="centos"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="9"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;31"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:27:03.192 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:27:03.193 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:27:03.193 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:27:03.193 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:27:03.193 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:27:03.194 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server
2026-02-14T01:27:03.295 INFO:teuthology.lock.ops:Updating [trial102.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:27:03.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial102.front.sepia.ceph.com'
2026-02-14T01:27:03.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:27:03.356 DEBUG:teuthology.orchestra.run.trial102:> true
2026-02-14T01:27:03.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial102.front.sepia.ceph.com'
2026-02-14T01:27:03.432 DEBUG:teuthology.orchestra.run.trial102:> uname -m
2026-02-14T01:27:03.487 INFO:teuthology.orchestra.run.trial102.stdout:x86_64
2026-02-14T01:27:03.488 DEBUG:teuthology.orchestra.run.trial102:> cat /etc/os-release
2026-02-14T01:27:03.545 INFO:teuthology.orchestra.run.trial102.stdout:NAME="CentOS Stream"
2026-02-14T01:27:03.545 INFO:teuthology.orchestra.run.trial102.stdout:VERSION="9"
2026-02-14T01:27:03.545 INFO:teuthology.orchestra.run.trial102.stdout:ID="centos"
2026-02-14T01:27:03.545 INFO:teuthology.orchestra.run.trial102.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:27:03.545 INFO:teuthology.orchestra.run.trial102.stdout:VERSION_ID="9"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:ANSI_COLOR="0;31"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:27:03.546 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:27:03.547 INFO:teuthology.lock.ops:Updating trial102.front.sepia.ceph.com on lock server
2026-02-14T01:27:03.652 INFO:teuthology.lock.ops:Updating [trial124.front.sepia.ceph.com]: set os type and version on server
2026-02-14T01:27:03.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial124.front.sepia.ceph.com'
2026-02-14T01:27:03.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-14T01:27:03.721 DEBUG:teuthology.orchestra.run.trial124:> true
2026-02-14T01:27:03.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial124.front.sepia.ceph.com'
2026-02-14T01:27:03.798 DEBUG:teuthology.orchestra.run.trial124:> uname -m
2026-02-14T01:27:03.854 INFO:teuthology.orchestra.run.trial124.stdout:x86_64
2026-02-14T01:27:03.854 DEBUG:teuthology.orchestra.run.trial124:> cat /etc/os-release
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:NAME="CentOS Stream"
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:VERSION="9"
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:ID="centos"
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:ID_LIKE="rhel fedora"
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_ID="9"
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:PLATFORM_ID="platform:el9"
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:ANSI_COLOR="0;31"
2026-02-14T01:27:03.910 INFO:teuthology.orchestra.run.trial124.stdout:LOGO="fedora-logo-icon"
2026-02-14T01:27:03.911 INFO:teuthology.orchestra.run.trial124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-14T01:27:03.911 INFO:teuthology.orchestra.run.trial124.stdout:HOME_URL="https://centos.org/"
2026-02-14T01:27:03.911 INFO:teuthology.orchestra.run.trial124.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-14T01:27:03.911 INFO:teuthology.orchestra.run.trial124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-14T01:27:03.911 INFO:teuthology.orchestra.run.trial124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-14T01:27:03.912 INFO:teuthology.lock.ops:Updating trial124.front.sepia.ceph.com on lock server
2026-02-14T01:27:04.014 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:27:04.112 INFO:teuthology.dispatcher.supervisor:Running job 50556
2026-02-14T01:27:04.112 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50556 --name jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-kernel} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50556/orig.config.yaml
2026-02-14T01:27:04.113 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-14_00:12:18-fs-wip-jcollin-testing-20260213.113451-tentacle-distro-default-trial/50556
2026-02-14T01:27:04.113 INFO:teuthology.dispatcher.supervisor:Job PID: 1550586
2026-02-14T01:27:04.113 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-14T01:29:04.114 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:31:04.239 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:33:04.362 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:35:04.492 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:37:04.619 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:39:04.742 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:41:04.822 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:43:04.947 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:45:05.063 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-14T01:45:05.152 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-14T01:45:05.324 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-14T01:45:06.063 INFO:teuthology.orchestra.console.trial102:Power off
2026-02-14T01:45:06.063 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:45:06.072 INFO:teuthology.orchestra.console.trial044:Power off
2026-02-14T01:45:06.072 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:45:06.089 INFO:teuthology.orchestra.console.trial124:Power off
2026-02-14T01:45:06.090 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-14T01:45:06.100 DEBUG:teuthology.orchestra.console.trial102:power off output: Chassis Power Control: Down/Off
2026-02-14T01:45:06.115 DEBUG:teuthology.orchestra.console.trial044:power off output: Chassis Power Control: Down/Off
2026-02-14T01:45:06.134 DEBUG:teuthology.orchestra.console.trial124:power off output: Chassis Power Control: Down/Off
2026-02-14T01:45:10.101 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:45:10.116 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:45:10.135 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:45:10.213 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is on
2026-02-14T01:45:10.226 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is on
2026-02-14T01:45:10.244 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is on
2026-02-14T01:45:14.214 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:45:14.227 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:45:14.245 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-14T01:45:14.325 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is off
2026-02-14T01:45:14.325 INFO:teuthology.orchestra.console.trial102:Power off completed
2026-02-14T01:45:14.338 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-14T01:45:14.338 INFO:teuthology.orchestra.console.trial044:Power off completed
2026-02-14T01:45:14.355 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is off
2026-02-14T01:45:14.355 INFO:teuthology.orchestra.console.trial124:Power off completed
2026-02-14T01:45:14.632 INFO:teuthology.lock.ops:unlocked: trial102.front.sepia.ceph.com
2026-02-14T01:45:14.642 INFO:teuthology.lock.ops:unlocked: trial044.front.sepia.ceph.com
2026-02-14T01:45:14.647 INFO:teuthology.lock.ops:unlocked: trial124.front.sepia.ceph.com