2026-02-18T01:45:39.674 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-18T01:45:39.675 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T01:45:39.746 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T01:45:39.936 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f53d1513890>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f53d0d43920>, signals=[15])
2026-02-18T01:45:39.936 INFO:teuthology.lock.ops:Start node 'trial031.front.sepia.ceph.com' reimaging
2026-02-18T01:45:39.936 INFO:teuthology.lock.ops:Updating [trial031.front.sepia.ceph.com]: reset os type and version on server
2026-02-18T01:45:39.936 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server
2026-02-18T01:45:40.112 DEBUG:teuthology.provision.fog.trial031:Requesting image trial_centos_9.stream (ID 3)
2026-02-18T01:45:40.163 INFO:teuthology.provision.fog.trial031:Scheduling deploy of centos 9.stream
2026-02-18T01:45:41.292 INFO:teuthology.orchestra.console.trial031:Power off
2026-02-18T01:45:41.292 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-18T01:45:41.331 DEBUG:teuthology.orchestra.console.trial031:power off output: Chassis Power Control: Down/Off
2026-02-18T01:45:45.336 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T01:45:45.447 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is off
2026-02-18T01:45:45.447 INFO:teuthology.orchestra.console.trial031:Power off completed
2026-02-18T01:45:45.548 INFO:teuthology.orchestra.console.trial031:Power on
2026-02-18T01:45:45.548 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-18T01:45:45.588 DEBUG:teuthology.orchestra.console.trial031:power on output: Chassis Power Control: Up/On
2026-02-18T01:45:49.594 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T01:45:49.704 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is on
2026-02-18T01:45:49.705 INFO:teuthology.orchestra.console.trial031:Power on completed
2026-02-18T01:45:49.805 INFO:teuthology.provision.fog.trial031:Waiting for deploy to finish
2026-02-18T01:47:37.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T01:47:37.152 ERROR:teuthology.orchestra.connection:Error authenticating with trial031.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-18T01:48:41.155 WARNING:teuthology.provision.fog.trial031:timed out
2026-02-18T01:48:47.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T01:48:51.401 ERROR:teuthology.orchestra.connection:Error authenticating with trial031.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-18T01:48:55.493 ERROR:teuthology.orchestra.connection:Error authenticating with trial031.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-18T01:49:02.604 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-18T01:49:02.604 DEBUG:teuthology.orchestra.run.trial031:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-18T01:49:02.768 INFO:teuthology.provision.fog.trial031:Node is ready
2026-02-18T01:49:02.769 DEBUG:teuthology.orchestra.run.trial031:> hostname
2026-02-18T01:49:02.824 INFO:teuthology.orchestra.run.trial031.stdout:trial031.front.sepia.ceph.com
2026-02-18T01:49:02.824 DEBUG:teuthology.orchestra.run.trial031:> grep trial031.front.sepia.ceph.com /etc/hosts
2026-02-18T01:49:02.881 INFO:teuthology.orchestra.run.trial031.stdout:10.20.193.31 trial031.front.sepia.ceph.com trial031
2026-02-18T01:49:02.881 DEBUG:teuthology.orchestra.run.trial031:> sudo hostname trial031
2026-02-18T01:49:02.950 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/trial031.front.sepia.ceph.com/trial031/g' /etc/hosts
2026-02-18T01:49:03.015 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/10.20.193.31/10.20.193.31/g' /etc/hosts
2026-02-18T01:49:03.079 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i -e 's/trial031.front.sepia.ceph.com/trial031/g' /etc/hostname
2026-02-18T01:49:03.144 DEBUG:teuthology.orchestra.run.trial031:> sudo hostname trial031
2026-02-18T01:49:03.207 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:NAME="CentOS Stream"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="9"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:ID="centos"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel fedora"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="9"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el9"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;31"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://centos.org/"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-18T01:49:03.263 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-18T01:49:03.264 INFO:teuthology.provision.fog.trial031:Deploy complete!
2026-02-18T01:49:03.264 DEBUG:teuthology.parallel:result is None
2026-02-18T01:49:03.480 INFO:teuthology.lock.ops:Checking trial031.front.sepia.ceph.com
2026-02-18T01:49:03.481 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-18T01:49:03.548 INFO:teuthology.lock.ops:Updating [trial031.front.sepia.ceph.com]: set os type and version on server
2026-02-18T01:49:03.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com'
2026-02-18T01:49:03.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-18T01:49:03.616 DEBUG:teuthology.orchestra.run.trial031:> true
2026-02-18T01:49:03.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com'
2026-02-18T01:49:03.688 DEBUG:teuthology.orchestra.run.trial031:> uname -m
2026-02-18T01:49:03.744 INFO:teuthology.orchestra.run.trial031.stdout:x86_64
2026-02-18T01:49:03.745 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release
2026-02-18T01:49:03.800 INFO:teuthology.orchestra.run.trial031.stdout:NAME="CentOS Stream"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="9"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:ID="centos"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel fedora"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="9"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el9"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;31"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-18T01:49:03.801 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://centos.org/"
2026-02-18T01:49:03.802 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-18T01:49:03.802 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-18T01:49:03.802 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-18T01:49:03.803 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server
2026-02-18T01:49:03.910 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T01:49:04.007 INFO:teuthology.dispatcher.supervisor:Running job 54360
2026-02-18T01:49:04.007 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_yuriw@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:18:34-fs-20.2.1_2.17.26-baseline_2-distro-default-trial/54360 --name yuriw-2026-02-17_21:18:34-fs-20.2.1_2.17.26-baseline_2-distro-default-trial --description fs/valgrind/{begin/{0-install 1-ceph 2-logrotate 3-kernel} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/{ignorelist_health pg_health} tasks/mirror}} -- /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:18:34-fs-20.2.1_2.17.26-baseline_2-distro-default-trial/54360/orig.config.yaml
2026-02-18T01:49:04.008 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:18:34-fs-20.2.1_2.17.26-baseline_2-distro-default-trial/54360
2026-02-18T01:49:04.008 INFO:teuthology.dispatcher.supervisor:Job PID: 2277296
2026-02-18T01:49:04.008 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-18T01:51:04.009 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T01:53:04.132 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T01:55:04.256 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T01:57:04.383 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T01:59:04.511 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:01:04.632 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:03:04.703 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:05:04.832 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:07:04.958 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:09:05.086 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:11:05.204 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:13:05.422 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:15:05.520 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:17:05.645 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:19:05.767 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:21:05.844 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:23:05.968 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:25:06.091 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:27:06.484 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:29:06.612 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:31:06.736 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:33:06.854 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:35:06.976 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:37:07.103 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:39:07.220 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:41:07.485 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:43:07.603 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:45:07.723 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:47:07.846 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:49:07.964 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:51:08.085 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:53:08.205 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:55:08.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:57:08.454 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T02:59:08.694 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T03:01:08.816 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T03:03:08.945 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-18T03:03:09.068 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-18T03:03:09.135 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-18T03:03:09.430 INFO:teuthology.orchestra.console.trial031:Power off
2026-02-18T03:03:09.430 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-18T03:03:09.470 DEBUG:teuthology.orchestra.console.trial031:power off output: Chassis Power Control: Down/Off
2026-02-18T03:03:13.471 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T03:03:13.583 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is on
2026-02-18T03:03:17.584 DEBUG:teuthology.orchestra.console.trial031:pexpect command: ipmitool -H trial031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-18T03:03:17.696 DEBUG:teuthology.orchestra.console.trial031:check power output: Chassis Power is off
2026-02-18T03:03:17.696 INFO:teuthology.orchestra.console.trial031:Power off completed
2026-02-18T03:03:17.906 INFO:teuthology.lock.ops:unlocked: trial031.front.sepia.ceph.com