2026-02-17T11:24:28.656 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T11:24:28.656 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:24:28.729 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:24:28.985 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x77d3e460a060>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x77d3e3e4a020>, signals=[15])
2026-02-17T11:24:28.985 INFO:teuthology.lock.ops:Start node 'trial012.front.sepia.ceph.com' reimaging
2026-02-17T11:24:28.985 INFO:teuthology.lock.ops:Updating [trial012.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T11:24:28.985 INFO:teuthology.lock.ops:Updating trial012.front.sepia.ceph.com on lock server
2026-02-17T11:24:29.042 INFO:teuthology.lock.ops:Start node 'trial052.front.sepia.ceph.com' reimaging
2026-02-17T11:24:29.042 INFO:teuthology.lock.ops:Updating [trial052.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T11:24:29.043 INFO:teuthology.lock.ops:Updating trial052.front.sepia.ceph.com on lock server
2026-02-17T11:24:29.101 INFO:teuthology.lock.ops:Start node 'trial088.front.sepia.ceph.com' reimaging
2026-02-17T11:24:29.101 INFO:teuthology.lock.ops:Updating [trial088.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T11:24:29.101 INFO:teuthology.lock.ops:Updating trial088.front.sepia.ceph.com on lock server
2026-02-17T11:24:29.272 DEBUG:teuthology.provision.fog.trial012:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T11:24:29.334 INFO:teuthology.provision.fog.trial012:Scheduling deploy of centos 9.stream
2026-02-17T11:24:29.335 DEBUG:teuthology.provision.fog.trial052:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T11:24:29.371 DEBUG:teuthology.provision.fog.trial088:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T11:24:29.393 INFO:teuthology.provision.fog.trial052:Scheduling deploy of centos 9.stream
2026-02-17T11:24:29.417 INFO:teuthology.provision.fog.trial088:Scheduling deploy of centos 9.stream
2026-02-17T11:24:30.622 INFO:teuthology.orchestra.console.trial012:Power off
2026-02-17T11:24:30.622 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:24:30.683 INFO:teuthology.orchestra.console.trial052:Power off
2026-02-17T11:24:30.683 DEBUG:teuthology.orchestra.console.trial052:pexpect command: ipmitool -H trial052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:24:30.689 DEBUG:teuthology.orchestra.console.trial012:power off output: Chassis Power Control: Down/Off
2026-02-17T11:24:30.703 INFO:teuthology.orchestra.console.trial088:Power off
2026-02-17T11:24:30.704 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:24:30.723 DEBUG:teuthology.orchestra.console.trial052:power off output: Chassis Power Control: Down/Off
2026-02-17T11:24:30.744 DEBUG:teuthology.orchestra.console.trial088:power off output: Chassis Power Control: Down/Off
2026-02-17T11:24:34.694 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:24:34.723 DEBUG:teuthology.orchestra.console.trial052:pexpect command: ipmitool -H trial052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:24:34.745 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:24:34.805 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is off
2026-02-17T11:24:34.805 INFO:teuthology.orchestra.console.trial012:Power off completed
2026-02-17T11:24:34.832 DEBUG:teuthology.orchestra.console.trial052:check power output: Chassis Power is off
2026-02-17T11:24:34.833 INFO:teuthology.orchestra.console.trial052:Power off completed
2026-02-17T11:24:34.855 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off
2026-02-17T11:24:34.855 INFO:teuthology.orchestra.console.trial088:Power off completed
2026-02-17T11:24:34.906 INFO:teuthology.orchestra.console.trial012:Power on
2026-02-17T11:24:34.907 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T11:24:34.934 INFO:teuthology.orchestra.console.trial052:Power on
2026-02-17T11:24:34.934 DEBUG:teuthology.orchestra.console.trial052:pexpect command: ipmitool -H trial052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T11:24:34.946 DEBUG:teuthology.orchestra.console.trial012:power on output: Chassis Power Control: Up/On
2026-02-17T11:24:34.956 INFO:teuthology.orchestra.console.trial088:Power on
2026-02-17T11:24:34.956 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T11:24:34.975 DEBUG:teuthology.orchestra.console.trial052:power on output: Chassis Power Control: Up/On
2026-02-17T11:24:34.996 DEBUG:teuthology.orchestra.console.trial088:power on output: Chassis Power Control: Up/On
2026-02-17T11:24:38.951 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:24:38.976 DEBUG:teuthology.orchestra.console.trial052:pexpect command: ipmitool -H trial052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:24:38.997 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:24:39.060 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is on
2026-02-17T11:24:39.060 INFO:teuthology.orchestra.console.trial012:Power on completed
2026-02-17T11:24:39.083 DEBUG:teuthology.orchestra.console.trial052:check power output: Chassis Power is on
2026-02-17T11:24:39.083 INFO:teuthology.orchestra.console.trial052:Power on completed
2026-02-17T11:24:39.105 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off
2026-02-17T11:24:39.161 INFO:teuthology.provision.fog.trial012:Waiting for deploy to finish
2026-02-17T11:24:39.184 INFO:teuthology.provision.fog.trial052:Waiting for deploy to finish
2026-02-17T11:24:43.110 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:24:43.221 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is on
2026-02-17T11:24:43.221 INFO:teuthology.orchestra.console.trial088:Power on completed
2026-02-17T11:24:43.322 INFO:teuthology.provision.fog.trial088:Waiting for deploy to finish
2026-02-17T11:26:26.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:26:26.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:26:26.540 ERROR:teuthology.orchestra.connection:Error authenticating with trial012.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T11:26:30.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:26:33.344 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-17T11:26:39.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:26:40.703 WARNING:teuthology.provision.fog.trial052:[Errno None] Unable to connect to port 22 on 10.20.193.52
2026-02-17T11:26:42.433 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-17T11:26:46.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:26:48.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:26:49.792 WARNING:teuthology.provision.fog.trial052:[Errno None] Unable to connect to port 22 on 10.20.193.52
2026-02-17T11:26:51.520 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-17T11:26:55.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:26:57.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:26:58.880 WARNING:teuthology.provision.fog.trial052:[Errno None] Unable to connect to port 22 on 10.20.193.52
2026-02-17T11:27:00.607 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-17T11:27:04.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:27:06.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:27:07.969 WARNING:teuthology.provision.fog.trial052:[Errno None] Unable to connect to port 22 on 10.20.193.52
2026-02-17T11:27:09.696 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-17T11:27:13.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:27:15.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:27:30.544 WARNING:teuthology.provision.fog.trial012:timed out
2026-02-17T11:27:36.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:27:39.760 ERROR:teuthology.orchestra.connection:Error authenticating with trial012.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T11:27:43.875 ERROR:teuthology.orchestra.connection:Error authenticating with trial012.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T11:27:49.726 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T11:27:49.727 DEBUG:teuthology.orchestra.run.trial052:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T11:27:49.893 INFO:teuthology.provision.fog.trial052:Node is ready
2026-02-17T11:27:49.893 DEBUG:teuthology.orchestra.run.trial052:> hostname
2026-02-17T11:27:49.948 INFO:teuthology.orchestra.run.trial052.stdout:trial052.front.sepia.ceph.com
2026-02-17T11:27:49.948 DEBUG:teuthology.orchestra.run.trial052:> grep trial052.front.sepia.ceph.com /etc/hosts
2026-02-17T11:27:50.005 INFO:teuthology.orchestra.run.trial052.stdout:10.20.193.52 trial052.front.sepia.ceph.com trial052
2026-02-17T11:27:50.006 DEBUG:teuthology.orchestra.run.trial052:> sudo hostname trial052
2026-02-17T11:27:50.076 DEBUG:teuthology.orchestra.run.trial052:> sudo sed -i -e 's/trial052.front.sepia.ceph.com/trial052/g' /etc/hosts
2026-02-17T11:27:50.141 DEBUG:teuthology.orchestra.run.trial052:> sudo sed -i -e 's/10.20.193.52/10.20.193.52/g' /etc/hosts
2026-02-17T11:27:50.206 DEBUG:teuthology.orchestra.run.trial052:> sudo sed -i -e 's/trial052.front.sepia.ceph.com/trial052/g' /etc/hostname
2026-02-17T11:27:50.271 DEBUG:teuthology.orchestra.run.trial052:> sudo hostname trial052
2026-02-17T11:27:50.335 DEBUG:teuthology.orchestra.run.trial052:> cat /etc/os-release
2026-02-17T11:27:50.390 INFO:teuthology.orchestra.run.trial052.stdout:NAME="CentOS Stream"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:VERSION="9"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:ID="centos"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:ID_LIKE="rhel fedora"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:VERSION_ID="9"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:PLATFORM_ID="platform:el9"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:ANSI_COLOR="0;31"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:LOGO="fedora-logo-icon"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:HOME_URL="https://centos.org/"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T11:27:50.391 INFO:teuthology.orchestra.run.trial052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T11:27:50.391 INFO:teuthology.provision.fog.trial052:Deploy complete!
2026-02-17T11:27:50.392 DEBUG:teuthology.parallel:result is None
2026-02-17T11:27:50.968 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T11:27:50.968 DEBUG:teuthology.orchestra.run.trial012:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T11:27:51.135 INFO:teuthology.provision.fog.trial012:Node is ready
2026-02-17T11:27:51.135 DEBUG:teuthology.orchestra.run.trial012:> hostname
2026-02-17T11:27:51.193 INFO:teuthology.orchestra.run.trial012.stdout:trial012.front.sepia.ceph.com
2026-02-17T11:27:51.193 DEBUG:teuthology.orchestra.run.trial012:> grep trial012.front.sepia.ceph.com /etc/hosts
2026-02-17T11:27:51.249 INFO:teuthology.orchestra.run.trial012.stdout:10.20.193.12 trial012.front.sepia.ceph.com trial012
2026-02-17T11:27:51.249 DEBUG:teuthology.orchestra.run.trial012:> sudo hostname trial012
2026-02-17T11:27:51.319 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/trial012.front.sepia.ceph.com/trial012/g' /etc/hosts
2026-02-17T11:27:51.385 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/10.20.193.12/10.20.193.12/g' /etc/hosts
2026-02-17T11:27:51.449 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/trial012.front.sepia.ceph.com/trial012/g' /etc/hostname
2026-02-17T11:27:51.513 DEBUG:teuthology.orchestra.run.trial012:> sudo hostname trial012
2026-02-17T11:27:51.577 DEBUG:teuthology.orchestra.run.trial012:> cat /etc/os-release
2026-02-17T11:27:51.632 INFO:teuthology.orchestra.run.trial012.stdout:NAME="CentOS Stream"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:VERSION="9"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:ID="centos"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:ID_LIKE="rhel fedora"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:VERSION_ID="9"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:PLATFORM_ID="platform:el9"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:ANSI_COLOR="0;31"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:LOGO="fedora-logo-icon"
2026-02-17T11:27:51.633 INFO:teuthology.orchestra.run.trial012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T11:27:51.634 INFO:teuthology.orchestra.run.trial012.stdout:HOME_URL="https://centos.org/"
2026-02-17T11:27:51.634 INFO:teuthology.orchestra.run.trial012.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T11:27:51.634 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T11:27:51.634 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T11:27:51.634 INFO:teuthology.provision.fog.trial012:Deploy complete!
2026-02-17T11:27:51.635 DEBUG:teuthology.parallel:result is None
2026-02-17T11:27:51.803 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T11:27:51.803 DEBUG:teuthology.orchestra.run.trial088:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T11:27:51.973 INFO:teuthology.provision.fog.trial088:Node is ready
2026-02-17T11:27:51.973 DEBUG:teuthology.orchestra.run.trial088:> hostname
2026-02-17T11:27:52.029 INFO:teuthology.orchestra.run.trial088.stdout:trial088.front.sepia.ceph.com
2026-02-17T11:27:52.030 DEBUG:teuthology.orchestra.run.trial088:> grep trial088.front.sepia.ceph.com /etc/hosts
2026-02-17T11:27:52.084 INFO:teuthology.orchestra.run.trial088.stdout:10.20.193.88 trial088.front.sepia.ceph.com trial088
2026-02-17T11:27:52.084 DEBUG:teuthology.orchestra.run.trial088:> sudo hostname trial088
2026-02-17T11:27:52.152 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/trial088.front.sepia.ceph.com/trial088/g' /etc/hosts
2026-02-17T11:27:52.217 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/10.20.193.88/10.20.193.88/g' /etc/hosts
2026-02-17T11:27:52.282 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/trial088.front.sepia.ceph.com/trial088/g' /etc/hostname
2026-02-17T11:27:52.345 DEBUG:teuthology.orchestra.run.trial088:> sudo hostname trial088
2026-02-17T11:27:52.408 DEBUG:teuthology.orchestra.run.trial088:> cat /etc/os-release
2026-02-17T11:27:52.463 INFO:teuthology.orchestra.run.trial088.stdout:NAME="CentOS Stream"
2026-02-17T11:27:52.463 INFO:teuthology.orchestra.run.trial088.stdout:VERSION="9"
2026-02-17T11:27:52.463 INFO:teuthology.orchestra.run.trial088.stdout:ID="centos"
2026-02-17T11:27:52.463 INFO:teuthology.orchestra.run.trial088.stdout:ID_LIKE="rhel fedora"
2026-02-17T11:27:52.463 INFO:teuthology.orchestra.run.trial088.stdout:VERSION_ID="9"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:PLATFORM_ID="platform:el9"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:ANSI_COLOR="0;31"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:LOGO="fedora-logo-icon"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:HOME_URL="https://centos.org/"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T11:27:52.464 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T11:27:52.464 INFO:teuthology.provision.fog.trial088:Deploy complete!
2026-02-17T11:27:52.465 DEBUG:teuthology.parallel:result is None
2026-02-17T11:27:52.979 INFO:teuthology.lock.ops:Checking trial012.front.sepia.ceph.com
2026-02-17T11:27:52.979 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T11:27:53.082 INFO:teuthology.lock.ops:Checking trial052.front.sepia.ceph.com
2026-02-17T11:27:53.082 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T11:27:53.148 INFO:teuthology.lock.ops:Checking trial088.front.sepia.ceph.com
2026-02-17T11:27:53.148 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T11:27:53.210 INFO:teuthology.lock.ops:Updating [trial012.front.sepia.ceph.com]: set os type and version on server
2026-02-17T11:27:53.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial012.front.sepia.ceph.com'
2026-02-17T11:27:53.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:27:53.273 DEBUG:teuthology.orchestra.run.trial012:> true
2026-02-17T11:27:53.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial012.front.sepia.ceph.com'
2026-02-17T11:27:53.347 DEBUG:teuthology.orchestra.run.trial012:> uname -m
2026-02-17T11:27:53.403 INFO:teuthology.orchestra.run.trial012.stdout:x86_64
2026-02-17T11:27:53.403 DEBUG:teuthology.orchestra.run.trial012:> cat /etc/os-release
2026-02-17T11:27:53.459 INFO:teuthology.orchestra.run.trial012.stdout:NAME="CentOS Stream"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:VERSION="9"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:ID="centos"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:ID_LIKE="rhel fedora"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:VERSION_ID="9"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:PLATFORM_ID="platform:el9"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:ANSI_COLOR="0;31"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:LOGO="fedora-logo-icon"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:HOME_URL="https://centos.org/"
2026-02-17T11:27:53.460 INFO:teuthology.orchestra.run.trial012.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T11:27:53.461 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T11:27:53.461 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T11:27:53.461 INFO:teuthology.lock.ops:Updating trial012.front.sepia.ceph.com on lock server
2026-02-17T11:27:53.563 INFO:teuthology.lock.ops:Updating [trial052.front.sepia.ceph.com]: set os type and version on server
2026-02-17T11:27:53.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial052.front.sepia.ceph.com'
2026-02-17T11:27:53.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:27:53.636 DEBUG:teuthology.orchestra.run.trial052:> true
2026-02-17T11:27:53.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial052.front.sepia.ceph.com'
2026-02-17T11:27:53.711 DEBUG:teuthology.orchestra.run.trial052:> uname -m
2026-02-17T11:27:53.767 INFO:teuthology.orchestra.run.trial052.stdout:x86_64
2026-02-17T11:27:53.768 DEBUG:teuthology.orchestra.run.trial052:> cat /etc/os-release
2026-02-17T11:27:53.828 INFO:teuthology.orchestra.run.trial052.stdout:NAME="CentOS Stream"
2026-02-17T11:27:53.828 INFO:teuthology.orchestra.run.trial052.stdout:VERSION="9"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:ID="centos"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:ID_LIKE="rhel fedora"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:VERSION_ID="9"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:PLATFORM_ID="platform:el9"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:ANSI_COLOR="0;31"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:LOGO="fedora-logo-icon"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:HOME_URL="https://centos.org/"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T11:27:53.829 INFO:teuthology.orchestra.run.trial052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T11:27:53.830 INFO:teuthology.lock.ops:Updating trial052.front.sepia.ceph.com on lock server
2026-02-17T11:27:53.936 INFO:teuthology.lock.ops:Updating [trial088.front.sepia.ceph.com]: set os type and version on server
2026-02-17T11:27:53.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial088.front.sepia.ceph.com'
2026-02-17T11:27:53.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T11:27:54.002 DEBUG:teuthology.orchestra.run.trial088:> true
2026-02-17T11:27:54.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial088.front.sepia.ceph.com'
2026-02-17T11:27:54.079 DEBUG:teuthology.orchestra.run.trial088:> uname -m
2026-02-17T11:27:54.135 INFO:teuthology.orchestra.run.trial088.stdout:x86_64
2026-02-17T11:27:54.135 DEBUG:teuthology.orchestra.run.trial088:> cat /etc/os-release
2026-02-17T11:27:54.192 INFO:teuthology.orchestra.run.trial088.stdout:NAME="CentOS Stream"
2026-02-17T11:27:54.192 INFO:teuthology.orchestra.run.trial088.stdout:VERSION="9"
2026-02-17T11:27:54.192 INFO:teuthology.orchestra.run.trial088.stdout:ID="centos"
2026-02-17T11:27:54.192 INFO:teuthology.orchestra.run.trial088.stdout:ID_LIKE="rhel fedora"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:VERSION_ID="9"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:PLATFORM_ID="platform:el9"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:ANSI_COLOR="0;31"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:LOGO="fedora-logo-icon"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:HOME_URL="https://centos.org/"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T11:27:54.193 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T11:27:54.194 INFO:teuthology.lock.ops:Updating trial088.front.sepia.ceph.com on lock server
2026-02-17T11:27:54.292 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:27:54.426 INFO:teuthology.dispatcher.supervisor:Running job 51308
2026-02-17T11:27:54.426 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51308 --name skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51308/orig.config.yaml
2026-02-17T11:27:54.426 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51308
2026-02-17T11:27:54.426 INFO:teuthology.dispatcher.supervisor:Job PID: 157343
2026-02-17T11:27:54.426 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T11:29:54.427 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:31:54.513 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:33:54.591 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:35:54.674 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:37:54.791 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:39:54.886 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:41:54.991 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:43:55.113 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:45:55.232 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:47:55.361 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:49:55.483 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:51:55.605 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:53:55.724 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T11:53:55.855 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T11:53:56.035 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T11:53:56.758 INFO:teuthology.orchestra.console.trial052:Power off
2026-02-17T11:53:56.759 DEBUG:teuthology.orchestra.console.trial052:pexpect command: ipmitool -H trial052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:53:56.772 INFO:teuthology.orchestra.console.trial088:Power off
2026-02-17T11:53:56.772 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:53:56.780 INFO:teuthology.orchestra.console.trial012:Power off
2026-02-17T11:53:56.780 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T11:53:56.800 DEBUG:teuthology.orchestra.console.trial052:power off output: Chassis Power Control: Down/Off
2026-02-17T11:53:56.811 DEBUG:teuthology.orchestra.console.trial088:power off output: Chassis Power Control: Down/Off
2026-02-17T11:53:56.817 DEBUG:teuthology.orchestra.console.trial012:power off output: Chassis Power Control: Down/Off
2026-02-17T11:54:00.802 DEBUG:teuthology.orchestra.console.trial052:pexpect command: ipmitool -H trial052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:54:00.812 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:54:00.820 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:54:00.912 DEBUG:teuthology.orchestra.console.trial052:check power output: Chassis Power is on
2026-02-17T11:54:00.922 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is on
2026-02-17T11:54:00.930 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is on
2026-02-17T11:54:04.913 DEBUG:teuthology.orchestra.console.trial052:pexpect command: ipmitool -H trial052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:54:04.922 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:54:04.931 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T11:54:05.023 DEBUG:teuthology.orchestra.console.trial052:check power output: Chassis Power is off
2026-02-17T11:54:05.024 INFO:teuthology.orchestra.console.trial052:Power off completed
2026-02-17T11:54:05.030 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off
2026-02-17T11:54:05.030 INFO:teuthology.orchestra.console.trial088:Power off completed
2026-02-17T11:54:05.038 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is off
2026-02-17T11:54:05.039 INFO:teuthology.orchestra.console.trial012:Power off completed
2026-02-17T11:54:05.321 INFO:teuthology.lock.ops:unlocked: trial052.front.sepia.ceph.com
2026-02-17T11:54:05.330 INFO:teuthology.lock.ops:unlocked: trial088.front.sepia.ceph.com
2026-02-17T11:54:05.334 INFO:teuthology.lock.ops:unlocked: trial012.front.sepia.ceph.com