2026-02-17T08:37:52.197 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T08:37:52.197 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:37:52.272 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:37:52.548 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7d9f495ac650>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7d9f48d5b4c0>, signals=[15])
2026-02-17T08:37:52.548 INFO:teuthology.lock.ops:Start node 'trial053.front.sepia.ceph.com' reimaging
2026-02-17T08:37:52.548 INFO:teuthology.lock.ops:Updating [trial053.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T08:37:52.548 INFO:teuthology.lock.ops:Updating trial053.front.sepia.ceph.com on lock server
2026-02-17T08:37:52.607 INFO:teuthology.lock.ops:Start node 'trial063.front.sepia.ceph.com' reimaging
2026-02-17T08:37:52.607 INFO:teuthology.lock.ops:Updating [trial063.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T08:37:52.607 INFO:teuthology.lock.ops:Updating trial063.front.sepia.ceph.com on lock server
2026-02-17T08:37:52.665 INFO:teuthology.lock.ops:Start node 'trial128.front.sepia.ceph.com' reimaging
2026-02-17T08:37:52.665 INFO:teuthology.lock.ops:Updating [trial128.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T08:37:52.666 INFO:teuthology.lock.ops:Updating trial128.front.sepia.ceph.com on lock server
2026-02-17T08:37:52.899 DEBUG:teuthology.provision.fog.trial063:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T08:37:52.900 DEBUG:teuthology.provision.fog.trial053:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T08:37:52.950 INFO:teuthology.provision.fog.trial053:Scheduling deploy of centos 9.stream
2026-02-17T08:37:52.953 INFO:teuthology.provision.fog.trial063:Scheduling deploy of centos 9.stream
2026-02-17T08:37:52.957 DEBUG:teuthology.provision.fog.trial128:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T08:37:52.987 INFO:teuthology.provision.fog.trial128:Scheduling deploy of centos 9.stream
2026-02-17T08:37:54.069 INFO:teuthology.orchestra.console.trial063:Power off
2026-02-17T08:37:54.069 DEBUG:teuthology.orchestra.console.trial063:pexpect command: ipmitool -H trial063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T08:37:54.089 INFO:teuthology.orchestra.console.trial053:Power off
2026-02-17T08:37:54.089 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T08:37:54.108 DEBUG:teuthology.orchestra.console.trial063:power off output: Chassis Power Control: Down/Off
2026-02-17T08:37:54.127 DEBUG:teuthology.orchestra.console.trial053:power off output: Chassis Power Control: Down/Off
2026-02-17T08:37:54.238 INFO:teuthology.orchestra.console.trial128:Power off
2026-02-17T08:37:54.238 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T08:37:54.276 DEBUG:teuthology.orchestra.console.trial128:power off output: Chassis Power Control: Down/Off
2026-02-17T08:37:58.112 DEBUG:teuthology.orchestra.console.trial063:pexpect command: ipmitool -H trial063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:37:58.128 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:37:58.221 DEBUG:teuthology.orchestra.console.trial063:check power output: Chassis Power is off
2026-02-17T08:37:58.221 INFO:teuthology.orchestra.console.trial063:Power off completed
2026-02-17T08:37:58.236 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is off
2026-02-17T08:37:58.236 INFO:teuthology.orchestra.console.trial053:Power off completed
2026-02-17T08:37:58.277 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:37:58.322 INFO:teuthology.orchestra.console.trial063:Power on
2026-02-17T08:37:58.323 DEBUG:teuthology.orchestra.console.trial063:pexpect command: ipmitool -H trial063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T08:37:58.337 INFO:teuthology.orchestra.console.trial053:Power on
2026-02-17T08:37:58.337 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T08:37:58.361 DEBUG:teuthology.orchestra.console.trial063:power on output: Chassis Power Control: Up/On
2026-02-17T08:37:58.380 DEBUG:teuthology.orchestra.console.trial053:power on output: Chassis Power Control: Up/On
2026-02-17T08:37:58.386 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is off
2026-02-17T08:37:58.386 INFO:teuthology.orchestra.console.trial128:Power off completed
2026-02-17T08:37:58.487 INFO:teuthology.orchestra.console.trial128:Power on
2026-02-17T08:37:58.487 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T08:37:58.530 DEBUG:teuthology.orchestra.console.trial128:power on output: Chassis Power Control: Up/On
2026-02-17T08:38:02.363 DEBUG:teuthology.orchestra.console.trial063:pexpect command: ipmitool -H trial063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:38:02.381 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:38:02.474 DEBUG:teuthology.orchestra.console.trial063:check power output: Chassis Power is on
2026-02-17T08:38:02.475 INFO:teuthology.orchestra.console.trial063:Power on completed
2026-02-17T08:38:02.489 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is on
2026-02-17T08:38:02.489 INFO:teuthology.orchestra.console.trial053:Power on completed
2026-02-17T08:38:02.531 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:38:02.575 INFO:teuthology.provision.fog.trial063:Waiting for deploy to finish
2026-02-17T08:38:02.590 INFO:teuthology.provision.fog.trial053:Waiting for deploy to finish
2026-02-17T08:38:02.638 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is off
2026-02-17T08:38:06.639 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:38:06.748 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is on
2026-02-17T08:38:06.748 INFO:teuthology.orchestra.console.trial128:Power on completed
2026-02-17T08:38:06.849 INFO:teuthology.provision.fog.trial128:Waiting for deploy to finish
2026-02-17T08:39:49.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:39:49.924 ERROR:teuthology.orchestra.connection:Error authenticating with trial053.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T08:39:53.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial128.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:02.113 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53
2026-02-17T08:40:05.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:08.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:08.192 WARNING:teuthology.provision.fog.trial063:[Errno None] Unable to connect to port 22 on 10.20.193.63
2026-02-17T08:40:11.200 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53
2026-02-17T08:40:14.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:17.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:17.280 WARNING:teuthology.provision.fog.trial063:[Errno None] Unable to connect to port 22 on 10.20.193.63
2026-02-17T08:40:20.287 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53
2026-02-17T08:40:23.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:26.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:26.368 WARNING:teuthology.provision.fog.trial063:[Errno None] Unable to connect to port 22 on 10.20.193.63
2026-02-17T08:40:29.375 WARNING:teuthology.provision.fog.trial053:[Errno None] Unable to connect to port 22 on 10.20.193.53
2026-02-17T08:40:32.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:35.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:35.456 WARNING:teuthology.provision.fog.trial063:[Errno None] Unable to connect to port 22 on 10.20.193.63
2026-02-17T08:40:41.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:40:53.869 WARNING:teuthology.provision.fog.trial128:timed out
2026-02-17T08:40:59.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial128.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:41:05.161 ERROR:teuthology.orchestra.connection:Error authenticating with trial128.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T08:41:09.309 ERROR:teuthology.orchestra.connection:Error authenticating with trial128.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T08:41:11.408 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T08:41:11.409 DEBUG:teuthology.orchestra.run.trial053:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T08:41:11.610 INFO:teuthology.provision.fog.trial053:Node is ready
2026-02-17T08:41:11.611 DEBUG:teuthology.orchestra.run.trial053:> hostname
2026-02-17T08:41:11.663 INFO:teuthology.orchestra.run.trial053.stdout:trial053.front.sepia.ceph.com
2026-02-17T08:41:11.664 DEBUG:teuthology.orchestra.run.trial053:> grep trial053.front.sepia.ceph.com /etc/hosts
2026-02-17T08:41:11.717 INFO:teuthology.orchestra.run.trial053.stdout:10.20.193.53 trial053.front.sepia.ceph.com trial053
2026-02-17T08:41:11.718 DEBUG:teuthology.orchestra.run.trial053:> sudo hostname trial053
2026-02-17T08:41:11.785 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/trial053.front.sepia.ceph.com/trial053/g' /etc/hosts
2026-02-17T08:41:11.848 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/10.20.193.53/10.20.193.53/g' /etc/hosts
2026-02-17T08:41:11.911 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i -e 's/trial053.front.sepia.ceph.com/trial053/g' /etc/hostname
2026-02-17T08:41:11.972 DEBUG:teuthology.orchestra.run.trial053:> sudo hostname trial053
2026-02-17T08:41:12.033 DEBUG:teuthology.orchestra.run.trial053:> cat /etc/os-release
2026-02-17T08:41:12.087 INFO:teuthology.orchestra.run.trial053.stdout:NAME="CentOS Stream"
2026-02-17T08:41:12.087 INFO:teuthology.orchestra.run.trial053.stdout:VERSION="9"
2026-02-17T08:41:12.087 INFO:teuthology.orchestra.run.trial053.stdout:ID="centos"
2026-02-17T08:41:12.087 INFO:teuthology.orchestra.run.trial053.stdout:ID_LIKE="rhel fedora"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:VERSION_ID="9"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:PLATFORM_ID="platform:el9"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:ANSI_COLOR="0;31"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:LOGO="fedora-logo-icon"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:HOME_URL="https://centos.org/"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T08:41:12.088 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T08:41:12.090 INFO:teuthology.provision.fog.trial053:Deploy complete!
2026-02-17T08:41:12.091 DEBUG:teuthology.parallel:result is None
2026-02-17T08:41:16.422 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T08:41:16.422 DEBUG:teuthology.orchestra.run.trial128:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T08:41:16.569 INFO:teuthology.provision.fog.trial128:Node is ready
2026-02-17T08:41:16.569 DEBUG:teuthology.orchestra.run.trial128:> hostname
2026-02-17T08:41:16.626 INFO:teuthology.orchestra.run.trial128.stdout:trial128.front.sepia.ceph.com
2026-02-17T08:41:16.626 DEBUG:teuthology.orchestra.run.trial128:> grep trial128.front.sepia.ceph.com /etc/hosts
2026-02-17T08:41:16.682 INFO:teuthology.orchestra.run.trial128.stdout:10.20.193.128 trial128.front.sepia.ceph.com trial128
2026-02-17T08:41:16.683 DEBUG:teuthology.orchestra.run.trial128:> sudo hostname trial128
2026-02-17T08:41:16.751 DEBUG:teuthology.orchestra.run.trial128:> sudo sed -i -e 's/trial128.front.sepia.ceph.com/trial128/g' /etc/hosts
2026-02-17T08:41:16.817 DEBUG:teuthology.orchestra.run.trial128:> sudo sed -i -e 's/10.20.193.128/10.20.193.128/g' /etc/hosts
2026-02-17T08:41:16.882 DEBUG:teuthology.orchestra.run.trial128:> sudo sed -i -e 's/trial128.front.sepia.ceph.com/trial128/g' /etc/hostname
2026-02-17T08:41:16.947 DEBUG:teuthology.orchestra.run.trial128:> sudo hostname trial128
2026-02-17T08:41:17.011 DEBUG:teuthology.orchestra.run.trial128:> cat /etc/os-release
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:NAME="CentOS Stream"
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:VERSION="9"
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:ID="centos"
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:ID_LIKE="rhel fedora"
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:VERSION_ID="9"
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:PLATFORM_ID="platform:el9"
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:ANSI_COLOR="0;31"
2026-02-17T08:41:17.067 INFO:teuthology.orchestra.run.trial128.stdout:LOGO="fedora-logo-icon"
2026-02-17T08:41:17.068 INFO:teuthology.orchestra.run.trial128.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T08:41:17.068 INFO:teuthology.orchestra.run.trial128.stdout:HOME_URL="https://centos.org/"
2026-02-17T08:41:17.068 INFO:teuthology.orchestra.run.trial128.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T08:41:17.068 INFO:teuthology.orchestra.run.trial128.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T08:41:17.068 INFO:teuthology.orchestra.run.trial128.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T08:41:17.068 INFO:teuthology.provision.fog.trial128:Deploy complete!
2026-02-17T08:41:17.069 DEBUG:teuthology.parallel:result is None
2026-02-17T08:41:17.565 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T08:41:17.565 DEBUG:teuthology.orchestra.run.trial063:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T08:41:17.861 INFO:teuthology.provision.fog.trial063:Node is ready
2026-02-17T08:41:17.861 DEBUG:teuthology.orchestra.run.trial063:> hostname
2026-02-17T08:41:17.916 INFO:teuthology.orchestra.run.trial063.stdout:trial063.front.sepia.ceph.com
2026-02-17T08:41:17.917 DEBUG:teuthology.orchestra.run.trial063:> grep trial063.front.sepia.ceph.com /etc/hosts
2026-02-17T08:41:17.972 INFO:teuthology.orchestra.run.trial063.stdout:10.20.193.63 trial063.front.sepia.ceph.com trial063
2026-02-17T08:41:17.973 DEBUG:teuthology.orchestra.run.trial063:> sudo hostname trial063
2026-02-17T08:41:18.043 DEBUG:teuthology.orchestra.run.trial063:> sudo sed -i -e 's/trial063.front.sepia.ceph.com/trial063/g' /etc/hosts
2026-02-17T08:41:18.109 DEBUG:teuthology.orchestra.run.trial063:> sudo sed -i -e 's/10.20.193.63/10.20.193.63/g' /etc/hosts
2026-02-17T08:41:18.174 DEBUG:teuthology.orchestra.run.trial063:> sudo sed -i -e 's/trial063.front.sepia.ceph.com/trial063/g' /etc/hostname
2026-02-17T08:41:18.239 DEBUG:teuthology.orchestra.run.trial063:> sudo hostname trial063
2026-02-17T08:41:18.304 DEBUG:teuthology.orchestra.run.trial063:> cat /etc/os-release
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:NAME="CentOS Stream"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:VERSION="9"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:ID="centos"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:ID_LIKE="rhel fedora"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:VERSION_ID="9"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:PLATFORM_ID="platform:el9"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:ANSI_COLOR="0;31"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:LOGO="fedora-logo-icon"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:HOME_URL="https://centos.org/"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T08:41:18.361 INFO:teuthology.orchestra.run.trial063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T08:41:18.362 INFO:teuthology.provision.fog.trial063:Deploy complete!
2026-02-17T08:41:18.362 DEBUG:teuthology.parallel:result is None
2026-02-17T08:41:18.859 INFO:teuthology.lock.ops:Checking trial053.front.sepia.ceph.com
2026-02-17T08:41:18.860 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T08:41:18.959 INFO:teuthology.lock.ops:Checking trial063.front.sepia.ceph.com
2026-02-17T08:41:18.959 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T08:41:19.021 INFO:teuthology.lock.ops:Checking trial128.front.sepia.ceph.com
2026-02-17T08:41:19.022 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T08:41:19.079 INFO:teuthology.lock.ops:Updating [trial053.front.sepia.ceph.com]: set os type and version on server
2026-02-17T08:41:19.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial053.front.sepia.ceph.com'
2026-02-17T08:41:19.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:41:19.140 DEBUG:teuthology.orchestra.run.trial053:> true
2026-02-17T08:41:19.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial053.front.sepia.ceph.com'
2026-02-17T08:41:19.213 DEBUG:teuthology.orchestra.run.trial053:> uname -m
2026-02-17T08:41:19.268 INFO:teuthology.orchestra.run.trial053.stdout:x86_64
2026-02-17T08:41:19.268 DEBUG:teuthology.orchestra.run.trial053:> cat /etc/os-release
2026-02-17T08:41:19.325 INFO:teuthology.orchestra.run.trial053.stdout:NAME="CentOS Stream"
2026-02-17T08:41:19.325 INFO:teuthology.orchestra.run.trial053.stdout:VERSION="9"
2026-02-17T08:41:19.325 INFO:teuthology.orchestra.run.trial053.stdout:ID="centos"
2026-02-17T08:41:19.325 INFO:teuthology.orchestra.run.trial053.stdout:ID_LIKE="rhel fedora"
2026-02-17T08:41:19.325 INFO:teuthology.orchestra.run.trial053.stdout:VERSION_ID="9"
2026-02-17T08:41:19.325 INFO:teuthology.orchestra.run.trial053.stdout:PLATFORM_ID="platform:el9"
2026-02-17T08:41:19.326 INFO:teuthology.orchestra.run.trial053.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T08:41:19.326 INFO:teuthology.orchestra.run.trial053.stdout:ANSI_COLOR="0;31"
2026-02-17T08:41:19.326 INFO:teuthology.orchestra.run.trial053.stdout:LOGO="fedora-logo-icon"
2026-02-17T08:41:19.326 INFO:teuthology.orchestra.run.trial053.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T08:41:19.326 INFO:teuthology.orchestra.run.trial053.stdout:HOME_URL="https://centos.org/"
2026-02-17T08:41:19.326 INFO:teuthology.orchestra.run.trial053.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T08:41:19.326 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T08:41:19.326 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T08:41:19.327 INFO:teuthology.lock.ops:Updating trial053.front.sepia.ceph.com on lock server
2026-02-17T08:41:19.428 INFO:teuthology.lock.ops:Updating [trial063.front.sepia.ceph.com]: set os type and version on server
2026-02-17T08:41:19.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial063.front.sepia.ceph.com'
2026-02-17T08:41:19.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:41:19.487 DEBUG:teuthology.orchestra.run.trial063:> true
2026-02-17T08:41:19.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial063.front.sepia.ceph.com'
2026-02-17T08:41:19.563 DEBUG:teuthology.orchestra.run.trial063:> uname -m
2026-02-17T08:41:19.618 INFO:teuthology.orchestra.run.trial063.stdout:x86_64
2026-02-17T08:41:19.619 DEBUG:teuthology.orchestra.run.trial063:> cat /etc/os-release
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:NAME="CentOS Stream"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:VERSION="9"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:ID="centos"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:ID_LIKE="rhel fedora"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:VERSION_ID="9"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:PLATFORM_ID="platform:el9"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:ANSI_COLOR="0;31"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:LOGO="fedora-logo-icon"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:HOME_URL="https://centos.org/"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T08:41:19.674 INFO:teuthology.orchestra.run.trial063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T08:41:19.674 INFO:teuthology.lock.ops:Updating trial063.front.sepia.ceph.com on lock server
2026-02-17T08:41:19.738 INFO:teuthology.lock.ops:Updating [trial128.front.sepia.ceph.com]: set os type and version on server
2026-02-17T08:41:19.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial128.front.sepia.ceph.com'
2026-02-17T08:41:19.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial128.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T08:41:19.801 DEBUG:teuthology.orchestra.run.trial128:> true
2026-02-17T08:41:19.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial128.front.sepia.ceph.com'
2026-02-17T08:41:19.876 DEBUG:teuthology.orchestra.run.trial128:> uname -m
2026-02-17T08:41:19.932 INFO:teuthology.orchestra.run.trial128.stdout:x86_64
2026-02-17T08:41:19.933 DEBUG:teuthology.orchestra.run.trial128:> cat /etc/os-release
2026-02-17T08:41:19.988 INFO:teuthology.orchestra.run.trial128.stdout:NAME="CentOS Stream"
2026-02-17T08:41:19.988 INFO:teuthology.orchestra.run.trial128.stdout:VERSION="9"
2026-02-17T08:41:19.988 INFO:teuthology.orchestra.run.trial128.stdout:ID="centos"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:ID_LIKE="rhel fedora"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:VERSION_ID="9"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:PLATFORM_ID="platform:el9"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:ANSI_COLOR="0;31"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:LOGO="fedora-logo-icon"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:HOME_URL="https://centos.org/"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T08:41:19.989 INFO:teuthology.orchestra.run.trial128.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T08:41:19.990 INFO:teuthology.lock.ops:Updating trial128.front.sepia.ceph.com on lock server
2026-02-17T08:41:20.093 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:41:20.189 INFO:teuthology.dispatcher.supervisor:Running job 51182
2026-02-17T08:41:20.189 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_skanta@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51182 --name skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial --description rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/mon_recovery} -- /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51182/orig.config.yaml
2026-02-17T08:41:20.190 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51182
2026-02-17T08:41:20.190 INFO:teuthology.dispatcher.supervisor:Job PID: 3548893
2026-02-17T08:41:20.190 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T08:43:20.191 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:45:20.311 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:47:20.432 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:49:20.552 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:51:20.685 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:53:20.818 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:55:20.923 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:57:21.043 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T08:57:21.125 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T08:57:21.316 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T08:57:22.089 INFO:teuthology.orchestra.console.trial063:Power off
2026-02-17T08:57:22.089 DEBUG:teuthology.orchestra.console.trial063:pexpect command: ipmitool -H trial063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T08:57:22.098 INFO:teuthology.orchestra.console.trial128:Power off
2026-02-17T08:57:22.099 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T08:57:22.116 INFO:teuthology.orchestra.console.trial053:Power off
2026-02-17T08:57:22.117 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T08:57:22.128 DEBUG:teuthology.orchestra.console.trial063:power off output: Chassis Power Control: Down/Off
2026-02-17T08:57:22.136 DEBUG:teuthology.orchestra.console.trial128:power off output: Chassis Power Control: Down/Off
2026-02-17T08:57:22.156 DEBUG:teuthology.orchestra.console.trial053:power off output: Chassis Power Control: Down/Off
2026-02-17T08:57:26.128 DEBUG:teuthology.orchestra.console.trial063:pexpect command: ipmitool -H trial063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:57:26.137 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:57:26.156 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:57:26.237 DEBUG:teuthology.orchestra.console.trial063:check power output: Chassis Power is on
2026-02-17T08:57:26.245 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is on
2026-02-17T08:57:26.264 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is on
2026-02-17T08:57:30.239 DEBUG:teuthology.orchestra.console.trial063:pexpect command: ipmitool -H trial063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:57:30.248 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:57:30.266 DEBUG:teuthology.orchestra.console.trial053:pexpect command: ipmitool -H trial053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T08:57:30.350 DEBUG:teuthology.orchestra.console.trial063:check power output: Chassis Power is off
2026-02-17T08:57:30.351 INFO:teuthology.orchestra.console.trial063:Power off completed
2026-02-17T08:57:30.358 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is off
2026-02-17T08:57:30.359 INFO:teuthology.orchestra.console.trial128:Power off completed
2026-02-17T08:57:30.376 DEBUG:teuthology.orchestra.console.trial053:check power output: Chassis Power is off
2026-02-17T08:57:30.376 INFO:teuthology.orchestra.console.trial053:Power off completed
2026-02-17T08:57:30.640 INFO:teuthology.lock.ops:unlocked: trial063.front.sepia.ceph.com
2026-02-17T08:57:30.650 INFO:teuthology.lock.ops:unlocked: trial128.front.sepia.ceph.com
2026-02-17T08:57:30.653 INFO:teuthology.lock.ops:unlocked: trial053.front.sepia.ceph.com