2026-02-17T01:10:23.626 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-17T01:10:23.627 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:10:23.701 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:10:23.967 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f26b664cf80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f26b5e68ae0>, signals=[15])
2026-02-17T01:10:23.968 INFO:teuthology.lock.ops:Start node 'trial007.front.sepia.ceph.com' reimaging
2026-02-17T01:10:23.968 INFO:teuthology.lock.ops:Updating [trial007.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T01:10:23.968 INFO:teuthology.lock.ops:Updating trial007.front.sepia.ceph.com on lock server
2026-02-17T01:10:24.025 INFO:teuthology.lock.ops:Start node 'trial058.front.sepia.ceph.com' reimaging
2026-02-17T01:10:24.025 INFO:teuthology.lock.ops:Updating [trial058.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T01:10:24.025 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server
2026-02-17T01:10:24.082 INFO:teuthology.lock.ops:Start node 'trial096.front.sepia.ceph.com' reimaging
2026-02-17T01:10:24.083 INFO:teuthology.lock.ops:Updating [trial096.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T01:10:24.083 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server
2026-02-17T01:10:24.324 DEBUG:teuthology.provision.fog.trial007:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T01:10:24.335 DEBUG:teuthology.provision.fog.trial058:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T01:10:24.341 DEBUG:teuthology.provision.fog.trial096:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T01:10:24.375 INFO:teuthology.provision.fog.trial007:Scheduling deploy of centos 9.stream
2026-02-17T01:10:24.388 INFO:teuthology.provision.fog.trial058:Scheduling deploy of centos 9.stream
2026-02-17T01:10:24.392 INFO:teuthology.provision.fog.trial096:Scheduling deploy of centos 9.stream
2026-02-17T01:10:25.663 INFO:teuthology.orchestra.console.trial007:Power off
2026-02-17T01:10:25.663 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T01:10:25.683 INFO:teuthology.orchestra.console.trial096:Power off
2026-02-17T01:10:25.683 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T01:10:25.693 INFO:teuthology.orchestra.console.trial058:Power off
2026-02-17T01:10:25.693 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T01:10:25.702 DEBUG:teuthology.orchestra.console.trial007:power off output: Chassis Power Control: Down/Off
2026-02-17T01:10:25.721 DEBUG:teuthology.orchestra.console.trial096:power off output: Chassis Power Control: Down/Off
2026-02-17T01:10:25.731 DEBUG:teuthology.orchestra.console.trial058:power off output: Chassis Power Control: Down/Off
2026-02-17T01:10:29.707 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T01:10:29.722 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T01:10:29.732 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T01:10:29.816 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is off
2026-02-17T01:10:29.816 INFO:teuthology.orchestra.console.trial007:Power off completed
2026-02-17T01:10:29.830 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off
2026-02-17T01:10:29.830 INFO:teuthology.orchestra.console.trial096:Power off completed
2026-02-17T01:10:29.840 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is off
2026-02-17T01:10:29.840 INFO:teuthology.orchestra.console.trial058:Power off completed
2026-02-17T01:10:29.918 INFO:teuthology.orchestra.console.trial007:Power on
2026-02-17T01:10:29.918 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T01:10:29.931 INFO:teuthology.orchestra.console.trial096:Power on
2026-02-17T01:10:29.931 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T01:10:29.941 INFO:teuthology.orchestra.console.trial058:Power on
2026-02-17T01:10:29.941 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T01:10:29.956 DEBUG:teuthology.orchestra.console.trial007:power on output: Chassis Power Control: Up/On
2026-02-17T01:10:29.970 DEBUG:teuthology.orchestra.console.trial096:power on output: Chassis Power Control: Up/On
2026-02-17T01:10:29.980 DEBUG:teuthology.orchestra.console.trial058:power on output: Chassis Power Control: Up/On
2026-02-17T01:10:33.960 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T01:10:33.971 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T01:10:33.980 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T01:10:34.070 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is on
2026-02-17T01:10:34.070 INFO:teuthology.orchestra.console.trial007:Power on completed
2026-02-17T01:10:34.080 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is on
2026-02-17T01:10:34.080 INFO:teuthology.orchestra.console.trial096:Power on completed
2026-02-17T01:10:34.088 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is on
2026-02-17T01:10:34.088 INFO:teuthology.orchestra.console.trial058:Power on completed
2026-02-17T01:10:34.172 INFO:teuthology.provision.fog.trial007:Waiting for deploy to finish
2026-02-17T01:10:34.182 INFO:teuthology.provision.fog.trial096:Waiting for deploy to finish
2026-02-17T01:10:34.189 INFO:teuthology.provision.fog.trial058:Waiting for deploy to finish
2026-02-17T01:12:21.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:12:21.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:12:21.953 ERROR:teuthology.orchestra.connection:Error authenticating with trial058.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T01:12:37.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:12:40.128 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7
2026-02-17T01:12:46.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:12:49.216 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7
2026-02-17T01:12:55.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:12:58.304 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7
2026-02-17T01:13:04.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:13:07.392 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7
2026-02-17T01:13:13.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:13:21.852 WARNING:teuthology.provision.fog.trial096:timed out
2026-02-17T01:13:25.956 WARNING:teuthology.provision.fog.trial058:timed out
2026-02-17T01:13:27.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:13:31.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:13:35.170 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T01:13:35.170 DEBUG:teuthology.orchestra.run.trial058:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T01:13:39.290 ERROR:teuthology.orchestra.connection:Error authenticating with trial096.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-17T01:13:43.403 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T01:13:43.403 DEBUG:teuthology.orchestra.run.trial096:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T01:13:46.218 INFO:teuthology.provision.fog.trial058:Node is ready
2026-02-17T01:13:46.219 DEBUG:teuthology.orchestra.run.trial058:> hostname
2026-02-17T01:13:46.238 INFO:teuthology.orchestra.run.trial058.stdout:trial058.front.sepia.ceph.com
2026-02-17T01:13:46.239 DEBUG:teuthology.orchestra.run.trial058:> grep trial058.front.sepia.ceph.com /etc/hosts
2026-02-17T01:13:46.300 INFO:teuthology.orchestra.run.trial058.stdout:10.20.193.58 trial058.front.sepia.ceph.com trial058
2026-02-17T01:13:46.301 DEBUG:teuthology.orchestra.run.trial058:> sudo hostname trial058
2026-02-17T01:13:46.374 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/trial058.front.sepia.ceph.com/trial058/g' /etc/hosts
2026-02-17T01:13:46.442 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/10.20.193.58/10.20.193.58/g' /etc/hosts
2026-02-17T01:13:46.510 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/trial058.front.sepia.ceph.com/trial058/g' /etc/hostname
2026-02-17T01:13:46.578 DEBUG:teuthology.orchestra.run.trial058:> sudo hostname trial058
2026-02-17T01:13:46.646 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T01:13:46.706 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T01:13:46.707 INFO:teuthology.provision.fog.trial058:Deploy complete!
2026-02-17T01:13:46.707 DEBUG:teuthology.parallel:result is None
2026-02-17T01:13:48.206 INFO:teuthology.provision.fog.trial096:Node is ready
2026-02-17T01:13:48.207 DEBUG:teuthology.orchestra.run.trial096:> hostname
2026-02-17T01:13:48.224 INFO:teuthology.orchestra.run.trial096.stdout:trial096.front.sepia.ceph.com
2026-02-17T01:13:48.224 DEBUG:teuthology.orchestra.run.trial096:> grep trial096.front.sepia.ceph.com /etc/hosts
2026-02-17T01:13:48.279 INFO:teuthology.orchestra.run.trial096.stdout:10.20.193.96 trial096.front.sepia.ceph.com trial096
2026-02-17T01:13:48.279 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname trial096
2026-02-17T01:13:48.347 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/trial096.front.sepia.ceph.com/trial096/g' /etc/hosts
2026-02-17T01:13:48.410 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/10.20.193.96/10.20.193.96/g' /etc/hosts
2026-02-17T01:13:48.474 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/trial096.front.sepia.ceph.com/trial096/g' /etc/hostname
2026-02-17T01:13:48.537 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname trial096
2026-02-17T01:13:48.598 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release
2026-02-17T01:13:48.653 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream"
2026-02-17T01:13:48.653 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9"
2026-02-17T01:13:48.653 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos"
2026-02-17T01:13:48.653 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora"
2026-02-17T01:13:48.653 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T01:13:48.654 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T01:13:48.655 INFO:teuthology.provision.fog.trial096:Deploy complete!
2026-02-17T01:13:48.655 DEBUG:teuthology.parallel:result is None
2026-02-17T01:13:49.303 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T01:13:49.303 DEBUG:teuthology.orchestra.run.trial007:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T01:13:49.457 INFO:teuthology.provision.fog.trial007:Node is ready
2026-02-17T01:13:49.457 DEBUG:teuthology.orchestra.run.trial007:> hostname
2026-02-17T01:13:49.513 INFO:teuthology.orchestra.run.trial007.stdout:trial007.front.sepia.ceph.com
2026-02-17T01:13:49.513 DEBUG:teuthology.orchestra.run.trial007:> grep trial007.front.sepia.ceph.com /etc/hosts
2026-02-17T01:13:49.569 INFO:teuthology.orchestra.run.trial007.stdout:10.20.193.7 trial007.front.sepia.ceph.com trial007
2026-02-17T01:13:49.569 DEBUG:teuthology.orchestra.run.trial007:> sudo hostname trial007
2026-02-17T01:13:49.638 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/trial007.front.sepia.ceph.com/trial007/g' /etc/hosts
2026-02-17T01:13:49.705 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/10.20.193.7/10.20.193.7/g' /etc/hosts
2026-02-17T01:13:49.769 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/trial007.front.sepia.ceph.com/trial007/g' /etc/hostname
2026-02-17T01:13:49.833 DEBUG:teuthology.orchestra.run.trial007:> sudo hostname trial007
2026-02-17T01:13:49.896 DEBUG:teuthology.orchestra.run.trial007:> cat /etc/os-release
2026-02-17T01:13:49.951 INFO:teuthology.orchestra.run.trial007.stdout:NAME="CentOS Stream"
2026-02-17T01:13:49.951 INFO:teuthology.orchestra.run.trial007.stdout:VERSION="9"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:ID="centos"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:ID_LIKE="rhel fedora"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:VERSION_ID="9"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:PLATFORM_ID="platform:el9"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:ANSI_COLOR="0;31"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:LOGO="fedora-logo-icon"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:HOME_URL="https://centos.org/"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T01:13:49.952 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T01:13:49.952 INFO:teuthology.provision.fog.trial007:Deploy complete!
2026-02-17T01:13:49.952 DEBUG:teuthology.parallel:result is None
2026-02-17T01:13:50.446 INFO:teuthology.lock.ops:Checking trial007.front.sepia.ceph.com
2026-02-17T01:13:50.446 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T01:13:50.521 INFO:teuthology.lock.ops:Checking trial058.front.sepia.ceph.com
2026-02-17T01:13:50.521 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T01:13:50.580 INFO:teuthology.lock.ops:Checking trial096.front.sepia.ceph.com
2026-02-17T01:13:50.580 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T01:13:50.638 INFO:teuthology.lock.ops:Updating [trial007.front.sepia.ceph.com]: set os type and version on server
2026-02-17T01:13:50.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial007.front.sepia.ceph.com'
2026-02-17T01:13:50.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:13:50.700 DEBUG:teuthology.orchestra.run.trial007:> true
2026-02-17T01:13:50.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial007.front.sepia.ceph.com'
2026-02-17T01:13:50.771 DEBUG:teuthology.orchestra.run.trial007:> uname -m
2026-02-17T01:13:50.827 INFO:teuthology.orchestra.run.trial007.stdout:x86_64
2026-02-17T01:13:50.827 DEBUG:teuthology.orchestra.run.trial007:> cat /etc/os-release
2026-02-17T01:13:50.884 INFO:teuthology.orchestra.run.trial007.stdout:NAME="CentOS Stream"
2026-02-17T01:13:50.884 INFO:teuthology.orchestra.run.trial007.stdout:VERSION="9"
2026-02-17T01:13:50.884 INFO:teuthology.orchestra.run.trial007.stdout:ID="centos"
2026-02-17T01:13:50.884 INFO:teuthology.orchestra.run.trial007.stdout:ID_LIKE="rhel fedora"
2026-02-17T01:13:50.884 INFO:teuthology.orchestra.run.trial007.stdout:VERSION_ID="9"
2026-02-17T01:13:50.884 INFO:teuthology.orchestra.run.trial007.stdout:PLATFORM_ID="platform:el9"
2026-02-17T01:13:50.884 INFO:teuthology.orchestra.run.trial007.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T01:13:50.885 INFO:teuthology.orchestra.run.trial007.stdout:ANSI_COLOR="0;31"
2026-02-17T01:13:50.885 INFO:teuthology.orchestra.run.trial007.stdout:LOGO="fedora-logo-icon"
2026-02-17T01:13:50.885 INFO:teuthology.orchestra.run.trial007.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T01:13:50.885 INFO:teuthology.orchestra.run.trial007.stdout:HOME_URL="https://centos.org/"
2026-02-17T01:13:50.885 INFO:teuthology.orchestra.run.trial007.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T01:13:50.885 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T01:13:50.885 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T01:13:50.886 INFO:teuthology.lock.ops:Updating trial007.front.sepia.ceph.com on lock server
2026-02-17T01:13:50.980 INFO:teuthology.lock.ops:Updating [trial058.front.sepia.ceph.com]: set os type and version on server
2026-02-17T01:13:50.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com'
2026-02-17T01:13:50.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:13:51.044 DEBUG:teuthology.orchestra.run.trial058:> true
2026-02-17T01:13:51.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com'
2026-02-17T01:13:51.116 DEBUG:teuthology.orchestra.run.trial058:> uname -m
2026-02-17T01:13:51.173 INFO:teuthology.orchestra.run.trial058.stdout:x86_64
2026-02-17T01:13:51.173 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release
2026-02-17T01:13:51.229 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T01:13:51.230 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T01:13:51.231 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server
2026-02-17T01:13:51.327 INFO:teuthology.lock.ops:Updating [trial096.front.sepia.ceph.com]: set os type and version on server
2026-02-17T01:13:51.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial096.front.sepia.ceph.com'
2026-02-17T01:13:51.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T01:13:51.390 DEBUG:teuthology.orchestra.run.trial096:> true
2026-02-17T01:13:51.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial096.front.sepia.ceph.com'
2026-02-17T01:13:51.464 DEBUG:teuthology.orchestra.run.trial096:> uname -m
2026-02-17T01:13:51.519 INFO:teuthology.orchestra.run.trial096.stdout:x86_64
2026-02-17T01:13:51.519 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release
2026-02-17T01:13:51.574 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream"
2026-02-17T01:13:51.574 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9"
2026-02-17T01:13:51.574 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T01:13:51.575 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T01:13:51.575 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server
2026-02-17T01:13:51.664 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:13:51.748 INFO:teuthology.dispatcher.supervisor:Running job 48753
2026-02-17T01:13:51.748 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_jayaprakash@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48753 --name jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial --description rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/3-size-2-min-size 1-install/tentacle backoff/peering_and_degraded ceph clusters/{three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} -- /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48753/orig.config.yaml
2026-02-17T01:13:51.749 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48753
2026-02-17T01:13:51.749 INFO:teuthology.dispatcher.supervisor:Job PID: 1254842
2026-02-17T01:13:51.749 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T01:15:51.749 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:17:51.863 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:19:51.986 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:21:52.083 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:23:52.195 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:25:52.338 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:27:52.440 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:29:52.558 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:31:52.663 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:33:52.790 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:35:52.879 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:37:52.955 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:39:53.075 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:41:53.200 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:43:53.320 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:45:53.440 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:47:53.562 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:49:53.692 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:51:53.815 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:53:53.939 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:55:54.059 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:57:54.181 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T01:59:54.304 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:01:54.427 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:03:54.555 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:05:54.679 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:07:54.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:09:54.921 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:11:55.042 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:13:55.165 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:15:55.287 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T02:15:55.408 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T02:15:55.591 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T02:15:56.302 INFO:teuthology.orchestra.console.trial007:Power off
2026-02-17T02:15:56.302 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T02:15:56.311 INFO:teuthology.orchestra.console.trial058:Power off
2026-02-17T02:15:56.311 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T02:15:56.330 INFO:teuthology.orchestra.console.trial096:Power off
2026-02-17T02:15:56.331 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T02:15:56.342 DEBUG:teuthology.orchestra.console.trial007:power off output: Chassis Power Control: Down/Off
2026-02-17T02:15:56.349 DEBUG:teuthology.orchestra.console.trial058:power off output: Chassis Power Control: Down/Off
2026-02-17T02:15:56.368 DEBUG:teuthology.orchestra.console.trial096:power off output: Chassis Power Control: Down/Off
2026-02-17T02:16:00.343 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T02:16:00.351 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T02:16:00.369 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T02:16:00.453 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is on
2026-02-17T02:16:00.460 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is on
2026-02-17T02:16:00.479 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is on
2026-02-17T02:16:04.454 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T02:16:04.462 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T02:16:04.480 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T02:16:04.563 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is off
2026-02-17T02:16:04.564 INFO:teuthology.orchestra.console.trial007:Power off completed
2026-02-17T02:16:04.570 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is off
2026-02-17T02:16:04.570 INFO:teuthology.orchestra.console.trial058:Power off completed
2026-02-17T02:16:04.590 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off
2026-02-17T02:16:04.590 INFO:teuthology.orchestra.console.trial096:Power off completed
2026-02-17T02:16:04.857 INFO:teuthology.lock.ops:unlocked: trial007.front.sepia.ceph.com
2026-02-17T02:16:04.866 INFO:teuthology.lock.ops:unlocked: trial058.front.sepia.ceph.com
2026-02-17T02:16:04.870 INFO:teuthology.lock.ops:unlocked: trial096.front.sepia.ceph.com