2026-02-13T01:10:12.862 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T01:10:12.863 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:10:12.931 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:10:13.172 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x77ba3d541250>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x77ba3cf73ec0>, signals=[15])
2026-02-13T01:10:13.172 INFO:teuthology.lock.ops:Start node 'trial116.front.sepia.ceph.com' reimaging
2026-02-13T01:10:13.172 INFO:teuthology.lock.ops:Updating [trial116.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T01:10:13.172 INFO:teuthology.lock.ops:Updating trial116.front.sepia.ceph.com on lock server
2026-02-13T01:10:13.228 INFO:teuthology.lock.ops:Start node 'trial128.front.sepia.ceph.com' reimaging
2026-02-13T01:10:13.229 INFO:teuthology.lock.ops:Updating [trial128.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T01:10:13.229 INFO:teuthology.lock.ops:Updating trial128.front.sepia.ceph.com on lock server
2026-02-13T01:10:13.286 INFO:teuthology.lock.ops:Start node 'trial133.front.sepia.ceph.com' reimaging
2026-02-13T01:10:13.286 INFO:teuthology.lock.ops:Updating [trial133.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T01:10:13.286 INFO:teuthology.lock.ops:Updating trial133.front.sepia.ceph.com on lock server
2026-02-13T01:10:13.515 DEBUG:teuthology.provision.fog.trial128:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T01:10:13.515 DEBUG:teuthology.provision.fog.trial116:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T01:10:13.541 INFO:teuthology.provision.fog.trial116:Scheduling deploy of centos 9.stream
2026-02-13T01:10:13.558 INFO:teuthology.provision.fog.trial128:Scheduling deploy of centos 9.stream
2026-02-13T01:10:13.570 DEBUG:teuthology.provision.fog.trial133:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T01:10:13.588 INFO:teuthology.provision.fog.trial133:Scheduling deploy of centos 9.stream
2026-02-13T01:10:14.781 INFO:teuthology.orchestra.console.trial116:Power off
2026-02-13T01:10:14.781 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:10:14.819 DEBUG:teuthology.orchestra.console.trial116:power off output: Chassis Power Control: Down/Off
2026-02-13T01:10:15.026 INFO:teuthology.orchestra.console.trial133:Power off
2026-02-13T01:10:15.026 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:10:15.036 INFO:teuthology.orchestra.console.trial128:Power off
2026-02-13T01:10:15.036 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:10:15.063 DEBUG:teuthology.orchestra.console.trial133:power off output: Chassis Power Control: Down/Off
2026-02-13T01:10:15.074 DEBUG:teuthology.orchestra.console.trial128:power off output: Chassis Power Control: Down/Off
2026-02-13T01:10:18.824 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:18.933 DEBUG:teuthology.orchestra.console.trial116:check power output: Chassis Power is off
2026-02-13T01:10:18.933 INFO:teuthology.orchestra.console.trial116:Power off completed
2026-02-13T01:10:19.033 INFO:teuthology.orchestra.console.trial116:Power on
2026-02-13T01:10:19.034 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T01:10:19.065 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:19.073 DEBUG:teuthology.orchestra.console.trial116:power on output: Chassis Power Control: Up/On
2026-02-13T01:10:19.074 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:19.174 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is off
2026-02-13T01:10:19.174 INFO:teuthology.orchestra.console.trial133:Power off completed
2026-02-13T01:10:19.183 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is off
2026-02-13T01:10:19.183 INFO:teuthology.orchestra.console.trial128:Power off completed
2026-02-13T01:10:19.275 INFO:teuthology.orchestra.console.trial133:Power on
2026-02-13T01:10:19.276 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T01:10:19.284 INFO:teuthology.orchestra.console.trial128:Power on
2026-02-13T01:10:19.284 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T01:10:19.315 DEBUG:teuthology.orchestra.console.trial133:power on output: Chassis Power Control: Up/On
2026-02-13T01:10:19.322 DEBUG:teuthology.orchestra.console.trial128:power on output: Chassis Power Control: Up/On
2026-02-13T01:10:23.079 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:23.189 DEBUG:teuthology.orchestra.console.trial116:check power output: Chassis Power is on
2026-02-13T01:10:23.189 INFO:teuthology.orchestra.console.trial116:Power on completed
2026-02-13T01:10:23.290 INFO:teuthology.provision.fog.trial116:Waiting for deploy to finish
2026-02-13T01:10:23.315 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:23.323 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:23.425 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is on
2026-02-13T01:10:23.425 INFO:teuthology.orchestra.console.trial133:Power on completed
2026-02-13T01:10:23.432 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is on
2026-02-13T01:10:23.432 INFO:teuthology.orchestra.console.trial128:Power on completed
2026-02-13T01:10:23.526 INFO:teuthology.provision.fog.trial133:Waiting for deploy to finish
2026-02-13T01:10:23.532 INFO:teuthology.provision.fog.trial128:Waiting for deploy to finish
2026-02-13T01:12:31.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:12:31.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:12:31.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial128.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:12:45.405 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133
2026-02-13T01:12:45.661 WARNING:teuthology.provision.fog.trial116:[Errno None] Unable to connect to port 22 on 10.20.193.116
2026-02-13T01:12:46.237 WARNING:teuthology.provision.fog.trial128:[Errno None] Unable to connect to port 22 on 10.20.193.128
2026-02-13T01:12:51.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:12:51.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:12:52.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial128.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:12:54.493 WARNING:teuthology.provision.fog.trial133:[Errno None] Unable to connect to port 22 on 10.20.193.133
2026-02-13T01:12:54.749 WARNING:teuthology.provision.fog.trial116:[Errno None] Unable to connect to port 22 on 10.20.193.116
2026-02-13T01:13:00.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:13:00.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:13:28.097 ERROR:teuthology.orchestra.connection:Error authenticating with trial128.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T01:13:32.206 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T01:13:32.206 DEBUG:teuthology.orchestra.run.trial128:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T01:13:32.417 INFO:teuthology.provision.fog.trial128:Node is ready
2026-02-13T01:13:32.417 DEBUG:teuthology.orchestra.run.trial128:> hostname
2026-02-13T01:13:32.474 INFO:teuthology.orchestra.run.trial128.stdout:trial128.front.sepia.ceph.com
2026-02-13T01:13:32.474 DEBUG:teuthology.orchestra.run.trial128:> grep trial128.front.sepia.ceph.com /etc/hosts
2026-02-13T01:13:32.530 INFO:teuthology.orchestra.run.trial128.stdout:10.20.193.128 trial128.front.sepia.ceph.com trial128
2026-02-13T01:13:32.531 DEBUG:teuthology.orchestra.run.trial128:> sudo hostname trial128
2026-02-13T01:13:32.602 DEBUG:teuthology.orchestra.run.trial128:> sudo sed -i -e 's/trial128.front.sepia.ceph.com/trial128/g' /etc/hosts
2026-02-13T01:13:32.668 DEBUG:teuthology.orchestra.run.trial128:> sudo sed -i -e 's/10.20.193.128/10.20.193.128/g' /etc/hosts
2026-02-13T01:13:32.735 DEBUG:teuthology.orchestra.run.trial128:> sudo sed -i -e 's/trial128.front.sepia.ceph.com/trial128/g' /etc/hostname
2026-02-13T01:13:32.801 DEBUG:teuthology.orchestra.run.trial128:> sudo hostname trial128
2026-02-13T01:13:32.866 DEBUG:teuthology.orchestra.run.trial128:> cat /etc/os-release
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:NAME="CentOS Stream"
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:VERSION="9"
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:ID="centos"
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:VERSION_ID="9"
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:ANSI_COLOR="0;31"
2026-02-13T01:13:32.924 INFO:teuthology.orchestra.run.trial128.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:13:32.925 INFO:teuthology.orchestra.run.trial128.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:13:32.925 INFO:teuthology.orchestra.run.trial128.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:13:32.925 INFO:teuthology.orchestra.run.trial128.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:13:32.925 INFO:teuthology.orchestra.run.trial128.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:13:32.925 INFO:teuthology.orchestra.run.trial128.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:13:32.926 INFO:teuthology.provision.fog.trial128:Deploy complete!
2026-02-13T01:13:32.927 DEBUG:teuthology.parallel:result is None
2026-02-13T01:13:36.287 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T01:13:36.287 DEBUG:teuthology.orchestra.run.trial133:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T01:13:36.480 INFO:teuthology.provision.fog.trial133:Node is ready
2026-02-13T01:13:36.481 DEBUG:teuthology.orchestra.run.trial133:> hostname
2026-02-13T01:13:36.535 INFO:teuthology.orchestra.run.trial133.stdout:trial133.front.sepia.ceph.com
2026-02-13T01:13:36.536 DEBUG:teuthology.orchestra.run.trial133:> grep trial133.front.sepia.ceph.com /etc/hosts
2026-02-13T01:13:36.592 INFO:teuthology.orchestra.run.trial133.stdout:10.20.193.133 trial133.front.sepia.ceph.com trial133
2026-02-13T01:13:36.593 DEBUG:teuthology.orchestra.run.trial133:> sudo hostname trial133
2026-02-13T01:13:36.661 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/trial133.front.sepia.ceph.com/trial133/g' /etc/hosts
2026-02-13T01:13:36.801 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T01:13:36.801 DEBUG:teuthology.orchestra.run.trial116:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T01:13:36.805 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/10.20.193.133/10.20.193.133/g' /etc/hosts
2026-02-13T01:13:36.868 DEBUG:teuthology.orchestra.run.trial133:> sudo sed -i -e 's/trial133.front.sepia.ceph.com/trial133/g' /etc/hostname
2026-02-13T01:13:36.931 DEBUG:teuthology.orchestra.run.trial133:> sudo hostname trial133
2026-02-13T01:13:36.950 INFO:teuthology.provision.fog.trial116:Node is ready
2026-02-13T01:13:36.950 DEBUG:teuthology.orchestra.run.trial116:> hostname
2026-02-13T01:13:36.994 DEBUG:teuthology.orchestra.run.trial133:> cat /etc/os-release
2026-02-13T01:13:37.006 INFO:teuthology.orchestra.run.trial116.stdout:trial116.front.sepia.ceph.com
2026-02-13T01:13:37.007 DEBUG:teuthology.orchestra.run.trial116:> grep trial116.front.sepia.ceph.com /etc/hosts
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:NAME="CentOS Stream"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:VERSION="9"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:ID="centos"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:VERSION_ID="9"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:ANSI_COLOR="0;31"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:13:37.051 INFO:teuthology.orchestra.run.trial133.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:13:37.052 INFO:teuthology.orchestra.run.trial133.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:13:37.052 INFO:teuthology.orchestra.run.trial133.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:13:37.052 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:13:37.052 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:13:37.052 INFO:teuthology.provision.fog.trial133:Deploy complete!
2026-02-13T01:13:37.053 DEBUG:teuthology.parallel:result is None
2026-02-13T01:13:37.062 INFO:teuthology.orchestra.run.trial116.stdout:10.20.193.116 trial116.front.sepia.ceph.com trial116
2026-02-13T01:13:37.063 DEBUG:teuthology.orchestra.run.trial116:> sudo hostname trial116
2026-02-13T01:13:37.131 DEBUG:teuthology.orchestra.run.trial116:> sudo sed -i -e 's/trial116.front.sepia.ceph.com/trial116/g' /etc/hosts
2026-02-13T01:13:37.197 DEBUG:teuthology.orchestra.run.trial116:> sudo sed -i -e 's/10.20.193.116/10.20.193.116/g' /etc/hosts
2026-02-13T01:13:37.261 DEBUG:teuthology.orchestra.run.trial116:> sudo sed -i -e 's/trial116.front.sepia.ceph.com/trial116/g' /etc/hostname
2026-02-13T01:13:37.325 DEBUG:teuthology.orchestra.run.trial116:> sudo hostname trial116
2026-02-13T01:13:37.388 DEBUG:teuthology.orchestra.run.trial116:> cat /etc/os-release
2026-02-13T01:13:37.444 INFO:teuthology.orchestra.run.trial116.stdout:NAME="CentOS Stream"
2026-02-13T01:13:37.444 INFO:teuthology.orchestra.run.trial116.stdout:VERSION="9"
2026-02-13T01:13:37.444 INFO:teuthology.orchestra.run.trial116.stdout:ID="centos"
2026-02-13T01:13:37.444 INFO:teuthology.orchestra.run.trial116.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:13:37.444 INFO:teuthology.orchestra.run.trial116.stdout:VERSION_ID="9"
2026-02-13T01:13:37.444 INFO:teuthology.orchestra.run.trial116.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:13:37.444 INFO:teuthology.orchestra.run.trial116.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:13:37.445 INFO:teuthology.orchestra.run.trial116.stdout:ANSI_COLOR="0;31"
2026-02-13T01:13:37.445 INFO:teuthology.orchestra.run.trial116.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:13:37.445 INFO:teuthology.orchestra.run.trial116.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:13:37.445 INFO:teuthology.orchestra.run.trial116.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:13:37.445 INFO:teuthology.orchestra.run.trial116.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:13:37.445 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:13:37.445 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:13:37.445 INFO:teuthology.provision.fog.trial116:Deploy complete!
2026-02-13T01:13:37.446 DEBUG:teuthology.parallel:result is None
2026-02-13T01:13:37.968 INFO:teuthology.lock.ops:Checking trial116.front.sepia.ceph.com
2026-02-13T01:13:37.969 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T01:13:38.075 INFO:teuthology.lock.ops:Checking trial128.front.sepia.ceph.com
2026-02-13T01:13:38.075 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T01:13:38.143 INFO:teuthology.lock.ops:Checking trial133.front.sepia.ceph.com
2026-02-13T01:13:38.143 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T01:13:38.199 INFO:teuthology.lock.ops:Updating [trial116.front.sepia.ceph.com]: set os type and version on server
2026-02-13T01:13:38.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial116.front.sepia.ceph.com'
2026-02-13T01:13:38.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:13:38.261 DEBUG:teuthology.orchestra.run.trial116:> true
2026-02-13T01:13:38.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial116.front.sepia.ceph.com'
2026-02-13T01:13:38.341 DEBUG:teuthology.orchestra.run.trial116:> uname -m
2026-02-13T01:13:38.397 INFO:teuthology.orchestra.run.trial116.stdout:x86_64
2026-02-13T01:13:38.398 DEBUG:teuthology.orchestra.run.trial116:> cat /etc/os-release
2026-02-13T01:13:38.454 INFO:teuthology.orchestra.run.trial116.stdout:NAME="CentOS Stream"
2026-02-13T01:13:38.454 INFO:teuthology.orchestra.run.trial116.stdout:VERSION="9"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:ID="centos"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:VERSION_ID="9"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:ANSI_COLOR="0;31"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:13:38.455 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:13:38.456 INFO:teuthology.lock.ops:Updating trial116.front.sepia.ceph.com on lock server
2026-02-13T01:13:38.559 INFO:teuthology.lock.ops:Updating [trial128.front.sepia.ceph.com]: set os type and version on server
2026-02-13T01:13:38.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial128.front.sepia.ceph.com'
2026-02-13T01:13:38.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial128.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:13:38.629 DEBUG:teuthology.orchestra.run.trial128:> true
2026-02-13T01:13:38.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial128.front.sepia.ceph.com'
2026-02-13T01:13:38.716 DEBUG:teuthology.orchestra.run.trial128:> uname -m
2026-02-13T01:13:38.772 INFO:teuthology.orchestra.run.trial128.stdout:x86_64
2026-02-13T01:13:38.772 DEBUG:teuthology.orchestra.run.trial128:> cat /etc/os-release
2026-02-13T01:13:38.827 INFO:teuthology.orchestra.run.trial128.stdout:NAME="CentOS Stream"
2026-02-13T01:13:38.827 INFO:teuthology.orchestra.run.trial128.stdout:VERSION="9"
2026-02-13T01:13:38.827 INFO:teuthology.orchestra.run.trial128.stdout:ID="centos"
2026-02-13T01:13:38.827 INFO:teuthology.orchestra.run.trial128.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:13:38.827 INFO:teuthology.orchestra.run.trial128.stdout:VERSION_ID="9"
2026-02-13T01:13:38.827 INFO:teuthology.orchestra.run.trial128.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:13:38.828 INFO:teuthology.orchestra.run.trial128.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:13:38.828 INFO:teuthology.orchestra.run.trial128.stdout:ANSI_COLOR="0;31"
2026-02-13T01:13:38.828 INFO:teuthology.orchestra.run.trial128.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:13:38.828 INFO:teuthology.orchestra.run.trial128.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:13:38.828 INFO:teuthology.orchestra.run.trial128.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:13:38.828 INFO:teuthology.orchestra.run.trial128.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:13:38.828 INFO:teuthology.orchestra.run.trial128.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:13:38.828 INFO:teuthology.orchestra.run.trial128.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:13:38.828 INFO:teuthology.lock.ops:Updating trial128.front.sepia.ceph.com on lock server
2026-02-13T01:13:38.887 INFO:teuthology.lock.ops:Updating [trial133.front.sepia.ceph.com]: set os type and version on server
2026-02-13T01:13:38.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial133.front.sepia.ceph.com'
2026-02-13T01:13:38.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:13:38.949 DEBUG:teuthology.orchestra.run.trial133:> true
2026-02-13T01:13:39.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial133.front.sepia.ceph.com'
2026-02-13T01:13:39.029 DEBUG:teuthology.orchestra.run.trial133:> uname -m
2026-02-13T01:13:39.084 INFO:teuthology.orchestra.run.trial133.stdout:x86_64
2026-02-13T01:13:39.084 DEBUG:teuthology.orchestra.run.trial133:> cat /etc/os-release
2026-02-13T01:13:39.139 INFO:teuthology.orchestra.run.trial133.stdout:NAME="CentOS Stream"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:VERSION="9"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:ID="centos"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:VERSION_ID="9"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:ANSI_COLOR="0;31"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:13:39.140 INFO:teuthology.orchestra.run.trial133.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:13:39.141 INFO:teuthology.orchestra.run.trial133.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:13:39.141 INFO:teuthology.orchestra.run.trial133.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:13:39.141 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:13:39.141 INFO:teuthology.orchestra.run.trial133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:13:39.141 INFO:teuthology.lock.ops:Updating trial133.front.sepia.ceph.com on lock server
2026-02-13T01:13:39.247 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:13:39.342 INFO:teuthology.dispatcher.supervisor:Running job 47419
2026-02-13T01:13:39.342 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47419 --name pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/squid 1-client 2-upgrade 3-compat_client/no}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47419/orig.config.yaml
2026-02-13T01:13:39.343 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47419
2026-02-13T01:13:39.343 INFO:teuthology.dispatcher.supervisor:Job PID: 1004469
2026-02-13T01:13:39.343 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T01:15:39.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:17:39.515 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:19:39.677 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:21:39.824 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:23:40.035 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:25:40.241 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:27:40.428 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:29:40.567 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:29:40.654 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-13T01:29:40.825 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T01:29:41.486 INFO:teuthology.orchestra.console.trial128:Power off
2026-02-13T01:29:41.487 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:29:41.545 INFO:teuthology.orchestra.console.trial133:Power off
2026-02-13T01:29:41.545 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:29:41.550 DEBUG:teuthology.orchestra.console.trial128:power off output: Chassis Power Control: Down/Off
2026-02-13T01:29:41.560 INFO:teuthology.orchestra.console.trial116:Power off
2026-02-13T01:29:41.560 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:29:41.582 DEBUG:teuthology.orchestra.console.trial133:power off output: Chassis Power Control: Down/Off
2026-02-13T01:29:41.598 DEBUG:teuthology.orchestra.console.trial116:power off output: Chassis Power Control: Down/Off
2026-02-13T01:29:45.551 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:29:45.583 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:29:45.598 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:29:45.659 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is on
2026-02-13T01:29:45.692 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is on
2026-02-13T01:29:45.708 DEBUG:teuthology.orchestra.console.trial116:check power output: Chassis Power is on
2026-02-13T01:29:49.664 DEBUG:teuthology.orchestra.console.trial128:pexpect command: ipmitool -H trial128.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:29:49.692 DEBUG:teuthology.orchestra.console.trial133:pexpect command: ipmitool -H trial133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:29:49.708 DEBUG:teuthology.orchestra.console.trial116:pexpect command: ipmitool -H trial116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:29:49.775 DEBUG:teuthology.orchestra.console.trial128:check power output: Chassis Power is off
2026-02-13T01:29:49.775 INFO:teuthology.orchestra.console.trial128:Power off completed
2026-02-13T01:29:49.802 DEBUG:teuthology.orchestra.console.trial133:check power output: Chassis Power is off
2026-02-13T01:29:49.802 INFO:teuthology.orchestra.console.trial133:Power off completed
2026-02-13T01:29:49.818 DEBUG:teuthology.orchestra.console.trial116:check power output: Chassis Power is off
2026-02-13T01:29:49.818 INFO:teuthology.orchestra.console.trial116:Power off completed
2026-02-13T01:29:50.069 INFO:teuthology.lock.ops:unlocked: trial128.front.sepia.ceph.com
2026-02-13T01:29:50.079 INFO:teuthology.lock.ops:unlocked: trial133.front.sepia.ceph.com
2026-02-13T01:29:50.083 INFO:teuthology.lock.ops:unlocked: trial116.front.sepia.ceph.com