2026-02-20T02:53:39.974 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-20T02:53:39.974 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T02:53:40.047 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T02:53:40.302 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7001202529c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x70011fa7ccc0>, signals=[15])
2026-02-20T02:53:40.302 INFO:teuthology.lock.ops:Start node 'trial007.front.sepia.ceph.com' reimaging
2026-02-20T02:53:40.302 INFO:teuthology.lock.ops:Updating [trial007.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T02:53:40.302 INFO:teuthology.lock.ops:Updating trial007.front.sepia.ceph.com on lock server
2026-02-20T02:53:40.359 INFO:teuthology.lock.ops:Start node 'trial039.front.sepia.ceph.com' reimaging
2026-02-20T02:53:40.359 INFO:teuthology.lock.ops:Updating [trial039.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T02:53:40.359 INFO:teuthology.lock.ops:Updating trial039.front.sepia.ceph.com on lock server
2026-02-20T02:53:40.416 INFO:teuthology.lock.ops:Start node 'trial058.front.sepia.ceph.com' reimaging
2026-02-20T02:53:40.416 INFO:teuthology.lock.ops:Updating [trial058.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T02:53:40.416 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server
2026-02-20T02:53:40.647 DEBUG:teuthology.provision.fog.trial039:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T02:53:40.647 DEBUG:teuthology.provision.fog.trial007:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T02:53:40.698 DEBUG:teuthology.provision.fog.trial058:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T02:53:40.700 INFO:teuthology.provision.fog.trial007:Scheduling deploy of centos 9.stream
2026-02-20T02:53:40.701 INFO:teuthology.provision.fog.trial039:Scheduling deploy of centos 9.stream
2026-02-20T02:53:40.749 INFO:teuthology.provision.fog.trial058:Scheduling deploy of centos 9.stream
2026-02-20T02:53:42.064 INFO:teuthology.orchestra.console.trial058:Power off
2026-02-20T02:53:42.065 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T02:53:42.078 INFO:teuthology.orchestra.console.trial007:Power off
2026-02-20T02:53:42.078 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T02:53:42.089 INFO:teuthology.orchestra.console.trial039:Power off
2026-02-20T02:53:42.089 DEBUG:teuthology.orchestra.console.trial039:pexpect command: ipmitool -H trial039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T02:53:42.104 DEBUG:teuthology.orchestra.console.trial058:power off output: Chassis Power Control: Down/Off
2026-02-20T02:53:42.115 DEBUG:teuthology.orchestra.console.trial007:power off output: Chassis Power Control: Down/Off
2026-02-20T02:53:42.127 DEBUG:teuthology.orchestra.console.trial039:power off output: Chassis Power Control: Down/Off
2026-02-20T02:53:46.108 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T02:53:46.116 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T02:53:46.128 DEBUG:teuthology.orchestra.console.trial039:pexpect command: ipmitool -H trial039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T02:53:46.219 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is off
2026-02-20T02:53:46.219 INFO:teuthology.orchestra.console.trial058:Power off completed
2026-02-20T02:53:46.225 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is off
2026-02-20T02:53:46.225 INFO:teuthology.orchestra.console.trial007:Power off completed
2026-02-20T02:53:46.237 DEBUG:teuthology.orchestra.console.trial039:check power output: Chassis Power is off
2026-02-20T02:53:46.237 INFO:teuthology.orchestra.console.trial039:Power off completed
2026-02-20T02:53:46.320 INFO:teuthology.orchestra.console.trial058:Power on
2026-02-20T02:53:46.321 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T02:53:46.330 INFO:teuthology.orchestra.console.trial007:Power on
2026-02-20T02:53:46.330 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T02:53:46.339 INFO:teuthology.orchestra.console.trial039:Power on
2026-02-20T02:53:46.339 DEBUG:teuthology.orchestra.console.trial039:pexpect command: ipmitool -H trial039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T02:53:46.361 DEBUG:teuthology.orchestra.console.trial058:power on output: Chassis Power Control: Up/On
2026-02-20T02:53:46.369 DEBUG:teuthology.orchestra.console.trial007:power on output: Chassis Power Control: Up/On
2026-02-20T02:53:46.378 DEBUG:teuthology.orchestra.console.trial039:power on output: Chassis Power Control: Up/On
2026-02-20T02:53:50.366 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T02:53:50.375 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T02:53:50.384 DEBUG:teuthology.orchestra.console.trial039:pexpect command: ipmitool -H trial039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T02:53:50.477 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is on
2026-02-20T02:53:50.477 INFO:teuthology.orchestra.console.trial058:Power on completed
2026-02-20T02:53:50.485 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is on
2026-02-20T02:53:50.485 INFO:teuthology.orchestra.console.trial007:Power on completed
2026-02-20T02:53:50.494 DEBUG:teuthology.orchestra.console.trial039:check power output: Chassis Power is off
2026-02-20T02:53:50.578 INFO:teuthology.provision.fog.trial058:Waiting for deploy to finish
2026-02-20T02:53:50.586 INFO:teuthology.provision.fog.trial007:Waiting for deploy to finish
2026-02-20T02:53:54.497 DEBUG:teuthology.orchestra.console.trial039:pexpect command: ipmitool -H trial039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T02:53:54.608 DEBUG:teuthology.orchestra.console.trial039:check power output: Chassis Power is on
2026-02-20T02:53:54.609 INFO:teuthology.orchestra.console.trial039:Power on completed
2026-02-20T02:53:54.709 INFO:teuthology.provision.fog.trial039:Waiting for deploy to finish
2026-02-20T02:55:38.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:55:38.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:55:41.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:55:56.160 WARNING:teuthology.provision.fog.trial039:[Errno None] Unable to connect to port 22 on 10.20.193.39
2026-02-20T02:56:02.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:56:05.248 WARNING:teuthology.provision.fog.trial039:[Errno None] Unable to connect to port 22 on 10.20.193.39
2026-02-20T02:56:11.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:56:14.336 WARNING:teuthology.provision.fog.trial039:[Errno None] Unable to connect to port 22 on 10.20.193.39
2026-02-20T02:56:17.280 WARNING:teuthology.provision.fog.trial058:[Errno None] Unable to connect to port 22 on 10.20.193.58
2026-02-20T02:56:17.280 WARNING:teuthology.provision.fog.trial007:[Errno None] Unable to connect to port 22 on 10.20.193.7
2026-02-20T02:56:20.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:56:23.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:56:23.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:56:56.307 ERROR:teuthology.orchestra.connection:Error authenticating with trial039.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-20T02:56:59.384 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T02:56:59.384 DEBUG:teuthology.orchestra.run.trial007:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T02:56:59.384 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T02:56:59.384 DEBUG:teuthology.orchestra.run.trial058:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T02:56:59.593 INFO:teuthology.provision.fog.trial007:Node is ready
2026-02-20T02:56:59.593 DEBUG:teuthology.orchestra.run.trial007:> hostname
2026-02-20T02:56:59.625 INFO:teuthology.provision.fog.trial058:Node is ready
2026-02-20T02:56:59.625 DEBUG:teuthology.orchestra.run.trial058:> hostname
2026-02-20T02:56:59.654 INFO:teuthology.orchestra.run.trial007.stdout:trial007.front.sepia.ceph.com
2026-02-20T02:56:59.655 DEBUG:teuthology.orchestra.run.trial007:> grep trial007.front.sepia.ceph.com /etc/hosts
2026-02-20T02:56:59.679 INFO:teuthology.orchestra.run.trial058.stdout:trial058.front.sepia.ceph.com
2026-02-20T02:56:59.680 DEBUG:teuthology.orchestra.run.trial058:> grep trial058.front.sepia.ceph.com /etc/hosts
2026-02-20T02:56:59.713 INFO:teuthology.orchestra.run.trial007.stdout:10.20.193.7 trial007.front.sepia.ceph.com trial007
2026-02-20T02:56:59.713 DEBUG:teuthology.orchestra.run.trial007:> sudo hostname trial007
2026-02-20T02:56:59.736 INFO:teuthology.orchestra.run.trial058.stdout:10.20.193.58 trial058.front.sepia.ceph.com trial058
2026-02-20T02:56:59.736 DEBUG:teuthology.orchestra.run.trial058:> sudo hostname trial058
2026-02-20T02:56:59.788 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/trial007.front.sepia.ceph.com/trial007/g' /etc/hosts
2026-02-20T02:56:59.807 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/trial058.front.sepia.ceph.com/trial058/g' /etc/hosts
2026-02-20T02:56:59.857 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/10.20.193.7/10.20.193.7/g' /etc/hosts
2026-02-20T02:56:59.871 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/10.20.193.58/10.20.193.58/g' /etc/hosts
2026-02-20T02:56:59.926 DEBUG:teuthology.orchestra.run.trial007:> sudo sed -i -e 's/trial007.front.sepia.ceph.com/trial007/g' /etc/hostname
2026-02-20T02:56:59.936 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i -e 's/trial058.front.sepia.ceph.com/trial058/g' /etc/hostname
2026-02-20T02:56:59.994 DEBUG:teuthology.orchestra.run.trial007:> sudo hostname trial007
2026-02-20T02:56:59.999 DEBUG:teuthology.orchestra.run.trial058:> sudo hostname trial058
2026-02-20T02:57:00.062 DEBUG:teuthology.orchestra.run.trial007:> cat /etc/os-release
2026-02-20T02:57:00.063 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release
2026-02-20T02:57:00.120 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream"
2026-02-20T02:57:00.120 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9"
2026-02-20T02:57:00.120 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos"
2026-02-20T02:57:00.120 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora"
2026-02-20T02:57:00.120 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9"
2026-02-20T02:57:00.120 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9"
2026-02-20T02:57:00.120 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T02:57:00.120 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31"
2026-02-20T02:57:00.121 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon"
2026-02-20T02:57:00.121 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T02:57:00.121 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/"
2026-02-20T02:57:00.121 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T02:57:00.121 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T02:57:00.121 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T02:57:00.122 INFO:teuthology.provision.fog.trial058:Deploy complete!
2026-02-20T02:57:00.123 DEBUG:teuthology.parallel:result is None
2026-02-20T02:57:00.124 INFO:teuthology.orchestra.run.trial007.stdout:NAME="CentOS Stream"
2026-02-20T02:57:00.124 INFO:teuthology.orchestra.run.trial007.stdout:VERSION="9"
2026-02-20T02:57:00.124 INFO:teuthology.orchestra.run.trial007.stdout:ID="centos"
2026-02-20T02:57:00.124 INFO:teuthology.orchestra.run.trial007.stdout:ID_LIKE="rhel fedora"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:VERSION_ID="9"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:PLATFORM_ID="platform:el9"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:ANSI_COLOR="0;31"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:LOGO="fedora-logo-icon"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:HOME_URL="https://centos.org/"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T02:57:00.125 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T02:57:00.126 INFO:teuthology.provision.fog.trial007:Deploy complete!
2026-02-20T02:57:00.126 DEBUG:teuthology.parallel:result is None
2026-02-20T02:57:00.420 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T02:57:00.420 DEBUG:teuthology.orchestra.run.trial039:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T02:57:00.643 INFO:teuthology.provision.fog.trial039:Node is ready
2026-02-20T02:57:00.643 DEBUG:teuthology.orchestra.run.trial039:> hostname
2026-02-20T02:57:00.696 INFO:teuthology.orchestra.run.trial039.stdout:trial039.front.sepia.ceph.com
2026-02-20T02:57:00.697 DEBUG:teuthology.orchestra.run.trial039:> grep trial039.front.sepia.ceph.com /etc/hosts
2026-02-20T02:57:00.752 INFO:teuthology.orchestra.run.trial039.stdout:10.20.193.39 trial039.front.sepia.ceph.com trial039
2026-02-20T02:57:00.754 DEBUG:teuthology.orchestra.run.trial039:> sudo hostname trial039
2026-02-20T02:57:00.819 DEBUG:teuthology.orchestra.run.trial039:> sudo sed -i -e 's/trial039.front.sepia.ceph.com/trial039/g' /etc/hosts
2026-02-20T02:57:00.882 DEBUG:teuthology.orchestra.run.trial039:> sudo sed -i -e 's/10.20.193.39/10.20.193.39/g' /etc/hosts
2026-02-20T02:57:00.942 DEBUG:teuthology.orchestra.run.trial039:> sudo sed -i -e 's/trial039.front.sepia.ceph.com/trial039/g' /etc/hostname
2026-02-20T02:57:01.003 DEBUG:teuthology.orchestra.run.trial039:> sudo hostname trial039
2026-02-20T02:57:01.066 DEBUG:teuthology.orchestra.run.trial039:> cat /etc/os-release
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:NAME="CentOS Stream"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:VERSION="9"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:ID="centos"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:ID_LIKE="rhel fedora"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:VERSION_ID="9"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:PLATFORM_ID="platform:el9"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:ANSI_COLOR="0;31"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:LOGO="fedora-logo-icon"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:HOME_URL="https://centos.org/"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T02:57:01.119 INFO:teuthology.orchestra.run.trial039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T02:57:01.120 INFO:teuthology.provision.fog.trial039:Deploy complete!
2026-02-20T02:57:01.121 DEBUG:teuthology.parallel:result is None
2026-02-20T02:57:01.625 INFO:teuthology.lock.ops:Checking trial007.front.sepia.ceph.com
2026-02-20T02:57:01.625 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T02:57:01.731 INFO:teuthology.lock.ops:Checking trial039.front.sepia.ceph.com
2026-02-20T02:57:01.731 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T02:57:01.794 INFO:teuthology.lock.ops:Checking trial058.front.sepia.ceph.com
2026-02-20T02:57:01.795 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T02:57:01.851 INFO:teuthology.lock.ops:Updating [trial007.front.sepia.ceph.com]: set os type and version on server
2026-02-20T02:57:01.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial007.front.sepia.ceph.com'
2026-02-20T02:57:01.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:57:01.915 DEBUG:teuthology.orchestra.run.trial007:> true
2026-02-20T02:57:01.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial007.front.sepia.ceph.com'
2026-02-20T02:57:01.995 DEBUG:teuthology.orchestra.run.trial007:> uname -m
2026-02-20T02:57:02.050 INFO:teuthology.orchestra.run.trial007.stdout:x86_64
2026-02-20T02:57:02.050 DEBUG:teuthology.orchestra.run.trial007:> cat /etc/os-release
2026-02-20T02:57:02.106 INFO:teuthology.orchestra.run.trial007.stdout:NAME="CentOS Stream"
2026-02-20T02:57:02.106 INFO:teuthology.orchestra.run.trial007.stdout:VERSION="9"
2026-02-20T02:57:02.106 INFO:teuthology.orchestra.run.trial007.stdout:ID="centos"
2026-02-20T02:57:02.106 INFO:teuthology.orchestra.run.trial007.stdout:ID_LIKE="rhel fedora"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:VERSION_ID="9"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:PLATFORM_ID="platform:el9"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:ANSI_COLOR="0;31"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:LOGO="fedora-logo-icon"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:HOME_URL="https://centos.org/"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T02:57:02.107 INFO:teuthology.orchestra.run.trial007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T02:57:02.108 INFO:teuthology.lock.ops:Updating trial007.front.sepia.ceph.com on lock server
2026-02-20T02:57:02.207 INFO:teuthology.lock.ops:Updating [trial039.front.sepia.ceph.com]: set os type and version on server
2026-02-20T02:57:02.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial039.front.sepia.ceph.com'
2026-02-20T02:57:02.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:57:02.273 DEBUG:teuthology.orchestra.run.trial039:> true
2026-02-20T02:57:02.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial039.front.sepia.ceph.com'
2026-02-20T02:57:02.352 DEBUG:teuthology.orchestra.run.trial039:> uname -m
2026-02-20T02:57:02.407 INFO:teuthology.orchestra.run.trial039.stdout:x86_64
2026-02-20T02:57:02.407 DEBUG:teuthology.orchestra.run.trial039:> cat /etc/os-release
2026-02-20T02:57:02.458 INFO:teuthology.orchestra.run.trial039.stdout:NAME="CentOS Stream"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:VERSION="9"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:ID="centos"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:ID_LIKE="rhel fedora"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:VERSION_ID="9"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:PLATFORM_ID="platform:el9"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:ANSI_COLOR="0;31"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:LOGO="fedora-logo-icon"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:HOME_URL="https://centos.org/"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T02:57:02.459 INFO:teuthology.orchestra.run.trial039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T02:57:02.459 INFO:teuthology.lock.ops:Updating trial039.front.sepia.ceph.com on lock server
2026-02-20T02:57:02.524 INFO:teuthology.lock.ops:Updating [trial058.front.sepia.ceph.com]: set os type and version on server
2026-02-20T02:57:02.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com'
2026-02-20T02:57:02.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T02:57:02.588 DEBUG:teuthology.orchestra.run.trial058:> true
2026-02-20T02:57:02.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com'
2026-02-20T02:57:02.664 DEBUG:teuthology.orchestra.run.trial058:> uname -m
2026-02-20T02:57:02.719 INFO:teuthology.orchestra.run.trial058.stdout:x86_64
2026-02-20T02:57:02.719 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon"
2026-02-20T02:57:02.776 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T02:57:02.777 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/"
2026-02-20T02:57:02.777 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T02:57:02.777 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T02:57:02.777 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T02:57:02.777 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server
2026-02-20T02:57:02.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T02:57:02.970 INFO:teuthology.dispatcher.supervisor:Running job 55464
2026-02-20T02:57:02.970 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_jcollin@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55464 --name jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/no}} -- /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55464/orig.config.yaml
2026-02-20T02:57:02.971 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55464
2026-02-20T02:57:02.971 INFO:teuthology.dispatcher.supervisor:Job PID: 3947926
2026-02-20T02:57:02.971 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-20T02:59:03.071 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:01:03.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:03:03.454 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:05:03.622 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:07:03.844 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:09:04.005 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:11:04.179 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:13:04.367 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:15:04.578 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:17:04.778 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:19:04.985 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:21:05.208 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:23:05.423 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:25:05.599 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:27:05.745 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:29:05.937 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:31:06.144 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:33:06.361 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:35:06.519 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:37:06.696 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:39:06.878 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:41:07.059 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:43:07.220 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:45:07.423 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:47:07.564 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:49:07.710 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:51:07.907 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:53:08.048 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:55:08.265 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:57:08.389 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T03:59:08.585 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:01:08.751 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:03:08.946 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:05:09.150 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:07:09.340 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:09:09.559 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:11:09.672 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:13:09.895 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:15:10.096 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:17:10.284 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:19:10.458 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:21:10.591 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:23:10.815 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:25:10.994 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:27:11.201 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:29:11.403 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T04:29:11.490 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-20T04:29:11.663 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-20T04:29:12.660 INFO:teuthology.orchestra.console.trial007:Power off
2026-02-20T04:29:12.660 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T04:29:12.699 DEBUG:teuthology.orchestra.console.trial007:power off output: Chassis Power Control: Down/Off
2026-02-20T04:29:14.503 INFO:teuthology.orchestra.console.trial058:Power off
2026-02-20T04:29:14.503 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T04:29:14.543 DEBUG:teuthology.orchestra.console.trial058:power off output: Chassis Power Control: Down/Off
2026-02-20T04:29:14.972 INFO:teuthology.orchestra.console.trial039:Power off
2026-02-20T04:29:14.972 DEBUG:teuthology.orchestra.console.trial039:pexpect command: ipmitool -H trial039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T04:29:15.014 DEBUG:teuthology.orchestra.console.trial039:power off output: Chassis Power Control: Down/Off
2026-02-20T04:29:16.701 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T04:29:16.809 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is on
2026-02-20T04:29:18.546 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T04:29:18.656 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is on
2026-02-20T04:29:19.015 DEBUG:teuthology.orchestra.console.trial039:pexpect command: ipmitool -H trial039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T04:29:19.124 DEBUG:teuthology.orchestra.console.trial039:check power output: Chassis Power is on
2026-02-20T04:29:20.811 DEBUG:teuthology.orchestra.console.trial007:pexpect command: ipmitool -H trial007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T04:29:20.921 DEBUG:teuthology.orchestra.console.trial007:check power output: Chassis Power is off
2026-02-20T04:29:20.921 INFO:teuthology.orchestra.console.trial007:Power off completed
2026-02-20T04:29:21.130 INFO:teuthology.lock.ops:unlocked: trial007.front.sepia.ceph.com
2026-02-20T04:29:22.659 DEBUG:teuthology.orchestra.console.trial058:pexpect command: ipmitool -H trial058.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T04:29:22.767 DEBUG:teuthology.orchestra.console.trial058:check power output: Chassis Power is off
2026-02-20T04:29:22.767 INFO:teuthology.orchestra.console.trial058:Power off completed
2026-02-20T04:29:22.976 INFO:teuthology.lock.ops:unlocked: trial058.front.sepia.ceph.com
2026-02-20T04:29:23.125 DEBUG:teuthology.orchestra.console.trial039:pexpect command: ipmitool -H trial039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T04:29:23.232 DEBUG:teuthology.orchestra.console.trial039:check power output: Chassis Power is off
2026-02-20T04:29:23.233 INFO:teuthology.orchestra.console.trial039:Power off completed
2026-02-20T04:29:23.440 INFO:teuthology.lock.ops:unlocked: trial039.front.sepia.ceph.com