2026-02-23T17:49:47.496 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T17:49:47.496 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T17:49:47.691 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T17:49:47.941 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7739d82bd080>, signals=[15]) 2026-02-23T17:49:47.941 INFO:teuthology.lock.ops:Start node 'trial014.front.sepia.ceph.com' reimaging 2026-02-23T17:49:47.941 INFO:teuthology.lock.ops:Updating [trial014.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T17:49:47.941 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server 2026-02-23T17:49:47.998 INFO:teuthology.lock.ops:Start node 'trial019.front.sepia.ceph.com' reimaging 2026-02-23T17:49:47.998 INFO:teuthology.lock.ops:Updating [trial019.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T17:49:47.998 INFO:teuthology.lock.ops:Updating trial019.front.sepia.ceph.com on lock server 2026-02-23T17:49:48.056 INFO:teuthology.lock.ops:Start node 'trial090.front.sepia.ceph.com' reimaging 2026-02-23T17:49:48.056 INFO:teuthology.lock.ops:Updating [trial090.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T17:49:48.056 INFO:teuthology.lock.ops:Updating trial090.front.sepia.ceph.com on lock server 2026-02-23T17:49:48.290 DEBUG:teuthology.provision.fog.trial019:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T17:49:48.342 INFO:teuthology.provision.fog.trial019:Scheduling deploy of centos 9.stream 2026-02-23T17:49:48.382 DEBUG:teuthology.provision.fog.trial014:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T17:49:48.423 INFO:teuthology.provision.fog.trial014:Scheduling deploy of centos 9.stream 2026-02-23T17:49:48.493 DEBUG:teuthology.provision.fog.trial090:Requesting image trial_centos_9.stream (ID 3) 2026-02-23T17:49:48.549 INFO:teuthology.provision.fog.trial090:Scheduling deploy of centos 9.stream 2026-02-23T17:49:52.587 INFO:teuthology.orchestra.console.trial014:Power off 2026-02-23T17:49:52.587 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T17:49:52.605 INFO:teuthology.orchestra.console.trial019:Power off 2026-02-23T17:49:52.605 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T17:49:52.625 DEBUG:teuthology.orchestra.console.trial014:power off output: Chassis Power Control: Down/Off 2026-02-23T17:49:52.642 DEBUG:teuthology.orchestra.console.trial019:power off output: Chassis Power Control: Down/Off 2026-02-23T17:49:52.819 INFO:teuthology.orchestra.console.trial090:Power off 2026-02-23T17:49:52.819 DEBUG:teuthology.orchestra.console.trial090:pexpect command: ipmitool -H trial090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T17:49:52.857 DEBUG:teuthology.orchestra.console.trial090:power off output: Chassis Power Control: Down/Off 2026-02-23T17:49:56.629 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T17:49:56.643 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T17:49:56.739 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is off 2026-02-23T17:49:56.739 INFO:teuthology.orchestra.console.trial014:Power off completed 2026-02-23T17:49:56.751 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is off 2026-02-23T17:49:56.751 INFO:teuthology.orchestra.console.trial019:Power off completed 2026-02-23T17:49:56.840 INFO:teuthology.orchestra.console.trial014:Power on 2026-02-23T17:49:56.840 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T17:49:56.851 INFO:teuthology.orchestra.console.trial019:Power on 2026-02-23T17:49:56.852 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T17:49:56.859 DEBUG:teuthology.orchestra.console.trial090:pexpect command: ipmitool -H trial090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T17:49:56.881 DEBUG:teuthology.orchestra.console.trial014:power on output: Chassis Power Control: Up/On 2026-02-23T17:49:56.890 DEBUG:teuthology.orchestra.console.trial019:power on output: Chassis Power Control: Up/On 2026-02-23T17:49:56.968 DEBUG:teuthology.orchestra.console.trial090:check power output: Chassis Power is off 2026-02-23T17:49:56.969 INFO:teuthology.orchestra.console.trial090:Power off completed 2026-02-23T17:49:57.069 INFO:teuthology.orchestra.console.trial090:Power on 2026-02-23T17:49:57.069 DEBUG:teuthology.orchestra.console.trial090:pexpect command: ipmitool -H trial090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T17:49:57.109 DEBUG:teuthology.orchestra.console.trial090:power on output: Chassis Power Control: Up/On 2026-02-23T17:50:00.886 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T17:50:00.894 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T17:50:00.997 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is on 2026-02-23T17:50:00.998 INFO:teuthology.orchestra.console.trial014:Power on completed 2026-02-23T17:50:01.004 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is off 2026-02-23T17:50:01.099 INFO:teuthology.provision.fog.trial014:Waiting for deploy to finish 2026-02-23T17:50:01.110 DEBUG:teuthology.orchestra.console.trial090:pexpect command: ipmitool -H trial090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T17:50:01.220 DEBUG:teuthology.orchestra.console.trial090:check power output: Chassis Power is on 2026-02-23T17:50:01.221 INFO:teuthology.orchestra.console.trial090:Power on completed 2026-02-23T17:50:01.321 INFO:teuthology.provision.fog.trial090:Waiting for deploy to finish 2026-02-23T17:50:05.007 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T17:50:05.118 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is on 2026-02-23T17:50:05.118 INFO:teuthology.orchestra.console.trial019:Power on completed 2026-02-23T17:50:05.219 INFO:teuthology.provision.fog.trial019:Waiting for deploy to finish 2026-02-23T17:52:46.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:53:01.248 WARNING:teuthology.provision.fog.trial019:[Errno None] Unable to connect to port 22 on 10.20.193.19 2026-02-23T17:53:07.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:53:10.336 WARNING:teuthology.provision.fog.trial019:[Errno None] Unable to connect to port 22 on 10.20.193.19 2026-02-23T17:53:16.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:53:19.425 WARNING:teuthology.provision.fog.trial019:[Errno None] Unable to connect to port 22 on 10.20.193.19 2026-02-23T17:53:25.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:53:28.511 WARNING:teuthology.provision.fog.trial019:[Errno None] Unable to connect to port 22 on 10.20.193.19 2026-02-23T17:53:34.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:53:40.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:53:54.305 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14 2026-02-23T17:54:00.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:54:03.392 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14 2026-02-23T17:54:09.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:54:10.549 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T17:54:10.549 DEBUG:teuthology.orchestra.run.trial019:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T17:54:10.761 INFO:teuthology.provision.fog.trial019:Node is ready 2026-02-23T17:54:10.761 DEBUG:teuthology.orchestra.run.trial019:> hostname 2026-02-23T17:54:10.817 INFO:teuthology.orchestra.run.trial019.stdout:trial019.front.sepia.ceph.com 2026-02-23T17:54:10.818 DEBUG:teuthology.orchestra.run.trial019:> grep trial019.front.sepia.ceph.com /etc/hosts 2026-02-23T17:54:10.875 INFO:teuthology.orchestra.run.trial019.stdout:10.20.193.19 trial019.front.sepia.ceph.com trial019 2026-02-23T17:54:10.875 DEBUG:teuthology.orchestra.run.trial019:> sudo hostname trial019 2026-02-23T17:54:10.946 DEBUG:teuthology.orchestra.run.trial019:> sudo sed -i -e 's/trial019.front.sepia.ceph.com/trial019/g' /etc/hosts 2026-02-23T17:54:11.011 DEBUG:teuthology.orchestra.run.trial019:> sudo sed -i -e 's/10.20.193.19/10.20.193.19/g' /etc/hosts 2026-02-23T17:54:11.074 DEBUG:teuthology.orchestra.run.trial019:> sudo sed -i -e 's/trial019.front.sepia.ceph.com/trial019/g' /etc/hostname 2026-02-23T17:54:11.139 DEBUG:teuthology.orchestra.run.trial019:> sudo hostname trial019 2026-02-23T17:54:11.204 DEBUG:teuthology.orchestra.run.trial019:> cat /etc/os-release 2026-02-23T17:54:11.259 INFO:teuthology.orchestra.run.trial019.stdout:NAME="CentOS Stream" 2026-02-23T17:54:11.259 INFO:teuthology.orchestra.run.trial019.stdout:VERSION="9" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:ID="centos" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:ID_LIKE="rhel fedora" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:VERSION_ID="9" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:PLATFORM_ID="platform:el9" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:ANSI_COLOR="0;31" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:LOGO="fedora-logo-icon" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:HOME_URL="https://centos.org/" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T17:54:11.260 INFO:teuthology.orchestra.run.trial019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T17:54:11.262 INFO:teuthology.provision.fog.trial019:Deploy complete! 2026-02-23T17:54:11.264 DEBUG:teuthology.parallel:result is None 2026-02-23T17:54:12.479 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14 2026-02-23T17:54:18.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:54:54.589 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T17:54:54.589 DEBUG:teuthology.orchestra.run.trial014:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T17:54:54.833 INFO:teuthology.provision.fog.trial014:Node is ready 2026-02-23T17:54:54.833 DEBUG:teuthology.orchestra.run.trial014:> hostname 2026-02-23T17:54:54.889 INFO:teuthology.orchestra.run.trial014.stdout:trial014.front.sepia.ceph.com 2026-02-23T17:54:54.889 DEBUG:teuthology.orchestra.run.trial014:> grep trial014.front.sepia.ceph.com /etc/hosts 2026-02-23T17:54:54.947 INFO:teuthology.orchestra.run.trial014.stdout:10.20.193.14 trial014.front.sepia.ceph.com trial014 2026-02-23T17:54:54.947 DEBUG:teuthology.orchestra.run.trial014:> sudo hostname trial014 2026-02-23T17:54:55.018 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/trial014.front.sepia.ceph.com/trial014/g' /etc/hosts 2026-02-23T17:54:55.083 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/10.20.193.14/10.20.193.14/g' /etc/hosts 2026-02-23T17:54:55.148 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/trial014.front.sepia.ceph.com/trial014/g' /etc/hostname 2026-02-23T17:54:55.215 DEBUG:teuthology.orchestra.run.trial014:> sudo hostname trial014 2026-02-23T17:54:55.279 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release 2026-02-23T17:54:55.336 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream" 2026-02-23T17:54:55.336 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9" 2026-02-23T17:54:55.336 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos" 2026-02-23T17:54:55.336 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora" 2026-02-23T17:54:55.336 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9" 2026-02-23T17:54:55.336 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9" 2026-02-23T17:54:55.336 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T17:54:55.337 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31" 2026-02-23T17:54:55.337 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon" 2026-02-23T17:54:55.337 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T17:54:55.337 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/" 2026-02-23T17:54:55.337 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T17:54:55.337 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T17:54:55.337 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T17:54:55.338 INFO:teuthology.provision.fog.trial014:Deploy complete! 2026-02-23T17:54:55.338 DEBUG:teuthology.parallel:result is None 2026-02-23T17:56:03.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:56:06.272 WARNING:teuthology.provision.fog.trial090:[Errno None] Unable to connect to port 22 on 10.20.193.90 2026-02-23T17:56:12.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:56:15.360 WARNING:teuthology.provision.fog.trial090:[Errno None] Unable to connect to port 22 on 10.20.193.90 2026-02-23T17:56:21.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:56:24.447 WARNING:teuthology.provision.fog.trial090:[Errno None] Unable to connect to port 22 on 10.20.193.90 2026-02-23T17:56:30.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:56:33.535 WARNING:teuthology.provision.fog.trial090:[Errno None] Unable to connect to port 22 on 10.20.193.90 2026-02-23T17:56:39.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:57:15.343 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T17:57:15.344 DEBUG:teuthology.orchestra.run.trial090:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T17:57:20.704 INFO:teuthology.provision.fog.trial090:Node is ready 2026-02-23T17:57:20.704 DEBUG:teuthology.orchestra.run.trial090:> hostname 2026-02-23T17:57:20.722 INFO:teuthology.orchestra.run.trial090.stdout:trial090.front.sepia.ceph.com 2026-02-23T17:57:20.722 DEBUG:teuthology.orchestra.run.trial090:> grep trial090.front.sepia.ceph.com /etc/hosts 2026-02-23T17:57:20.778 INFO:teuthology.orchestra.run.trial090.stdout:10.20.193.90 trial090.front.sepia.ceph.com trial090 2026-02-23T17:57:20.779 DEBUG:teuthology.orchestra.run.trial090:> sudo hostname trial090 2026-02-23T17:57:20.849 DEBUG:teuthology.orchestra.run.trial090:> sudo sed -i -e 's/trial090.front.sepia.ceph.com/trial090/g' /etc/hosts 2026-02-23T17:57:20.914 DEBUG:teuthology.orchestra.run.trial090:> sudo sed -i -e 's/10.20.193.90/10.20.193.90/g' /etc/hosts 2026-02-23T17:57:20.980 DEBUG:teuthology.orchestra.run.trial090:> sudo sed -i -e 's/trial090.front.sepia.ceph.com/trial090/g' /etc/hostname 2026-02-23T17:57:21.045 DEBUG:teuthology.orchestra.run.trial090:> sudo hostname trial090 2026-02-23T17:57:21.109 DEBUG:teuthology.orchestra.run.trial090:> cat /etc/os-release 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:NAME="CentOS Stream" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:VERSION="9" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:ID="centos" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:ID_LIKE="rhel fedora" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:VERSION_ID="9" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:PLATFORM_ID="platform:el9" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:ANSI_COLOR="0;31" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:LOGO="fedora-logo-icon" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:HOME_URL="https://centos.org/" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T17:57:21.165 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T17:57:21.166 INFO:teuthology.provision.fog.trial090:Deploy complete! 2026-02-23T17:57:21.166 DEBUG:teuthology.parallel:result is None 2026-02-23T17:57:21.665 INFO:teuthology.lock.ops:Checking trial014.front.sepia.ceph.com 2026-02-23T17:57:21.666 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T17:57:21.723 INFO:teuthology.lock.ops:Checking trial019.front.sepia.ceph.com 2026-02-23T17:57:21.723 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T17:57:21.789 INFO:teuthology.lock.ops:Checking trial090.front.sepia.ceph.com 2026-02-23T17:57:21.789 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T17:57:21.854 INFO:teuthology.lock.ops:Updating [trial014.front.sepia.ceph.com]: set os type and version on server 2026-02-23T17:57:21.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-23T17:57:21.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:57:21.917 DEBUG:teuthology.orchestra.run.trial014:> true 2026-02-23T17:57:22.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-23T17:57:22.062 DEBUG:teuthology.orchestra.run.trial014:> uname -m 2026-02-23T17:57:22.117 INFO:teuthology.orchestra.run.trial014.stdout:x86_64 2026-02-23T17:57:22.117 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release 2026-02-23T17:57:22.172 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream" 2026-02-23T17:57:22.172 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9" 2026-02-23T17:57:22.172 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos" 2026-02-23T17:57:22.172 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora" 2026-02-23T17:57:22.172 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9" 2026-02-23T17:57:22.172 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9" 2026-02-23T17:57:22.172 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T17:57:22.172 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31" 2026-02-23T17:57:22.173 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon" 2026-02-23T17:57:22.173 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T17:57:22.173 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/" 2026-02-23T17:57:22.173 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T17:57:22.173 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T17:57:22.173 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T17:57:22.173 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server 2026-02-23T17:57:22.242 INFO:teuthology.lock.ops:Updating [trial019.front.sepia.ceph.com]: set os type and version on server 2026-02-23T17:57:22.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial019.front.sepia.ceph.com' 2026-02-23T17:57:22.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:57:22.305 DEBUG:teuthology.orchestra.run.trial019:> true 2026-02-23T17:57:22.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial019.front.sepia.ceph.com' 2026-02-23T17:57:22.455 DEBUG:teuthology.orchestra.run.trial019:> uname -m 2026-02-23T17:57:22.511 INFO:teuthology.orchestra.run.trial019.stdout:x86_64 2026-02-23T17:57:22.512 DEBUG:teuthology.orchestra.run.trial019:> cat /etc/os-release 2026-02-23T17:57:22.568 INFO:teuthology.orchestra.run.trial019.stdout:NAME="CentOS Stream" 2026-02-23T17:57:22.568 INFO:teuthology.orchestra.run.trial019.stdout:VERSION="9" 2026-02-23T17:57:22.568 INFO:teuthology.orchestra.run.trial019.stdout:ID="centos" 2026-02-23T17:57:22.568 INFO:teuthology.orchestra.run.trial019.stdout:ID_LIKE="rhel fedora" 2026-02-23T17:57:22.568 INFO:teuthology.orchestra.run.trial019.stdout:VERSION_ID="9" 2026-02-23T17:57:22.568 INFO:teuthology.orchestra.run.trial019.stdout:PLATFORM_ID="platform:el9" 2026-02-23T17:57:22.568 INFO:teuthology.orchestra.run.trial019.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T17:57:22.569 INFO:teuthology.orchestra.run.trial019.stdout:ANSI_COLOR="0;31" 2026-02-23T17:57:22.569 INFO:teuthology.orchestra.run.trial019.stdout:LOGO="fedora-logo-icon" 2026-02-23T17:57:22.569 INFO:teuthology.orchestra.run.trial019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T17:57:22.569 INFO:teuthology.orchestra.run.trial019.stdout:HOME_URL="https://centos.org/" 2026-02-23T17:57:22.569 INFO:teuthology.orchestra.run.trial019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T17:57:22.569 INFO:teuthology.orchestra.run.trial019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T17:57:22.569 INFO:teuthology.orchestra.run.trial019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T17:57:22.569 INFO:teuthology.lock.ops:Updating trial019.front.sepia.ceph.com on lock server 2026-02-23T17:57:22.649 INFO:teuthology.lock.ops:Updating [trial090.front.sepia.ceph.com]: set os type and version on server 2026-02-23T17:57:22.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-23T17:57:22.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T17:57:22.711 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-23T17:57:22.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-23T17:57:22.790 DEBUG:teuthology.orchestra.run.trial090:> uname -m 2026-02-23T17:57:22.846 INFO:teuthology.orchestra.run.trial090.stdout:x86_64 2026-02-23T17:57:22.846 DEBUG:teuthology.orchestra.run.trial090:> cat /etc/os-release 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:NAME="CentOS Stream" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:VERSION="9" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:ID="centos" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:ID_LIKE="rhel fedora" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:VERSION_ID="9" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:PLATFORM_ID="platform:el9" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:ANSI_COLOR="0;31" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:LOGO="fedora-logo-icon" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:HOME_URL="https://centos.org/" 2026-02-23T17:57:22.902 INFO:teuthology.orchestra.run.trial090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-23T17:57:22.903 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-23T17:57:22.903 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-23T17:57:22.903 INFO:teuthology.lock.ops:Updating trial090.front.sepia.ceph.com on lock server 2026-02-23T17:57:23.003 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T17:57:23.101 INFO:teuthology.dispatcher.supervisor:Running job 66558 2026-02-23T17:57:23.101 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66558 --name nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial --description rados/thrash-old-clients/{0-distro$/{centos_9.stream} 0-size-min-size-overrides/2-size-2-min-size 1-install/reef backoff/peering_and_degraded ceph clusters/{three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/test_rbd_api} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66558/orig.config.yaml 2026-02-23T17:57:23.101 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66558 2026-02-23T17:57:23.101 INFO:teuthology.dispatcher.supervisor:Job PID: 959712 2026-02-23T17:57:23.101 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-23T17:59:23.200 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:01:23.373 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:03:23.563 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:05:23.719 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:07:23.925 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:09:24.107 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:09:24.196 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-23T18:09:24.366 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-23T18:09:25.090 INFO:teuthology.orchestra.console.trial014:Power off 2026-02-23T18:09:25.090 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T18:09:25.100 INFO:teuthology.orchestra.console.trial019:Power off 2026-02-23T18:09:25.100 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T18:09:25.108 INFO:teuthology.orchestra.console.trial090:Power off 2026-02-23T18:09:25.108 DEBUG:teuthology.orchestra.console.trial090:pexpect command: ipmitool -H trial090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T18:09:25.128 DEBUG:teuthology.orchestra.console.trial014:power off output: Chassis Power Control: Down/Off 2026-02-23T18:09:25.138 DEBUG:teuthology.orchestra.console.trial019:power off output: Chassis Power Control: Down/Off 2026-02-23T18:09:25.144 DEBUG:teuthology.orchestra.console.trial090:power off output: Chassis Power Control: Down/Off 2026-02-23T18:09:29.133 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:09:29.139 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:09:29.145 DEBUG:teuthology.orchestra.console.trial090:pexpect command: ipmitool -H trial090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:09:29.241 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is on 2026-02-23T18:09:29.245 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is on 2026-02-23T18:09:29.252 DEBUG:teuthology.orchestra.console.trial090:check power output: Chassis Power is on 2026-02-23T18:09:33.246 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:09:33.254 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:09:33.262 DEBUG:teuthology.orchestra.console.trial090:pexpect command: ipmitool -H trial090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:09:33.357 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is off 2026-02-23T18:09:33.357 INFO:teuthology.orchestra.console.trial014:Power off completed 2026-02-23T18:09:33.363 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is off 2026-02-23T18:09:33.363 INFO:teuthology.orchestra.console.trial019:Power off completed 2026-02-23T18:09:33.371 DEBUG:teuthology.orchestra.console.trial090:check power output: Chassis Power is off 2026-02-23T18:09:33.371 INFO:teuthology.orchestra.console.trial090:Power off completed 2026-02-23T18:09:33.647 INFO:teuthology.lock.ops:unlocked: trial014.front.sepia.ceph.com 2026-02-23T18:09:33.662 INFO:teuthology.lock.ops:unlocked: trial019.front.sepia.ceph.com 2026-02-23T18:09:33.667 INFO:teuthology.lock.ops:unlocked: trial090.front.sepia.ceph.com