2026-02-25T12:08:41.370 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T12:08:41.371 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:08:41.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:08:41.709 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x70c0b94c4400>, signals=[15]) 2026-02-25T12:08:41.709 INFO:teuthology.lock.ops:Start node 'trial015.front.sepia.ceph.com' reimaging 2026-02-25T12:08:41.709 INFO:teuthology.lock.ops:Updating [trial015.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T12:08:41.709 INFO:teuthology.lock.ops:Updating trial015.front.sepia.ceph.com on lock server 2026-02-25T12:08:41.767 INFO:teuthology.lock.ops:Start node 'trial161.front.sepia.ceph.com' reimaging 2026-02-25T12:08:41.767 INFO:teuthology.lock.ops:Updating [trial161.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T12:08:41.767 INFO:teuthology.lock.ops:Updating trial161.front.sepia.ceph.com on lock server 2026-02-25T12:08:41.828 INFO:teuthology.lock.ops:Start node 'trial163.front.sepia.ceph.com' reimaging 2026-02-25T12:08:41.828 INFO:teuthology.lock.ops:Updating [trial163.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T12:08:41.828 INFO:teuthology.lock.ops:Updating trial163.front.sepia.ceph.com on lock server 2026-02-25T12:08:42.055 DEBUG:teuthology.provision.fog.trial015:Requesting image trial_ubuntu_22.04 (ID 1) 2026-02-25T12:08:42.056 DEBUG:teuthology.provision.fog.trial161:Requesting image trial_ubuntu_22.04 (ID 1) 2026-02-25T12:08:42.086 INFO:teuthology.provision.fog.trial015:Scheduling deploy of ubuntu 22.04 2026-02-25T12:08:42.113 INFO:teuthology.provision.fog.trial161:Scheduling deploy of ubuntu 22.04 2026-02-25T12:08:42.115 DEBUG:teuthology.provision.fog.trial163:Requesting image trial_ubuntu_22.04 (ID 1) 2026-02-25T12:08:42.157 INFO:teuthology.provision.fog.trial163:Scheduling deploy of ubuntu 22.04 2026-02-25T12:08:43.658 INFO:teuthology.orchestra.console.trial015:Power off 2026-02-25T12:08:43.658 DEBUG:teuthology.orchestra.console.trial015:pexpect command: ipmitool -H trial015.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T12:08:43.745 DEBUG:teuthology.orchestra.console.trial015:power off output: Chassis Power Control: Down/Off 2026-02-25T12:08:43.797 INFO:teuthology.orchestra.console.trial161:Power off 2026-02-25T12:08:43.797 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T12:08:43.817 INFO:teuthology.orchestra.console.trial163:Power off 2026-02-25T12:08:43.817 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T12:08:43.836 DEBUG:teuthology.orchestra.console.trial161:power off output: Chassis Power Control: Down/Off 2026-02-25T12:08:43.863 DEBUG:teuthology.orchestra.console.trial163:power off output: Chassis Power Control: Down/Off 2026-02-25T12:08:47.750 DEBUG:teuthology.orchestra.console.trial015:pexpect command: ipmitool -H trial015.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:08:47.837 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:08:47.860 DEBUG:teuthology.orchestra.console.trial015:check power output: Chassis Power is off 2026-02-25T12:08:47.861 INFO:teuthology.orchestra.console.trial015:Power off completed 2026-02-25T12:08:47.865 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:08:47.947 DEBUG:teuthology.orchestra.console.trial161:check power output: Chassis Power is off 2026-02-25T12:08:47.948 INFO:teuthology.orchestra.console.trial161:Power off completed 2026-02-25T12:08:47.962 INFO:teuthology.orchestra.console.trial015:Power on 2026-02-25T12:08:47.963 DEBUG:teuthology.orchestra.console.trial015:pexpect command: ipmitool -H trial015.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T12:08:47.974 DEBUG:teuthology.orchestra.console.trial163:check power output: Chassis Power is off 2026-02-25T12:08:47.975 INFO:teuthology.orchestra.console.trial163:Power off completed 2026-02-25T12:08:48.008 DEBUG:teuthology.orchestra.console.trial015:power on output: Chassis Power Control: Up/On 2026-02-25T12:08:48.049 INFO:teuthology.orchestra.console.trial161:Power on 2026-02-25T12:08:48.049 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T12:08:48.076 INFO:teuthology.orchestra.console.trial163:Power on 2026-02-25T12:08:48.076 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T12:08:48.093 DEBUG:teuthology.orchestra.console.trial161:power on output: Chassis Power Control: Up/On 2026-02-25T12:08:48.121 DEBUG:teuthology.orchestra.console.trial163:power on output: Chassis Power Control: Up/On 2026-02-25T12:08:52.012 DEBUG:teuthology.orchestra.console.trial015:pexpect command: ipmitool -H trial015.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:08:52.094 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:08:52.121 DEBUG:teuthology.orchestra.console.trial015:check power output: Chassis Power is on 2026-02-25T12:08:52.121 INFO:teuthology.orchestra.console.trial015:Power on completed 2026-02-25T12:08:52.121 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:08:52.203 DEBUG:teuthology.orchestra.console.trial161:check power output: Chassis Power is on 2026-02-25T12:08:52.203 INFO:teuthology.orchestra.console.trial161:Power on completed 2026-02-25T12:08:52.222 INFO:teuthology.provision.fog.trial015:Waiting for deploy to finish 2026-02-25T12:08:52.229 DEBUG:teuthology.orchestra.console.trial163:check power output: Chassis Power is on 2026-02-25T12:08:52.229 INFO:teuthology.orchestra.console.trial163:Power on completed 2026-02-25T12:08:52.304 INFO:teuthology.provision.fog.trial161:Waiting for deploy to finish 2026-02-25T12:08:52.330 INFO:teuthology.provision.fog.trial163:Waiting for deploy to finish 2026-02-25T12:10:55.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:10:56.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:10:56.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:10:58.560 WARNING:teuthology.provision.fog.trial015:[Errno None] Unable to connect to port 22 on 10.20.193.15 2026-02-25T12:10:59.521 WARNING:teuthology.provision.fog.trial161:[Errno None] Unable to connect to port 22 on 10.20.193.161 2026-02-25T12:10:59.584 WARNING:teuthology.provision.fog.trial163:[Errno None] Unable to connect to port 22 on 10.20.193.163 2026-02-25T12:11:04.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:05.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:05.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:07.648 WARNING:teuthology.provision.fog.trial015:[Errno None] Unable to connect to port 22 on 10.20.193.15 2026-02-25T12:11:08.608 WARNING:teuthology.provision.fog.trial161:[Errno None] Unable to connect to port 22 on 10.20.193.161 2026-02-25T12:11:08.672 WARNING:teuthology.provision.fog.trial163:[Errno None] Unable to connect to port 22 on 10.20.193.163 2026-02-25T12:11:13.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:14.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:14.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:16.736 WARNING:teuthology.provision.fog.trial015:[Errno None] Unable to connect to port 22 on 10.20.193.15 2026-02-25T12:11:17.697 WARNING:teuthology.provision.fog.trial161:[Errno None] Unable to connect to port 22 on 10.20.193.161 2026-02-25T12:11:17.761 WARNING:teuthology.provision.fog.trial163:[Errno None] Unable to connect to port 22 on 10.20.193.163 2026-02-25T12:11:22.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:23.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:23.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:25.824 WARNING:teuthology.provision.fog.trial015:[Errno None] Unable to connect to port 22 on 10.20.193.15 2026-02-25T12:11:26.785 WARNING:teuthology.provision.fog.trial161:[Errno None] Unable to connect to port 22 on 10.20.193.161 2026-02-25T12:11:26.849 WARNING:teuthology.provision.fog.trial163:[Errno None] Unable to connect to port 22 on 10.20.193.163 2026-02-25T12:11:31.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:32.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:32.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:11:34.912 WARNING:teuthology.provision.fog.trial015:[Errno None] Unable to connect to port 22 on 10.20.193.15 2026-02-25T12:11:40.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:12:09.078 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T12:12:09.078 DEBUG:teuthology.orchestra.run.trial163:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T12:12:09.467 INFO:teuthology.provision.fog.trial163:Node is ready 2026-02-25T12:12:09.467 DEBUG:teuthology.orchestra.run.trial163:> hostname 2026-02-25T12:12:09.517 INFO:teuthology.orchestra.run.trial163.stdout:trial163.front.sepia.ceph.com 2026-02-25T12:12:09.517 DEBUG:teuthology.orchestra.run.trial163:> grep trial163.front.sepia.ceph.com /etc/hosts 2026-02-25T12:12:09.565 INFO:teuthology.orchestra.run.trial163.stdout:10.20.193.163 trial163.front.sepia.ceph.com trial163 2026-02-25T12:12:09.565 DEBUG:teuthology.orchestra.run.trial163:> sudo hostname trial163 2026-02-25T12:12:09.624 DEBUG:teuthology.orchestra.run.trial163:> sudo sed -i -e 's/trial163.front.sepia.ceph.com/trial163/g' /etc/hosts 2026-02-25T12:12:09.673 DEBUG:teuthology.orchestra.run.trial163:> sudo sed -i -e 's/10.20.193.163/10.20.193.163/g' /etc/hosts 2026-02-25T12:12:09.726 DEBUG:teuthology.orchestra.run.trial163:> sudo sed -i -e 's/trial163.front.sepia.ceph.com/trial163/g' /etc/hostname 2026-02-25T12:12:09.781 DEBUG:teuthology.orchestra.run.trial163:> sudo hostname trial163 2026-02-25T12:12:09.832 DEBUG:teuthology.orchestra.run.trial163:> cat /etc/os-release 2026-02-25T12:12:09.877 INFO:teuthology.orchestra.run.trial163.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T12:12:09.878 INFO:teuthology.orchestra.run.trial163.stdout:NAME="Ubuntu" 2026-02-25T12:12:09.878 INFO:teuthology.orchestra.run.trial163.stdout:VERSION_ID="22.04" 2026-02-25T12:12:09.878 INFO:teuthology.orchestra.run.trial163.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T12:12:09.878 INFO:teuthology.orchestra.run.trial163.stdout:VERSION_CODENAME=jammy 2026-02-25T12:12:09.878 INFO:teuthology.orchestra.run.trial163.stdout:ID=ubuntu 2026-02-25T12:12:09.879 INFO:teuthology.orchestra.run.trial163.stdout:ID_LIKE=debian 2026-02-25T12:12:09.879 INFO:teuthology.orchestra.run.trial163.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T12:12:09.879 INFO:teuthology.orchestra.run.trial163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T12:12:09.879 INFO:teuthology.orchestra.run.trial163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T12:12:09.879 INFO:teuthology.orchestra.run.trial163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T12:12:09.879 INFO:teuthology.orchestra.run.trial163.stdout:UBUNTU_CODENAME=jammy 2026-02-25T12:12:09.880 INFO:teuthology.provision.fog.trial163:Deploy complete! 2026-02-25T12:12:09.882 DEBUG:teuthology.parallel:result is None 2026-02-25T12:12:16.723 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T12:12:16.724 DEBUG:teuthology.orchestra.run.trial015:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T12:12:17.115 INFO:teuthology.provision.fog.trial015:Node is ready 2026-02-25T12:12:17.115 DEBUG:teuthology.orchestra.run.trial015:> hostname 2026-02-25T12:12:17.161 INFO:teuthology.orchestra.run.trial015.stdout:trial015.front.sepia.ceph.com 2026-02-25T12:12:17.162 DEBUG:teuthology.orchestra.run.trial015:> grep trial015.front.sepia.ceph.com /etc/hosts 2026-02-25T12:12:17.209 INFO:teuthology.orchestra.run.trial015.stdout:10.20.193.15 trial015.front.sepia.ceph.com trial015 2026-02-25T12:12:17.209 DEBUG:teuthology.orchestra.run.trial015:> sudo hostname trial015 2026-02-25T12:12:17.265 DEBUG:teuthology.orchestra.run.trial015:> sudo sed -i -e 's/trial015.front.sepia.ceph.com/trial015/g' /etc/hosts 2026-02-25T12:12:17.314 DEBUG:teuthology.orchestra.run.trial015:> sudo sed -i -e 's/10.20.193.15/10.20.193.15/g' /etc/hosts 2026-02-25T12:12:17.370 DEBUG:teuthology.orchestra.run.trial015:> sudo sed -i -e 's/trial015.front.sepia.ceph.com/trial015/g' /etc/hostname 2026-02-25T12:12:17.421 DEBUG:teuthology.orchestra.run.trial015:> sudo hostname trial015 2026-02-25T12:12:17.476 DEBUG:teuthology.orchestra.run.trial015:> cat /etc/os-release 2026-02-25T12:12:17.520 INFO:teuthology.orchestra.run.trial015.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:NAME="Ubuntu" 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:VERSION_ID="22.04" 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:VERSION_CODENAME=jammy 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:ID=ubuntu 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:ID_LIKE=debian 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T12:12:17.521 INFO:teuthology.orchestra.run.trial015.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T12:12:17.522 INFO:teuthology.orchestra.run.trial015.stdout:UBUNTU_CODENAME=jammy 2026-02-25T12:12:17.522 INFO:teuthology.provision.fog.trial015:Deploy complete! 2026-02-25T12:12:17.523 DEBUG:teuthology.parallel:result is None 2026-02-25T12:12:32.801 WARNING:teuthology.provision.fog.trial161:timed out 2026-02-25T12:12:38.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:12:38.882 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T12:12:38.882 DEBUG:teuthology.orchestra.run.trial161:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T12:12:39.277 INFO:teuthology.provision.fog.trial161:Node is ready 2026-02-25T12:12:39.278 DEBUG:teuthology.orchestra.run.trial161:> hostname 2026-02-25T12:12:39.324 INFO:teuthology.orchestra.run.trial161.stdout:trial161.front.sepia.ceph.com 2026-02-25T12:12:39.324 DEBUG:teuthology.orchestra.run.trial161:> grep trial161.front.sepia.ceph.com /etc/hosts 2026-02-25T12:12:39.369 INFO:teuthology.orchestra.run.trial161.stdout:10.20.193.161 trial161.front.sepia.ceph.com trial161 2026-02-25T12:12:39.369 DEBUG:teuthology.orchestra.run.trial161:> sudo hostname trial161 2026-02-25T12:12:39.424 DEBUG:teuthology.orchestra.run.trial161:> sudo sed -i -e 's/trial161.front.sepia.ceph.com/trial161/g' /etc/hosts 2026-02-25T12:12:39.473 DEBUG:teuthology.orchestra.run.trial161:> sudo sed -i -e 's/10.20.193.161/10.20.193.161/g' /etc/hosts 2026-02-25T12:12:39.525 DEBUG:teuthology.orchestra.run.trial161:> sudo sed -i -e 's/trial161.front.sepia.ceph.com/trial161/g' /etc/hostname 2026-02-25T12:12:39.573 DEBUG:teuthology.orchestra.run.trial161:> sudo hostname trial161 2026-02-25T12:12:39.629 DEBUG:teuthology.orchestra.run.trial161:> cat /etc/os-release 2026-02-25T12:12:39.673 INFO:teuthology.orchestra.run.trial161.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T12:12:39.673 INFO:teuthology.orchestra.run.trial161.stdout:NAME="Ubuntu" 2026-02-25T12:12:39.673 INFO:teuthology.orchestra.run.trial161.stdout:VERSION_ID="22.04" 2026-02-25T12:12:39.673 INFO:teuthology.orchestra.run.trial161.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T12:12:39.673 INFO:teuthology.orchestra.run.trial161.stdout:VERSION_CODENAME=jammy 2026-02-25T12:12:39.673 INFO:teuthology.orchestra.run.trial161.stdout:ID=ubuntu 2026-02-25T12:12:39.673 INFO:teuthology.orchestra.run.trial161.stdout:ID_LIKE=debian 2026-02-25T12:12:39.673 INFO:teuthology.orchestra.run.trial161.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T12:12:39.674 INFO:teuthology.orchestra.run.trial161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T12:12:39.674 INFO:teuthology.orchestra.run.trial161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T12:12:39.674 INFO:teuthology.orchestra.run.trial161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T12:12:39.674 INFO:teuthology.orchestra.run.trial161.stdout:UBUNTU_CODENAME=jammy 2026-02-25T12:12:39.674 INFO:teuthology.provision.fog.trial161:Deploy complete! 2026-02-25T12:12:39.675 DEBUG:teuthology.parallel:result is None 2026-02-25T12:12:40.415 INFO:teuthology.lock.ops:Checking trial015.front.sepia.ceph.com 2026-02-25T12:12:40.415 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T12:12:40.523 INFO:teuthology.lock.ops:Checking trial161.front.sepia.ceph.com 2026-02-25T12:12:40.523 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T12:12:40.586 INFO:teuthology.lock.ops:Checking trial163.front.sepia.ceph.com 2026-02-25T12:12:40.586 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T12:12:40.644 INFO:teuthology.lock.ops:Updating [trial015.front.sepia.ceph.com]: set os type and version on server 2026-02-25T12:12:40.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial015.front.sepia.ceph.com' 2026-02-25T12:12:40.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:12:40.708 DEBUG:teuthology.orchestra.run.trial015:> true 2026-02-25T12:12:40.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial015.front.sepia.ceph.com' 2026-02-25T12:12:40.841 DEBUG:teuthology.orchestra.run.trial015:> uname -m 2026-02-25T12:12:40.889 INFO:teuthology.orchestra.run.trial015.stdout:x86_64 2026-02-25T12:12:40.889 DEBUG:teuthology.orchestra.run.trial015:> cat /etc/os-release 2026-02-25T12:12:40.932 INFO:teuthology.orchestra.run.trial015.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:NAME="Ubuntu" 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:VERSION_ID="22.04" 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:VERSION_CODENAME=jammy 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:ID=ubuntu 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:ID_LIKE=debian 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T12:12:40.933 INFO:teuthology.orchestra.run.trial015.stdout:UBUNTU_CODENAME=jammy 2026-02-25T12:12:40.934 INFO:teuthology.lock.ops:Updating trial015.front.sepia.ceph.com on lock server 2026-02-25T12:12:41.037 INFO:teuthology.lock.ops:Updating [trial161.front.sepia.ceph.com]: set os type and version on server 2026-02-25T12:12:41.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-25T12:12:41.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:12:41.107 DEBUG:teuthology.orchestra.run.trial161:> true 2026-02-25T12:12:41.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-25T12:12:41.184 DEBUG:teuthology.orchestra.run.trial161:> uname -m 2026-02-25T12:12:41.228 INFO:teuthology.orchestra.run.trial161.stdout:x86_64 2026-02-25T12:12:41.229 DEBUG:teuthology.orchestra.run.trial161:> cat /etc/os-release 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:NAME="Ubuntu" 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:VERSION_ID="22.04" 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:VERSION_CODENAME=jammy 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:ID=ubuntu 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:ID_LIKE=debian 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T12:12:41.273 INFO:teuthology.orchestra.run.trial161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T12:12:41.274 INFO:teuthology.orchestra.run.trial161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T12:12:41.274 INFO:teuthology.orchestra.run.trial161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T12:12:41.274 INFO:teuthology.orchestra.run.trial161.stdout:UBUNTU_CODENAME=jammy 2026-02-25T12:12:41.274 INFO:teuthology.lock.ops:Updating trial161.front.sepia.ceph.com on lock server 2026-02-25T12:12:41.374 INFO:teuthology.lock.ops:Updating [trial163.front.sepia.ceph.com]: set os type and version on server 2026-02-25T12:12:41.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-25T12:12:41.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T12:12:41.439 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-25T12:12:41.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-25T12:12:41.574 DEBUG:teuthology.orchestra.run.trial163:> uname -m 2026-02-25T12:12:41.620 INFO:teuthology.orchestra.run.trial163.stdout:x86_64 2026-02-25T12:12:41.620 DEBUG:teuthology.orchestra.run.trial163:> cat /etc/os-release 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:NAME="Ubuntu" 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:VERSION_ID="22.04" 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:VERSION_CODENAME=jammy 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:ID=ubuntu 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:ID_LIKE=debian 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T12:12:41.664 INFO:teuthology.orchestra.run.trial163.stdout:UBUNTU_CODENAME=jammy 2026-02-25T12:12:41.665 INFO:teuthology.lock.ops:Updating trial163.front.sepia.ceph.com on lock server 2026-02-25T12:12:41.727 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:12:41.817 INFO:teuthology.dispatcher.supervisor:Running job 69934 2026-02-25T12:12:41.817 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-25_11:36:23-rados-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/69934 --name nmordech-2026-02-25_11:36:23-rados-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds} ec_optimizations/ec_optimizations_off mon_election/connectivity msgr-failures/osd-delay objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-1} onode-segment$/{512K} write$/{random/{compr$/{yes$/{zstd}} random}}}} rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-25_11:36:23-rados-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/69934/orig.config.yaml 2026-02-25T12:12:41.817 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-25_11:36:23-rados-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/69934 2026-02-25T12:12:41.817 INFO:teuthology.dispatcher.supervisor:Job PID: 919538 2026-02-25T12:12:41.817 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-25T12:14:41.906 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:16:42.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:18:42.308 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:20:42.518 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:22:42.700 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:24:42.884 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:26:43.024 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:28:43.141 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:30:43.531 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:32:43.721 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:34:43.906 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:36:44.074 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T12:36:44.150 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-25T12:36:44.320 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-25T12:36:45.059 INFO:teuthology.orchestra.console.trial015:Power off 2026-02-25T12:36:45.059 DEBUG:teuthology.orchestra.console.trial015:pexpect command: ipmitool -H trial015.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T12:36:45.072 INFO:teuthology.orchestra.console.trial161:Power off 2026-02-25T12:36:45.072 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T12:36:45.082 INFO:teuthology.orchestra.console.trial163:Power off 2026-02-25T12:36:45.082 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T12:36:45.097 DEBUG:teuthology.orchestra.console.trial015:power off output: Chassis Power Control: Down/Off 2026-02-25T12:36:45.109 DEBUG:teuthology.orchestra.console.trial161:power off output: Chassis Power Control: Down/Off 2026-02-25T12:36:45.119 DEBUG:teuthology.orchestra.console.trial163:power off output: Chassis Power Control: Down/Off 2026-02-25T12:36:49.101 DEBUG:teuthology.orchestra.console.trial015:pexpect command: ipmitool -H trial015.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:36:49.109 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:36:49.120 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:36:49.213 DEBUG:teuthology.orchestra.console.trial015:check power output: Chassis Power is on 2026-02-25T12:36:49.219 DEBUG:teuthology.orchestra.console.trial161:check power output: Chassis Power is on 2026-02-25T12:36:49.228 DEBUG:teuthology.orchestra.console.trial163:check power output: Chassis Power is on 2026-02-25T12:36:53.218 DEBUG:teuthology.orchestra.console.trial015:pexpect command: ipmitool -H trial015.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:36:53.225 DEBUG:teuthology.orchestra.console.trial161:pexpect command: ipmitool -H trial161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:36:53.235 DEBUG:teuthology.orchestra.console.trial163:pexpect command: ipmitool -H trial163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T12:36:53.327 DEBUG:teuthology.orchestra.console.trial015:check power output: Chassis Power is off 2026-02-25T12:36:53.327 INFO:teuthology.orchestra.console.trial015:Power off completed 2026-02-25T12:36:53.337 DEBUG:teuthology.orchestra.console.trial161:check power output: Chassis Power is off 2026-02-25T12:36:53.337 INFO:teuthology.orchestra.console.trial161:Power off completed 2026-02-25T12:36:53.344 DEBUG:teuthology.orchestra.console.trial163:check power output: Chassis Power is off 2026-02-25T12:36:53.344 INFO:teuthology.orchestra.console.trial163:Power off completed 2026-02-25T12:36:53.622 INFO:teuthology.lock.ops:unlocked: trial015.front.sepia.ceph.com 2026-02-25T12:36:53.633 INFO:teuthology.lock.ops:unlocked: trial161.front.sepia.ceph.com 2026-02-25T12:36:53.748 INFO:teuthology.lock.ops:unlocked: trial163.front.sepia.ceph.com