2026-02-23T18:45:39.679 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T18:45:39.679 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T18:45:39.757 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T18:45:40.045 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x73b38c55c4a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x73b38c4b4e00>, signals=[15])
2026-02-23T18:45:40.045 INFO:teuthology.lock.ops:Start node 'trial077.front.sepia.ceph.com' reimaging
2026-02-23T18:45:40.045 INFO:teuthology.lock.ops:Updating [trial077.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T18:45:40.045 INFO:teuthology.lock.ops:Updating trial077.front.sepia.ceph.com on lock server
2026-02-23T18:45:40.103 INFO:teuthology.lock.ops:Start node 'trial145.front.sepia.ceph.com' reimaging
2026-02-23T18:45:40.104 INFO:teuthology.lock.ops:Updating [trial145.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T18:45:40.104 INFO:teuthology.lock.ops:Updating trial145.front.sepia.ceph.com on lock server
2026-02-23T18:45:40.162 INFO:teuthology.lock.ops:Start node 'trial185.front.sepia.ceph.com' reimaging
2026-02-23T18:45:40.162 INFO:teuthology.lock.ops:Updating [trial185.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T18:45:40.163 INFO:teuthology.lock.ops:Updating trial185.front.sepia.ceph.com on lock server
2026-02-23T18:45:40.402 DEBUG:teuthology.provision.fog.trial145:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-23T18:45:40.403 DEBUG:teuthology.provision.fog.trial077:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-23T18:45:40.452 INFO:teuthology.provision.fog.trial145:Scheduling deploy of ubuntu 22.04
2026-02-23T18:45:40.457 INFO:teuthology.provision.fog.trial077:Scheduling deploy of ubuntu 22.04
2026-02-23T18:45:40.461 DEBUG:teuthology.provision.fog.trial185:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-23T18:45:40.513 INFO:teuthology.provision.fog.trial185:Scheduling deploy of ubuntu 22.04
2026-02-23T18:45:42.721 INFO:teuthology.orchestra.console.trial145:Power off
2026-02-23T18:45:42.721 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T18:45:42.737 INFO:teuthology.orchestra.console.trial077:Power off
2026-02-23T18:45:42.737 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T18:45:42.746 INFO:teuthology.orchestra.console.trial185:Power off
2026-02-23T18:45:42.746 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T18:45:42.761 DEBUG:teuthology.orchestra.console.trial145:power off output: Chassis Power Control: Down/Off
2026-02-23T18:45:42.776 DEBUG:teuthology.orchestra.console.trial077:power off output: Chassis Power Control: Down/Off
2026-02-23T18:45:42.787 DEBUG:teuthology.orchestra.console.trial185:power off output: Chassis Power Control: Down/Off
2026-02-23T18:45:46.765 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T18:45:46.777 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T18:45:46.787 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T18:45:46.875 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is off
2026-02-23T18:45:46.876 INFO:teuthology.orchestra.console.trial145:Power off completed
2026-02-23T18:45:46.886 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is off
2026-02-23T18:45:46.886 INFO:teuthology.orchestra.console.trial077:Power off completed
2026-02-23T18:45:46.897 DEBUG:teuthology.orchestra.console.trial185:check power output: Chassis Power is off
2026-02-23T18:45:46.897 INFO:teuthology.orchestra.console.trial185:Power off completed
2026-02-23T18:45:46.976 INFO:teuthology.orchestra.console.trial145:Power on
2026-02-23T18:45:46.977 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T18:45:46.987 INFO:teuthology.orchestra.console.trial077:Power on
2026-02-23T18:45:46.988 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T18:45:46.997 INFO:teuthology.orchestra.console.trial185:Power on
2026-02-23T18:45:46.998 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T18:45:47.015 DEBUG:teuthology.orchestra.console.trial145:power on output: Chassis Power Control: Up/On
2026-02-23T18:45:47.027 DEBUG:teuthology.orchestra.console.trial077:power on output: Chassis Power Control: Up/On
2026-02-23T18:45:47.036 DEBUG:teuthology.orchestra.console.trial185:power on output: Chassis Power Control: Up/On
2026-02-23T18:45:51.020 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T18:45:51.029 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T18:45:51.038 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T18:45:51.132 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is on
2026-02-23T18:45:51.133 INFO:teuthology.orchestra.console.trial145:Power on completed
2026-02-23T18:45:51.140 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is on
2026-02-23T18:45:51.141 INFO:teuthology.orchestra.console.trial077:Power on completed
2026-02-23T18:45:51.149 DEBUG:teuthology.orchestra.console.trial185:check power output: Chassis Power is on
2026-02-23T18:45:51.149 INFO:teuthology.orchestra.console.trial185:Power on completed
2026-02-23T18:45:51.234 INFO:teuthology.provision.fog.trial145:Waiting for deploy to finish
2026-02-23T18:45:51.241 INFO:teuthology.provision.fog.trial077:Waiting for deploy to finish
2026-02-23T18:45:51.250 INFO:teuthology.provision.fog.trial185:Waiting for deploy to finish
2026-02-23T18:47:55.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:47:55.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:47:55.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:47:58.784 WARNING:teuthology.provision.fog.trial077:[Errno None] Unable to connect to port 22 on 10.20.193.77
2026-02-23T18:47:58.848 WARNING:teuthology.provision.fog.trial185:[Errno None] Unable to connect to port 22 on 10.20.193.185
2026-02-23T18:47:58.848 WARNING:teuthology.provision.fog.trial145:[Errno None] Unable to connect to port 22 on 10.20.193.145
2026-02-23T18:48:04.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:04.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:04.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:07.872 WARNING:teuthology.provision.fog.trial077:[Errno None] Unable to connect to port 22 on 10.20.193.77
2026-02-23T18:48:07.936 WARNING:teuthology.provision.fog.trial145:[Errno None] Unable to connect to port 22 on 10.20.193.145
2026-02-23T18:48:07.936 WARNING:teuthology.provision.fog.trial185:[Errno None] Unable to connect to port 22 on 10.20.193.185
2026-02-23T18:48:13.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:13.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:13.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:16.960 WARNING:teuthology.provision.fog.trial077:[Errno None] Unable to connect to port 22 on 10.20.193.77
2026-02-23T18:48:17.023 WARNING:teuthology.provision.fog.trial145:[Errno None] Unable to connect to port 22 on 10.20.193.145
2026-02-23T18:48:17.024 WARNING:teuthology.provision.fog.trial185:[Errno None] Unable to connect to port 22 on 10.20.193.185
2026-02-23T18:48:22.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:23.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:23.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:26.048 WARNING:teuthology.provision.fog.trial077:[Errno None] Unable to connect to port 22 on 10.20.193.77
2026-02-23T18:48:26.112 WARNING:teuthology.provision.fog.trial145:[Errno None] Unable to connect to port 22 on 10.20.193.145
2026-02-23T18:48:26.112 WARNING:teuthology.provision.fog.trial185:[Errno None] Unable to connect to port 22 on 10.20.193.185
2026-02-23T18:48:32.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:32.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:48:32.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:49:07.830 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T18:49:07.830 DEBUG:teuthology.orchestra.run.trial077:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T18:49:08.225 INFO:teuthology.provision.fog.trial077:Node is ready
2026-02-23T18:49:08.225 DEBUG:teuthology.orchestra.run.trial077:> hostname
2026-02-23T18:49:08.339 INFO:teuthology.orchestra.run.trial077.stdout:trial077.front.sepia.ceph.com
2026-02-23T18:49:08.339 DEBUG:teuthology.orchestra.run.trial077:> grep trial077.front.sepia.ceph.com /etc/hosts
2026-02-23T18:49:08.351 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T18:49:08.351 DEBUG:teuthology.orchestra.run.trial185:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T18:49:08.356 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T18:49:08.357 DEBUG:teuthology.orchestra.run.trial145:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T18:49:08.384 INFO:teuthology.orchestra.run.trial077.stdout:10.20.193.77 trial077.front.sepia.ceph.com trial077
2026-02-23T18:49:08.384 DEBUG:teuthology.orchestra.run.trial077:> sudo hostname trial077
2026-02-23T18:49:08.441 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/trial077.front.sepia.ceph.com/trial077/g' /etc/hosts
2026-02-23T18:49:08.493 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/10.20.193.77/10.20.193.77/g' /etc/hosts
2026-02-23T18:49:08.546 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i -e 's/trial077.front.sepia.ceph.com/trial077/g' /etc/hostname
2026-02-23T18:49:08.602 DEBUG:teuthology.orchestra.run.trial077:> sudo hostname trial077
2026-02-23T18:49:08.658 DEBUG:teuthology.orchestra.run.trial077:> cat /etc/os-release
2026-02-23T18:49:08.701 INFO:teuthology.orchestra.run.trial077.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-23T18:49:08.702 INFO:teuthology.orchestra.run.trial077.stdout:NAME="Ubuntu"
2026-02-23T18:49:08.702 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_ID="22.04"
2026-02-23T18:49:08.702 INFO:teuthology.orchestra.run.trial077.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-23T18:49:08.702 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_CODENAME=jammy
2026-02-23T18:49:08.702 INFO:teuthology.orchestra.run.trial077.stdout:ID=ubuntu
2026-02-23T18:49:08.702 INFO:teuthology.orchestra.run.trial077.stdout:ID_LIKE=debian
2026-02-23T18:49:08.702 INFO:teuthology.orchestra.run.trial077.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-23T18:49:08.702 INFO:teuthology.orchestra.run.trial077.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-23T18:49:08.703 INFO:teuthology.orchestra.run.trial077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-23T18:49:08.703 INFO:teuthology.orchestra.run.trial077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-23T18:49:08.703 INFO:teuthology.orchestra.run.trial077.stdout:UBUNTU_CODENAME=jammy
2026-02-23T18:49:08.704 INFO:teuthology.provision.fog.trial077:Deploy complete!
2026-02-23T18:49:08.706 DEBUG:teuthology.parallel:result is None
2026-02-23T18:49:08.744 INFO:teuthology.provision.fog.trial185:Node is ready
2026-02-23T18:49:08.744 DEBUG:teuthology.orchestra.run.trial185:> hostname
2026-02-23T18:49:08.746 INFO:teuthology.provision.fog.trial145:Node is ready
2026-02-23T18:49:08.747 DEBUG:teuthology.orchestra.run.trial145:> hostname
2026-02-23T18:49:08.788 INFO:teuthology.orchestra.run.trial185.stdout:trial185.front.sepia.ceph.com
2026-02-23T18:49:08.789 DEBUG:teuthology.orchestra.run.trial185:> grep trial185.front.sepia.ceph.com /etc/hosts
2026-02-23T18:49:08.798 INFO:teuthology.orchestra.run.trial145.stdout:trial145.front.sepia.ceph.com
2026-02-23T18:49:08.799 DEBUG:teuthology.orchestra.run.trial145:> grep trial145.front.sepia.ceph.com /etc/hosts
2026-02-23T18:49:08.841 INFO:teuthology.orchestra.run.trial185.stdout:10.20.193.185 trial185.front.sepia.ceph.com trial185
2026-02-23T18:49:08.842 DEBUG:teuthology.orchestra.run.trial185:> sudo hostname trial185
2026-02-23T18:49:08.848 INFO:teuthology.orchestra.run.trial145.stdout:10.20.193.145 trial145.front.sepia.ceph.com trial145
2026-02-23T18:49:08.848 DEBUG:teuthology.orchestra.run.trial145:> sudo hostname trial145
2026-02-23T18:49:08.896 DEBUG:teuthology.orchestra.run.trial185:> sudo sed -i -e 's/trial185.front.sepia.ceph.com/trial185/g' /etc/hosts
2026-02-23T18:49:08.900 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/trial145.front.sepia.ceph.com/trial145/g' /etc/hosts
2026-02-23T18:49:08.945 DEBUG:teuthology.orchestra.run.trial185:> sudo sed -i -e 's/10.20.193.185/10.20.193.185/g' /etc/hosts
2026-02-23T18:49:08.949 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/10.20.193.145/10.20.193.145/g' /etc/hosts
2026-02-23T18:49:08.996 DEBUG:teuthology.orchestra.run.trial185:> sudo sed -i -e 's/trial185.front.sepia.ceph.com/trial185/g' /etc/hostname
2026-02-23T18:49:08.998 DEBUG:teuthology.orchestra.run.trial145:> sudo sed -i -e 's/trial145.front.sepia.ceph.com/trial145/g' /etc/hostname
2026-02-23T18:49:09.049 DEBUG:teuthology.orchestra.run.trial185:> sudo hostname trial185
2026-02-23T18:49:09.050 DEBUG:teuthology.orchestra.run.trial145:> sudo hostname trial145
2026-02-23T18:49:09.100 DEBUG:teuthology.orchestra.run.trial185:> cat /etc/os-release
2026-02-23T18:49:09.102 DEBUG:teuthology.orchestra.run.trial145:> cat /etc/os-release
2026-02-23T18:49:09.147 INFO:teuthology.orchestra.run.trial185.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-23T18:49:09.147 INFO:teuthology.orchestra.run.trial185.stdout:NAME="Ubuntu"
2026-02-23T18:49:09.147 INFO:teuthology.orchestra.run.trial185.stdout:VERSION_ID="22.04"
2026-02-23T18:49:09.147 INFO:teuthology.orchestra.run.trial185.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-23T18:49:09.147 INFO:teuthology.orchestra.run.trial185.stdout:VERSION_CODENAME=jammy
2026-02-23T18:49:09.147 INFO:teuthology.orchestra.run.trial185.stdout:ID=ubuntu
2026-02-23T18:49:09.147 INFO:teuthology.orchestra.run.trial185.stdout:ID_LIKE=debian
2026-02-23T18:49:09.147 INFO:teuthology.orchestra.run.trial185.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-23T18:49:09.148 INFO:teuthology.orchestra.run.trial185.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-23T18:49:09.148 INFO:teuthology.orchestra.run.trial185.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-23T18:49:09.148 INFO:teuthology.orchestra.run.trial185.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-23T18:49:09.148 INFO:teuthology.orchestra.run.trial185.stdout:UBUNTU_CODENAME=jammy
2026-02-23T18:49:09.148 INFO:teuthology.provision.fog.trial185:Deploy complete!
2026-02-23T18:49:09.148 DEBUG:teuthology.parallel:result is None
2026-02-23T18:49:09.148 INFO:teuthology.orchestra.run.trial145.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:NAME="Ubuntu"
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:VERSION_ID="22.04"
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:VERSION_CODENAME=jammy
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:ID=ubuntu
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:ID_LIKE=debian
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-23T18:49:09.149 INFO:teuthology.orchestra.run.trial145.stdout:UBUNTU_CODENAME=jammy
2026-02-23T18:49:09.149 INFO:teuthology.provision.fog.trial145:Deploy complete!
2026-02-23T18:49:09.149 DEBUG:teuthology.parallel:result is None
2026-02-23T18:49:09.854 INFO:teuthology.lock.ops:Checking trial077.front.sepia.ceph.com
2026-02-23T18:49:09.854 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T18:49:09.961 INFO:teuthology.lock.ops:Checking trial145.front.sepia.ceph.com
2026-02-23T18:49:09.961 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T18:49:10.026 INFO:teuthology.lock.ops:Checking trial185.front.sepia.ceph.com
2026-02-23T18:49:10.027 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T18:49:10.085 INFO:teuthology.lock.ops:Updating [trial077.front.sepia.ceph.com]: set os type and version on server
2026-02-23T18:49:10.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com'
2026-02-23T18:49:10.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:49:10.149 DEBUG:teuthology.orchestra.run.trial077:> true
2026-02-23T18:49:10.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial077.front.sepia.ceph.com'
2026-02-23T18:49:10.229 DEBUG:teuthology.orchestra.run.trial077:> uname -m
2026-02-23T18:49:10.273 INFO:teuthology.orchestra.run.trial077.stdout:x86_64
2026-02-23T18:49:10.273 DEBUG:teuthology.orchestra.run.trial077:> cat /etc/os-release
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:NAME="Ubuntu"
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_ID="22.04"
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_CODENAME=jammy
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:ID=ubuntu
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:ID_LIKE=debian
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-23T18:49:10.317 INFO:teuthology.orchestra.run.trial077.stdout:UBUNTU_CODENAME=jammy
2026-02-23T18:49:10.317 INFO:teuthology.lock.ops:Updating trial077.front.sepia.ceph.com on lock server
2026-02-23T18:49:10.377 INFO:teuthology.lock.ops:Updating [trial145.front.sepia.ceph.com]: set os type and version on server
2026-02-23T18:49:10.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial145.front.sepia.ceph.com'
2026-02-23T18:49:10.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:49:10.441 DEBUG:teuthology.orchestra.run.trial145:> true
2026-02-23T18:49:10.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial145.front.sepia.ceph.com'
2026-02-23T18:49:10.520 DEBUG:teuthology.orchestra.run.trial145:> uname -m
2026-02-23T18:49:10.564 INFO:teuthology.orchestra.run.trial145.stdout:x86_64
2026-02-23T18:49:10.565 DEBUG:teuthology.orchestra.run.trial145:> cat /etc/os-release
2026-02-23T18:49:10.609 INFO:teuthology.orchestra.run.trial145.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-23T18:49:10.609 INFO:teuthology.orchestra.run.trial145.stdout:NAME="Ubuntu"
2026-02-23T18:49:10.609 INFO:teuthology.orchestra.run.trial145.stdout:VERSION_ID="22.04"
2026-02-23T18:49:10.609 INFO:teuthology.orchestra.run.trial145.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-23T18:49:10.609 INFO:teuthology.orchestra.run.trial145.stdout:VERSION_CODENAME=jammy
2026-02-23T18:49:10.609 INFO:teuthology.orchestra.run.trial145.stdout:ID=ubuntu
2026-02-23T18:49:10.609 INFO:teuthology.orchestra.run.trial145.stdout:ID_LIKE=debian
2026-02-23T18:49:10.609 INFO:teuthology.orchestra.run.trial145.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-23T18:49:10.610 INFO:teuthology.orchestra.run.trial145.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-23T18:49:10.610 INFO:teuthology.orchestra.run.trial145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-23T18:49:10.610 INFO:teuthology.orchestra.run.trial145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-23T18:49:10.610 INFO:teuthology.orchestra.run.trial145.stdout:UBUNTU_CODENAME=jammy
2026-02-23T18:49:10.610 INFO:teuthology.lock.ops:Updating trial145.front.sepia.ceph.com on lock server
2026-02-23T18:49:10.708 INFO:teuthology.lock.ops:Updating [trial185.front.sepia.ceph.com]: set os type and version on server
2026-02-23T18:49:10.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com'
2026-02-23T18:49:10.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T18:49:10.776 DEBUG:teuthology.orchestra.run.trial185:> true
2026-02-23T18:49:10.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com'
2026-02-23T18:49:10.855 DEBUG:teuthology.orchestra.run.trial185:> uname -m
2026-02-23T18:49:10.899 INFO:teuthology.orchestra.run.trial185.stdout:x86_64
2026-02-23T18:49:10.899 DEBUG:teuthology.orchestra.run.trial185:> cat /etc/os-release
2026-02-23T18:49:10.943 INFO:teuthology.orchestra.run.trial185.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-23T18:49:10.943 INFO:teuthology.orchestra.run.trial185.stdout:NAME="Ubuntu"
2026-02-23T18:49:10.943 INFO:teuthology.orchestra.run.trial185.stdout:VERSION_ID="22.04"
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:VERSION_CODENAME=jammy
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:ID=ubuntu
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:ID_LIKE=debian
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-23T18:49:10.944 INFO:teuthology.orchestra.run.trial185.stdout:UBUNTU_CODENAME=jammy
2026-02-23T18:49:10.944 INFO:teuthology.lock.ops:Updating trial185.front.sepia.ceph.com on lock server
2026-02-23T18:49:11.021 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T18:49:11.104 INFO:teuthology.dispatcher.supervisor:Running job 66768
2026-02-23T18:49:11.104 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66768 --name nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds} ec_optimizations/ec_optimizations_off mon_election/connectivity msgr-failures/osd-delay objectstore/{bluestore/{alloc$/{bitmap} base mem$/{low} onode-segment$/{none} write$/{v2/{compr$/{no$/{no}} v2}}}} rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2-technique=cauchy} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66768/orig.config.yaml
2026-02-23T18:49:11.105 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66768
2026-02-23T18:49:11.105 INFO:teuthology.dispatcher.supervisor:Job PID: 1620073
2026-02-23T18:49:11.105 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T18:51:11.127 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T18:53:11.330 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T18:55:11.534 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T18:57:11.751 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T18:59:11.958 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T19:01:12.166 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T19:03:12.382 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T19:05:12.507 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T19:07:12.673 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T19:09:12.878 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T19:11:13.074 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T19:13:13.245 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T19:13:13.354 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-23T19:13:13.549 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T19:13:14.194 INFO:teuthology.orchestra.console.trial145:Power off
2026-02-23T19:13:14.194 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T19:13:14.234 DEBUG:teuthology.orchestra.console.trial145:power off output: Chassis Power Control: Down/Off
2026-02-23T19:13:14.350 INFO:teuthology.orchestra.console.trial077:Power off
2026-02-23T19:13:14.350 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T19:13:14.361 INFO:teuthology.orchestra.console.trial185:Power off
2026-02-23T19:13:14.361 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T19:13:14.389 DEBUG:teuthology.orchestra.console.trial077:power off output: Chassis Power Control: Down/Off
2026-02-23T19:13:14.406 DEBUG:teuthology.orchestra.console.trial185:power off output: Chassis Power Control: Down/Off
2026-02-23T19:13:18.238 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T19:13:18.347 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is on
2026-02-23T19:13:18.391 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T19:13:18.406 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T19:13:18.502 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is on
2026-02-23T19:13:18.517 DEBUG:teuthology.orchestra.console.trial185:check power output: Chassis Power is on
2026-02-23T19:13:22.351 DEBUG:teuthology.orchestra.console.trial145:pexpect command: ipmitool -H trial145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T19:13:22.460 DEBUG:teuthology.orchestra.console.trial145:check power output: Chassis Power is off
2026-02-23T19:13:22.461 INFO:teuthology.orchestra.console.trial145:Power off completed
2026-02-23T19:13:22.502 DEBUG:teuthology.orchestra.console.trial077:pexpect command: ipmitool -H trial077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T19:13:22.518 DEBUG:teuthology.orchestra.console.trial185:pexpect command: ipmitool -H trial185.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T19:13:22.659 DEBUG:teuthology.orchestra.console.trial077:check power output: Chassis Power is off
2026-02-23T19:13:22.659 INFO:teuthology.orchestra.console.trial077:Power off completed
2026-02-23T19:13:22.659 DEBUG:teuthology.orchestra.console.trial185:check power output: Chassis Power is off
2026-02-23T19:13:22.660 INFO:teuthology.orchestra.console.trial185:Power off completed
2026-02-23T19:13:22.680 INFO:teuthology.lock.ops:unlocked: trial145.front.sepia.ceph.com
2026-02-23T19:13:22.865 INFO:teuthology.lock.ops:unlocked: trial077.front.sepia.ceph.com
2026-02-23T19:13:22.872 INFO:teuthology.lock.ops:unlocked: trial185.front.sepia.ceph.com