2026-02-21T22:37:04.152 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-21T22:37:04.152 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:37:04.225 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:37:04.482 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72e1ab086e80>, signals=[15]) 2026-02-21T22:37:04.482 INFO:teuthology.lock.ops:Start node 'trial009.front.sepia.ceph.com' reimaging 2026-02-21T22:37:04.482 INFO:teuthology.lock.ops:Updating [trial009.front.sepia.ceph.com]: reset os type and version on server 2026-02-21T22:37:04.482 INFO:teuthology.lock.ops:Updating trial009.front.sepia.ceph.com on lock server 2026-02-21T22:37:04.540 INFO:teuthology.lock.ops:Start node 'trial127.front.sepia.ceph.com' reimaging 2026-02-21T22:37:04.540 INFO:teuthology.lock.ops:Updating [trial127.front.sepia.ceph.com]: reset os type and version on server 2026-02-21T22:37:04.540 INFO:teuthology.lock.ops:Updating trial127.front.sepia.ceph.com on lock server 2026-02-21T22:37:04.596 INFO:teuthology.lock.ops:Start node 'trial144.front.sepia.ceph.com' reimaging 2026-02-21T22:37:04.597 INFO:teuthology.lock.ops:Updating [trial144.front.sepia.ceph.com]: reset os type and version on server 2026-02-21T22:37:04.597 INFO:teuthology.lock.ops:Updating trial144.front.sepia.ceph.com on lock server 2026-02-21T22:37:04.820 DEBUG:teuthology.provision.fog.trial009:Requesting image trial_ubuntu_22.04 (ID 1) 2026-02-21T22:37:04.821 DEBUG:teuthology.provision.fog.trial127:Requesting image trial_ubuntu_22.04 (ID 1) 2026-02-21T22:37:04.873 INFO:teuthology.provision.fog.trial009:Scheduling deploy of ubuntu 22.04 2026-02-21T22:37:04.875 INFO:teuthology.provision.fog.trial127:Scheduling deploy of ubuntu 22.04 2026-02-21T22:37:04.888 DEBUG:teuthology.provision.fog.trial144:Requesting image trial_ubuntu_22.04 (ID 1) 2026-02-21T22:37:04.917 INFO:teuthology.provision.fog.trial144:Scheduling deploy of ubuntu 22.04 2026-02-21T22:37:06.431 INFO:teuthology.orchestra.console.trial009:Power off 2026-02-21T22:37:06.431 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T22:37:06.444 INFO:teuthology.orchestra.console.trial144:Power off 2026-02-21T22:37:06.444 DEBUG:teuthology.orchestra.console.trial144:pexpect command: ipmitool -H trial144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T22:37:06.450 INFO:teuthology.orchestra.console.trial127:Power off 2026-02-21T22:37:06.450 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T22:37:06.470 DEBUG:teuthology.orchestra.console.trial009:power off output: Chassis Power Control: Down/Off 2026-02-21T22:37:06.482 DEBUG:teuthology.orchestra.console.trial144:power off output: Chassis Power Control: Down/Off 2026-02-21T22:37:06.487 DEBUG:teuthology.orchestra.console.trial127:power off output: Chassis Power Control: Down/Off 2026-02-21T22:37:10.475 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:37:10.482 DEBUG:teuthology.orchestra.console.trial144:pexpect command: ipmitool -H trial144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:37:10.488 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:37:10.583 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is off 2026-02-21T22:37:10.583 INFO:teuthology.orchestra.console.trial009:Power off completed 2026-02-21T22:37:10.589 DEBUG:teuthology.orchestra.console.trial144:check power output: Chassis Power is off 2026-02-21T22:37:10.589 INFO:teuthology.orchestra.console.trial144:Power off completed 2026-02-21T22:37:10.598 DEBUG:teuthology.orchestra.console.trial127:check power output: Chassis Power is off 2026-02-21T22:37:10.598 INFO:teuthology.orchestra.console.trial127:Power off completed 2026-02-21T22:37:10.683 INFO:teuthology.orchestra.console.trial009:Power on 2026-02-21T22:37:10.684 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-21T22:37:10.691 INFO:teuthology.orchestra.console.trial144:Power on 2026-02-21T22:37:10.691 DEBUG:teuthology.orchestra.console.trial144:pexpect command: ipmitool -H trial144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-21T22:37:10.699 INFO:teuthology.orchestra.console.trial127:Power on 2026-02-21T22:37:10.699 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-21T22:37:10.725 DEBUG:teuthology.orchestra.console.trial009:power on output: Chassis Power Control: Up/On 2026-02-21T22:37:10.729 DEBUG:teuthology.orchestra.console.trial144:power on output: Chassis Power Control: Up/On 2026-02-21T22:37:10.737 DEBUG:teuthology.orchestra.console.trial127:power on output: Chassis Power Control: Up/On 2026-02-21T22:37:14.730 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:37:14.738 DEBUG:teuthology.orchestra.console.trial144:pexpect command: ipmitool -H trial144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:37:14.746 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:37:14.841 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is on 2026-02-21T22:37:14.841 INFO:teuthology.orchestra.console.trial009:Power on completed 2026-02-21T22:37:14.848 DEBUG:teuthology.orchestra.console.trial144:check power output: Chassis Power is on 2026-02-21T22:37:14.848 INFO:teuthology.orchestra.console.trial144:Power on completed 2026-02-21T22:37:14.856 DEBUG:teuthology.orchestra.console.trial127:check power output: Chassis Power is on 2026-02-21T22:37:14.856 INFO:teuthology.orchestra.console.trial127:Power on completed 2026-02-21T22:37:14.942 INFO:teuthology.provision.fog.trial009:Waiting for deploy to finish 2026-02-21T22:37:14.949 INFO:teuthology.provision.fog.trial144:Waiting for deploy to finish 2026-02-21T22:37:14.957 INFO:teuthology.provision.fog.trial127:Waiting for deploy to finish 2026-02-21T22:39:18.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:18.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:18.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:21.792 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-21T22:39:21.920 WARNING:teuthology.provision.fog.trial144:[Errno None] Unable to connect to port 22 on 10.20.193.144 2026-02-21T22:39:21.921 WARNING:teuthology.provision.fog.trial127:[Errno None] Unable to connect to port 22 on 10.20.193.127 2026-02-21T22:39:27.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:27.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:27.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:30.880 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-21T22:39:31.008 WARNING:teuthology.provision.fog.trial144:[Errno None] Unable to connect to port 22 on 10.20.193.144 2026-02-21T22:39:31.008 WARNING:teuthology.provision.fog.trial127:[Errno None] Unable to connect to port 22 on 10.20.193.127 2026-02-21T22:39:36.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:37.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:37.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:39.968 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-21T22:39:40.096 WARNING:teuthology.provision.fog.trial144:[Errno None] Unable to connect to port 22 on 10.20.193.144 2026-02-21T22:39:40.096 WARNING:teuthology.provision.fog.trial127:[Errno None] Unable to connect to port 22 on 10.20.193.127 2026-02-21T22:39:45.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:46.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:46.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:49.057 WARNING:teuthology.provision.fog.trial009:[Errno None] Unable to connect to port 22 on 10.20.193.9 2026-02-21T22:39:49.184 WARNING:teuthology.provision.fog.trial144:[Errno None] Unable to connect to port 22 on 10.20.193.144 2026-02-21T22:39:49.184 WARNING:teuthology.provision.fog.trial127:[Errno None] Unable to connect to port 22 on 10.20.193.127 2026-02-21T22:39:55.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:55.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:39:55.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:40:31.263 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-21T22:40:31.264 DEBUG:teuthology.orchestra.run.trial144:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-21T22:40:31.265 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-21T22:40:31.265 DEBUG:teuthology.orchestra.run.trial009:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-21T22:40:31.654 INFO:teuthology.provision.fog.trial144:Node is ready 2026-02-21T22:40:31.655 DEBUG:teuthology.orchestra.run.trial144:> hostname 2026-02-21T22:40:31.660 INFO:teuthology.provision.fog.trial009:Node is ready 2026-02-21T22:40:31.661 DEBUG:teuthology.orchestra.run.trial009:> hostname 2026-02-21T22:40:31.700 INFO:teuthology.orchestra.run.trial144.stdout:trial144.front.sepia.ceph.com 2026-02-21T22:40:31.701 DEBUG:teuthology.orchestra.run.trial144:> grep trial144.front.sepia.ceph.com /etc/hosts 2026-02-21T22:40:31.707 INFO:teuthology.orchestra.run.trial009.stdout:trial009.front.sepia.ceph.com 2026-02-21T22:40:31.707 DEBUG:teuthology.orchestra.run.trial009:> grep trial009.front.sepia.ceph.com /etc/hosts 2026-02-21T22:40:31.747 INFO:teuthology.orchestra.run.trial144.stdout:10.20.193.144 trial144.front.sepia.ceph.com trial144 2026-02-21T22:40:31.747 DEBUG:teuthology.orchestra.run.trial144:> sudo hostname trial144 2026-02-21T22:40:31.751 INFO:teuthology.orchestra.run.trial009.stdout:10.20.193.9 trial009.front.sepia.ceph.com trial009 2026-02-21T22:40:31.751 DEBUG:teuthology.orchestra.run.trial009:> sudo hostname trial009 2026-02-21T22:40:31.798 DEBUG:teuthology.orchestra.run.trial144:> sudo sed -i -e 's/trial144.front.sepia.ceph.com/trial144/g' /etc/hosts 2026-02-21T22:40:31.806 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/trial009.front.sepia.ceph.com/trial009/g' /etc/hosts 2026-02-21T22:40:31.847 DEBUG:teuthology.orchestra.run.trial144:> sudo sed -i -e 's/10.20.193.144/10.20.193.144/g' /etc/hosts 2026-02-21T22:40:31.855 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/10.20.193.9/10.20.193.9/g' /etc/hosts 2026-02-21T22:40:31.900 DEBUG:teuthology.orchestra.run.trial144:> sudo sed -i -e 's/trial144.front.sepia.ceph.com/trial144/g' /etc/hostname 2026-02-21T22:40:31.903 DEBUG:teuthology.orchestra.run.trial009:> sudo sed -i -e 's/trial009.front.sepia.ceph.com/trial009/g' /etc/hostname 2026-02-21T22:40:31.951 DEBUG:teuthology.orchestra.run.trial144:> sudo hostname trial144 2026-02-21T22:40:31.955 DEBUG:teuthology.orchestra.run.trial009:> sudo hostname trial009 2026-02-21T22:40:31.999 DEBUG:teuthology.orchestra.run.trial144:> cat /etc/os-release 2026-02-21T22:40:32.003 DEBUG:teuthology.orchestra.run.trial009:> cat /etc/os-release 2026-02-21T22:40:32.043 INFO:teuthology.orchestra.run.trial144.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-21T22:40:32.043 INFO:teuthology.orchestra.run.trial144.stdout:NAME="Ubuntu" 2026-02-21T22:40:32.043 INFO:teuthology.orchestra.run.trial144.stdout:VERSION_ID="22.04" 2026-02-21T22:40:32.043 INFO:teuthology.orchestra.run.trial144.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-21T22:40:32.043 INFO:teuthology.orchestra.run.trial144.stdout:VERSION_CODENAME=jammy 2026-02-21T22:40:32.043 INFO:teuthology.orchestra.run.trial144.stdout:ID=ubuntu 2026-02-21T22:40:32.043 INFO:teuthology.orchestra.run.trial144.stdout:ID_LIKE=debian 2026-02-21T22:40:32.043 INFO:teuthology.orchestra.run.trial144.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-21T22:40:32.044 INFO:teuthology.orchestra.run.trial144.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-21T22:40:32.044 INFO:teuthology.orchestra.run.trial144.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-21T22:40:32.044 INFO:teuthology.orchestra.run.trial144.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-21T22:40:32.044 INFO:teuthology.orchestra.run.trial144.stdout:UBUNTU_CODENAME=jammy 2026-02-21T22:40:32.044 INFO:teuthology.provision.fog.trial144:Deploy complete! 2026-02-21T22:40:32.044 DEBUG:teuthology.parallel:result is None 2026-02-21T22:40:32.047 INFO:teuthology.orchestra.run.trial009.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-21T22:40:32.047 INFO:teuthology.orchestra.run.trial009.stdout:NAME="Ubuntu" 2026-02-21T22:40:32.047 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_ID="22.04" 2026-02-21T22:40:32.047 INFO:teuthology.orchestra.run.trial009.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-21T22:40:32.047 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_CODENAME=jammy 2026-02-21T22:40:32.048 INFO:teuthology.orchestra.run.trial009.stdout:ID=ubuntu 2026-02-21T22:40:32.048 INFO:teuthology.orchestra.run.trial009.stdout:ID_LIKE=debian 2026-02-21T22:40:32.048 INFO:teuthology.orchestra.run.trial009.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-21T22:40:32.048 INFO:teuthology.orchestra.run.trial009.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-21T22:40:32.048 INFO:teuthology.orchestra.run.trial009.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-21T22:40:32.048 INFO:teuthology.orchestra.run.trial009.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-21T22:40:32.048 INFO:teuthology.orchestra.run.trial009.stdout:UBUNTU_CODENAME=jammy 2026-02-21T22:40:32.048 INFO:teuthology.provision.fog.trial009:Deploy complete! 2026-02-21T22:40:32.048 DEBUG:teuthology.parallel:result is None 2026-02-21T22:40:55.212 WARNING:teuthology.provision.fog.trial127:timed out 2026-02-21T22:41:01.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:41:01.337 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-21T22:41:01.337 DEBUG:teuthology.orchestra.run.trial127:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-21T22:41:01.742 INFO:teuthology.provision.fog.trial127:Node is ready 2026-02-21T22:41:01.742 DEBUG:teuthology.orchestra.run.trial127:> hostname 2026-02-21T22:41:01.792 INFO:teuthology.orchestra.run.trial127.stdout:trial127.front.sepia.ceph.com 2026-02-21T22:41:01.792 DEBUG:teuthology.orchestra.run.trial127:> grep trial127.front.sepia.ceph.com /etc/hosts 2026-02-21T22:41:01.836 INFO:teuthology.orchestra.run.trial127.stdout:10.20.193.127 trial127.front.sepia.ceph.com trial127 2026-02-21T22:41:01.836 DEBUG:teuthology.orchestra.run.trial127:> sudo hostname trial127 2026-02-21T22:41:01.887 DEBUG:teuthology.orchestra.run.trial127:> sudo sed -i -e 's/trial127.front.sepia.ceph.com/trial127/g' /etc/hosts 2026-02-21T22:41:01.940 DEBUG:teuthology.orchestra.run.trial127:> sudo sed -i -e 's/10.20.193.127/10.20.193.127/g' /etc/hosts 2026-02-21T22:41:01.997 DEBUG:teuthology.orchestra.run.trial127:> sudo sed -i -e 's/trial127.front.sepia.ceph.com/trial127/g' /etc/hostname 2026-02-21T22:41:02.049 DEBUG:teuthology.orchestra.run.trial127:> sudo hostname trial127 2026-02-21T22:41:02.100 DEBUG:teuthology.orchestra.run.trial127:> cat /etc/os-release 2026-02-21T22:41:02.148 INFO:teuthology.orchestra.run.trial127.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:NAME="Ubuntu" 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_ID="22.04" 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_CODENAME=jammy 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:ID=ubuntu 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:ID_LIKE=debian 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-21T22:41:02.149 INFO:teuthology.orchestra.run.trial127.stdout:UBUNTU_CODENAME=jammy 2026-02-21T22:41:02.150 INFO:teuthology.provision.fog.trial127:Deploy complete! 2026-02-21T22:41:02.151 DEBUG:teuthology.parallel:result is None 2026-02-21T22:41:02.914 INFO:teuthology.lock.ops:Checking trial009.front.sepia.ceph.com 2026-02-21T22:41:02.915 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-21T22:41:03.027 INFO:teuthology.lock.ops:Checking trial127.front.sepia.ceph.com 2026-02-21T22:41:03.027 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-21T22:41:03.091 INFO:teuthology.lock.ops:Checking trial144.front.sepia.ceph.com 2026-02-21T22:41:03.091 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-21T22:41:03.150 INFO:teuthology.lock.ops:Updating [trial009.front.sepia.ceph.com]: set os type and version on server 2026-02-21T22:41:03.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-21T22:41:03.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial009.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:41:03.214 DEBUG:teuthology.orchestra.run.trial009:> true 2026-02-21T22:41:03.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial009.front.sepia.ceph.com' 2026-02-21T22:41:03.361 DEBUG:teuthology.orchestra.run.trial009:> uname -m 2026-02-21T22:41:03.406 INFO:teuthology.orchestra.run.trial009.stdout:x86_64 2026-02-21T22:41:03.407 DEBUG:teuthology.orchestra.run.trial009:> cat /etc/os-release 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:NAME="Ubuntu" 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_ID="22.04" 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:VERSION_CODENAME=jammy 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:ID=ubuntu 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:ID_LIKE=debian 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-21T22:41:03.451 INFO:teuthology.orchestra.run.trial009.stdout:UBUNTU_CODENAME=jammy 2026-02-21T22:41:03.451 INFO:teuthology.lock.ops:Updating trial009.front.sepia.ceph.com on lock server 2026-02-21T22:41:03.537 INFO:teuthology.lock.ops:Updating [trial127.front.sepia.ceph.com]: set os type and version on server 2026-02-21T22:41:03.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-21T22:41:03.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:41:03.603 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-21T22:41:03.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-21T22:41:03.681 DEBUG:teuthology.orchestra.run.trial127:> uname -m 2026-02-21T22:41:03.728 INFO:teuthology.orchestra.run.trial127.stdout:x86_64 2026-02-21T22:41:03.729 DEBUG:teuthology.orchestra.run.trial127:> cat /etc/os-release 2026-02-21T22:41:03.772 INFO:teuthology.orchestra.run.trial127.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:NAME="Ubuntu" 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_ID="22.04" 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_CODENAME=jammy 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:ID=ubuntu 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:ID_LIKE=debian 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-21T22:41:03.773 INFO:teuthology.orchestra.run.trial127.stdout:UBUNTU_CODENAME=jammy 2026-02-21T22:41:03.774 INFO:teuthology.lock.ops:Updating trial127.front.sepia.ceph.com on lock server 2026-02-21T22:41:03.871 INFO:teuthology.lock.ops:Updating [trial144.front.sepia.ceph.com]: set os type and version on server 2026-02-21T22:41:03.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial144.front.sepia.ceph.com' 2026-02-21T22:41:03.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:41:03.938 DEBUG:teuthology.orchestra.run.trial144:> true 2026-02-21T22:41:04.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial144.front.sepia.ceph.com' 2026-02-21T22:41:04.073 DEBUG:teuthology.orchestra.run.trial144:> uname -m 2026-02-21T22:41:04.119 INFO:teuthology.orchestra.run.trial144.stdout:x86_64 2026-02-21T22:41:04.119 DEBUG:teuthology.orchestra.run.trial144:> cat /etc/os-release 2026-02-21T22:41:04.163 INFO:teuthology.orchestra.run.trial144.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:NAME="Ubuntu" 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:VERSION_ID="22.04" 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:VERSION_CODENAME=jammy 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:ID=ubuntu 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:ID_LIKE=debian 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-21T22:41:04.164 INFO:teuthology.orchestra.run.trial144.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-21T22:41:04.165 INFO:teuthology.orchestra.run.trial144.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-21T22:41:04.165 INFO:teuthology.orchestra.run.trial144.stdout:UBUNTU_CODENAME=jammy 2026-02-21T22:41:04.165 INFO:teuthology.lock.ops:Updating trial144.front.sepia.ceph.com on lock server 2026-02-21T22:41:04.270 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:41:04.365 INFO:teuthology.dispatcher.supervisor:Running job 63197 2026-02-21T22:41:04.365 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63197 --name nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial --description rados/multimon/{ceph clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/{bluestore/{alloc$/{bitmap} base mem$/{low} onode-segment$/{512K} write$/{random/{compr$/{yes$/{zlib}} random}}}} rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63197/orig.config.yaml 2026-02-21T22:41:04.365 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63197 2026-02-21T22:41:04.365 INFO:teuthology.dispatcher.supervisor:Job PID: 1323978 2026-02-21T22:41:04.365 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-21T22:43:04.442 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:45:04.608 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:47:04.824 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:49:05.004 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:51:05.156 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:53:05.335 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:55:05.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:57:05.676 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:59:05.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:59:05.968 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-21T22:59:06.136 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-21T22:59:06.890 INFO:teuthology.orchestra.console.trial144:Power off 2026-02-21T22:59:06.890 DEBUG:teuthology.orchestra.console.trial144:pexpect command: ipmitool -H trial144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T22:59:06.899 INFO:teuthology.orchestra.console.trial127:Power off 2026-02-21T22:59:06.899 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T22:59:06.919 INFO:teuthology.orchestra.console.trial009:Power off 2026-02-21T22:59:06.920 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T22:59:06.930 DEBUG:teuthology.orchestra.console.trial144:power off output: Chassis Power Control: Down/Off 2026-02-21T22:59:06.936 DEBUG:teuthology.orchestra.console.trial127:power off output: Chassis Power Control: Down/Off 2026-02-21T22:59:06.957 DEBUG:teuthology.orchestra.console.trial009:power off output: Chassis Power Control: Down/Off 2026-02-21T22:59:10.934 DEBUG:teuthology.orchestra.console.trial144:pexpect command: ipmitool -H trial144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:59:10.942 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:59:10.958 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:59:11.044 DEBUG:teuthology.orchestra.console.trial144:check power output: Chassis Power is on 2026-02-21T22:59:11.050 DEBUG:teuthology.orchestra.console.trial127:check power output: Chassis Power is on 2026-02-21T22:59:11.066 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is on 2026-02-21T22:59:15.048 DEBUG:teuthology.orchestra.console.trial144:pexpect command: ipmitool -H trial144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:59:15.057 DEBUG:teuthology.orchestra.console.trial127:pexpect command: ipmitool -H trial127.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:59:15.067 DEBUG:teuthology.orchestra.console.trial009:pexpect command: ipmitool -H trial009.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:59:15.159 DEBUG:teuthology.orchestra.console.trial144:check power output: Chassis Power is off 2026-02-21T22:59:15.160 INFO:teuthology.orchestra.console.trial144:Power off completed 2026-02-21T22:59:15.167 DEBUG:teuthology.orchestra.console.trial127:check power output: Chassis Power is off 2026-02-21T22:59:15.168 INFO:teuthology.orchestra.console.trial127:Power off completed 2026-02-21T22:59:15.176 DEBUG:teuthology.orchestra.console.trial009:check power output: Chassis Power is off 2026-02-21T22:59:15.177 INFO:teuthology.orchestra.console.trial009:Power off completed 2026-02-21T22:59:15.453 INFO:teuthology.lock.ops:unlocked: trial144.front.sepia.ceph.com 2026-02-21T22:59:15.460 INFO:teuthology.lock.ops:unlocked: trial127.front.sepia.ceph.com 2026-02-21T22:59:15.467 INFO:teuthology.lock.ops:unlocked: trial009.front.sepia.ceph.com