2026-02-24T13:17:15.574 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-24T13:17:15.574 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:17:15.648 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:17:15.896 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7b6c0a04b200>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7b6c09881300>, signals=[15])
2026-02-24T13:17:15.896 INFO:teuthology.lock.ops:Start node 'trial082.front.sepia.ceph.com' reimaging
2026-02-24T13:17:15.896 INFO:teuthology.lock.ops:Updating [trial082.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:17:15.896 INFO:teuthology.lock.ops:Updating trial082.front.sepia.ceph.com on lock server
2026-02-24T13:17:15.952 INFO:teuthology.lock.ops:Start node 'trial121.front.sepia.ceph.com' reimaging
2026-02-24T13:17:15.952 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:17:15.952 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-24T13:17:16.010 INFO:teuthology.lock.ops:Start node 'trial148.front.sepia.ceph.com' reimaging
2026-02-24T13:17:16.010 INFO:teuthology.lock.ops:Updating [trial148.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:17:16.010 INFO:teuthology.lock.ops:Updating trial148.front.sepia.ceph.com on lock server
2026-02-24T13:17:16.217 DEBUG:teuthology.provision.fog.trial121:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-24T13:17:16.217 DEBUG:teuthology.provision.fog.trial082:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-24T13:17:16.265 INFO:teuthology.provision.fog.trial121:Scheduling deploy of ubuntu 22.04
2026-02-24T13:17:16.271 INFO:teuthology.provision.fog.trial082:Scheduling deploy of ubuntu 22.04
2026-02-24T13:17:16.277 DEBUG:teuthology.provision.fog.trial148:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-24T13:17:16.329 INFO:teuthology.provision.fog.trial148:Scheduling deploy of ubuntu 22.04
2026-02-24T13:17:18.050 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-24T13:17:18.050 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:17:18.108 INFO:teuthology.orchestra.console.trial082:Power off
2026-02-24T13:17:18.108 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:17:18.117 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-24T13:17:18.130 INFO:teuthology.orchestra.console.trial148:Power off
2026-02-24T13:17:18.131 DEBUG:teuthology.orchestra.console.trial148:pexpect command: ipmitool -H trial148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:17:18.197 DEBUG:teuthology.orchestra.console.trial082:power off output: Chassis Power Control: Down/Off
2026-02-24T13:17:18.198 DEBUG:teuthology.orchestra.console.trial148:power off output: Chassis Power Control: Down/Off
2026-02-24T13:17:22.121 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:17:22.198 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:17:22.205 DEBUG:teuthology.orchestra.console.trial148:pexpect command: ipmitool -H trial148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:17:22.230 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-24T13:17:22.230 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-24T13:17:22.307 DEBUG:teuthology.orchestra.console.trial082:check power output: Chassis Power is off
2026-02-24T13:17:22.307 INFO:teuthology.orchestra.console.trial082:Power off completed
2026-02-24T13:17:22.316 DEBUG:teuthology.orchestra.console.trial148:check power output: Chassis Power is off
2026-02-24T13:17:22.316 INFO:teuthology.orchestra.console.trial148:Power off completed
2026-02-24T13:17:22.331 INFO:teuthology.orchestra.console.trial121:Power on
2026-02-24T13:17:22.331 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:17:22.371 DEBUG:teuthology.orchestra.console.trial121:power on output: Chassis Power Control: Up/On
2026-02-24T13:17:22.408 INFO:teuthology.orchestra.console.trial082:Power on
2026-02-24T13:17:22.409 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:17:22.417 INFO:teuthology.orchestra.console.trial148:Power on
2026-02-24T13:17:22.417 DEBUG:teuthology.orchestra.console.trial148:pexpect command: ipmitool -H trial148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:17:22.451 DEBUG:teuthology.orchestra.console.trial082:power on output: Chassis Power Control: Up/On
2026-02-24T13:17:22.456 DEBUG:teuthology.orchestra.console.trial148:power on output: Chassis Power Control: Up/On
2026-02-24T13:17:26.377 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:17:26.452 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:17:26.461 DEBUG:teuthology.orchestra.console.trial148:pexpect command: ipmitool -H trial148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:17:26.488 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-24T13:17:26.489 INFO:teuthology.orchestra.console.trial121:Power on completed
2026-02-24T13:17:26.563 DEBUG:teuthology.orchestra.console.trial082:check power output: Chassis Power is on
2026-02-24T13:17:26.563 INFO:teuthology.orchestra.console.trial082:Power on completed
2026-02-24T13:17:26.571 DEBUG:teuthology.orchestra.console.trial148:check power output: Chassis Power is on
2026-02-24T13:17:26.572 INFO:teuthology.orchestra.console.trial148:Power on completed
2026-02-24T13:17:26.590 INFO:teuthology.provision.fog.trial121:Waiting for deploy to finish
2026-02-24T13:17:26.664 INFO:teuthology.provision.fog.trial082:Waiting for deploy to finish
2026-02-24T13:17:26.672 INFO:teuthology.provision.fog.trial148:Waiting for deploy to finish
2026-02-24T13:19:15.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:15.287 ERROR:teuthology.orchestra.connection:Error authenticating with trial148.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-24T13:19:30.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:30.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:33.440 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-24T13:19:33.504 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-24T13:19:39.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:39.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:42.528 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-24T13:19:42.591 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-24T13:19:48.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:48.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:51.615 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-24T13:19:51.680 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-24T13:19:57.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:19:57.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:00.704 WARNING:teuthology.provision.fog.trial082:[Errno None] Unable to connect to port 22 on 10.20.193.82
2026-02-24T13:20:00.768 WARNING:teuthology.provision.fog.trial121:[Errno None] Unable to connect to port 22 on 10.20.193.121
2026-02-24T13:20:06.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:06.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:19.289 WARNING:teuthology.provision.fog.trial148:timed out
2026-02-24T13:20:25.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:36.586 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:20:36.587 DEBUG:teuthology.orchestra.run.trial148:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:20:37.005 INFO:teuthology.provision.fog.trial148:Node is ready
2026-02-24T13:20:37.005 DEBUG:teuthology.orchestra.run.trial148:> hostname
2026-02-24T13:20:37.054 INFO:teuthology.orchestra.run.trial148.stdout:trial148.front.sepia.ceph.com
2026-02-24T13:20:37.054 DEBUG:teuthology.orchestra.run.trial148:> grep trial148.front.sepia.ceph.com /etc/hosts
2026-02-24T13:20:37.106 INFO:teuthology.orchestra.run.trial148.stdout:10.20.193.148 trial148.front.sepia.ceph.com trial148
2026-02-24T13:20:37.106 DEBUG:teuthology.orchestra.run.trial148:> sudo hostname trial148
2026-02-24T13:20:37.161 DEBUG:teuthology.orchestra.run.trial148:> sudo sed -i -e 's/trial148.front.sepia.ceph.com/trial148/g' /etc/hosts
2026-02-24T13:20:37.210 DEBUG:teuthology.orchestra.run.trial148:> sudo sed -i -e 's/10.20.193.148/10.20.193.148/g' /etc/hosts
2026-02-24T13:20:37.258 DEBUG:teuthology.orchestra.run.trial148:> sudo sed -i -e 's/trial148.front.sepia.ceph.com/trial148/g' /etc/hostname
2026-02-24T13:20:37.310 DEBUG:teuthology.orchestra.run.trial148:> sudo hostname trial148
2026-02-24T13:20:37.365 DEBUG:teuthology.orchestra.run.trial148:> cat /etc/os-release
2026-02-24T13:20:37.409 INFO:teuthology.orchestra.run.trial148.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:NAME="Ubuntu"
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:VERSION_ID="22.04"
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:VERSION_CODENAME=jammy
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:ID=ubuntu
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:ID_LIKE=debian
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:20:37.410 INFO:teuthology.orchestra.run.trial148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:20:37.411 INFO:teuthology.orchestra.run.trial148.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:20:37.411 INFO:teuthology.provision.fog.trial148:Deploy complete!
2026-02-24T13:20:37.413 DEBUG:teuthology.parallel:result is None
2026-02-24T13:20:42.483 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:20:42.483 DEBUG:teuthology.orchestra.run.trial082:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:20:42.871 INFO:teuthology.provision.fog.trial082:Node is ready
2026-02-24T13:20:42.871 DEBUG:teuthology.orchestra.run.trial082:> hostname
2026-02-24T13:20:42.951 INFO:teuthology.orchestra.run.trial082.stdout:trial082.front.sepia.ceph.com
2026-02-24T13:20:42.951 DEBUG:teuthology.orchestra.run.trial082:> grep trial082.front.sepia.ceph.com /etc/hosts
2026-02-24T13:20:42.962 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:20:42.962 DEBUG:teuthology.orchestra.run.trial121:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:20:42.999 INFO:teuthology.orchestra.run.trial082.stdout:10.20.193.82 trial082.front.sepia.ceph.com trial082
2026-02-24T13:20:42.999 DEBUG:teuthology.orchestra.run.trial082:> sudo hostname trial082
2026-02-24T13:20:43.053 DEBUG:teuthology.orchestra.run.trial082:> sudo sed -i -e 's/trial082.front.sepia.ceph.com/trial082/g' /etc/hosts
2026-02-24T13:20:43.102 DEBUG:teuthology.orchestra.run.trial082:> sudo sed -i -e 's/10.20.193.82/10.20.193.82/g' /etc/hosts
2026-02-24T13:20:43.150 DEBUG:teuthology.orchestra.run.trial082:> sudo sed -i -e 's/trial082.front.sepia.ceph.com/trial082/g' /etc/hostname
2026-02-24T13:20:43.204 DEBUG:teuthology.orchestra.run.trial082:> sudo hostname trial082
2026-02-24T13:20:43.254 DEBUG:teuthology.orchestra.run.trial082:> cat /etc/os-release
2026-02-24T13:20:43.299 INFO:teuthology.orchestra.run.trial082.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:20:43.299 INFO:teuthology.orchestra.run.trial082.stdout:NAME="Ubuntu"
2026-02-24T13:20:43.299 INFO:teuthology.orchestra.run.trial082.stdout:VERSION_ID="22.04"
2026-02-24T13:20:43.299 INFO:teuthology.orchestra.run.trial082.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:20:43.300 INFO:teuthology.orchestra.run.trial082.stdout:VERSION_CODENAME=jammy
2026-02-24T13:20:43.300 INFO:teuthology.orchestra.run.trial082.stdout:ID=ubuntu
2026-02-24T13:20:43.300 INFO:teuthology.orchestra.run.trial082.stdout:ID_LIKE=debian
2026-02-24T13:20:43.300 INFO:teuthology.orchestra.run.trial082.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:20:43.300 INFO:teuthology.orchestra.run.trial082.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:20:43.300 INFO:teuthology.orchestra.run.trial082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:20:43.300 INFO:teuthology.orchestra.run.trial082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:20:43.300 INFO:teuthology.orchestra.run.trial082.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:20:43.301 INFO:teuthology.provision.fog.trial082:Deploy complete!
2026-02-24T13:20:43.301 DEBUG:teuthology.parallel:result is None
2026-02-24T13:20:43.356 INFO:teuthology.provision.fog.trial121:Node is ready
2026-02-24T13:20:43.357 DEBUG:teuthology.orchestra.run.trial121:> hostname
2026-02-24T13:20:43.404 INFO:teuthology.orchestra.run.trial121.stdout:trial121.front.sepia.ceph.com
2026-02-24T13:20:43.404 DEBUG:teuthology.orchestra.run.trial121:> grep trial121.front.sepia.ceph.com /etc/hosts
2026-02-24T13:20:43.448 INFO:teuthology.orchestra.run.trial121.stdout:10.20.193.121 trial121.front.sepia.ceph.com trial121
2026-02-24T13:20:43.449 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-24T13:20:43.500 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hosts
2026-02-24T13:20:43.548 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/10.20.193.121/10.20.193.121/g' /etc/hosts
2026-02-24T13:20:43.601 DEBUG:teuthology.orchestra.run.trial121:> sudo sed -i -e 's/trial121.front.sepia.ceph.com/trial121/g' /etc/hostname
2026-02-24T13:20:43.653 DEBUG:teuthology.orchestra.run.trial121:> sudo hostname trial121
2026-02-24T13:20:43.709 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-24T13:20:43.756 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:NAME="Ubuntu"
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="22.04"
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_CODENAME=jammy
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:ID=ubuntu
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE=debian
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:20:43.757 INFO:teuthology.orchestra.run.trial121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:20:43.758 INFO:teuthology.orchestra.run.trial121.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:20:43.758 INFO:teuthology.provision.fog.trial121:Deploy complete!
2026-02-24T13:20:43.759 DEBUG:teuthology.parallel:result is None
2026-02-24T13:20:44.512 INFO:teuthology.lock.ops:Checking trial082.front.sepia.ceph.com
2026-02-24T13:20:44.512 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:20:44.590 INFO:teuthology.lock.ops:Checking trial121.front.sepia.ceph.com
2026-02-24T13:20:44.590 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:20:46.927 INFO:teuthology.lock.ops:Checking trial148.front.sepia.ceph.com
2026-02-24T13:20:46.927 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:20:47.034 INFO:teuthology.lock.ops:Updating [trial082.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:20:47.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com'
2026-02-24T13:20:47.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:47.102 DEBUG:teuthology.orchestra.run.trial082:> true
2026-02-24T13:20:47.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com'
2026-02-24T13:20:47.180 DEBUG:teuthology.orchestra.run.trial082:> uname -m
2026-02-24T13:20:47.226 INFO:teuthology.orchestra.run.trial082.stdout:x86_64
2026-02-24T13:20:47.227 DEBUG:teuthology.orchestra.run.trial082:> cat /etc/os-release
2026-02-24T13:20:47.270 INFO:teuthology.orchestra.run.trial082.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:20:47.270 INFO:teuthology.orchestra.run.trial082.stdout:NAME="Ubuntu"
2026-02-24T13:20:47.270 INFO:teuthology.orchestra.run.trial082.stdout:VERSION_ID="22.04"
2026-02-24T13:20:47.270 INFO:teuthology.orchestra.run.trial082.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:20:47.270 INFO:teuthology.orchestra.run.trial082.stdout:VERSION_CODENAME=jammy
2026-02-24T13:20:47.270 INFO:teuthology.orchestra.run.trial082.stdout:ID=ubuntu
2026-02-24T13:20:47.270 INFO:teuthology.orchestra.run.trial082.stdout:ID_LIKE=debian
2026-02-24T13:20:47.270 INFO:teuthology.orchestra.run.trial082.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:20:47.271 INFO:teuthology.orchestra.run.trial082.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:20:47.271 INFO:teuthology.orchestra.run.trial082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:20:47.271 INFO:teuthology.orchestra.run.trial082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:20:47.271 INFO:teuthology.orchestra.run.trial082.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:20:47.271 INFO:teuthology.lock.ops:Updating trial082.front.sepia.ceph.com on lock server
2026-02-24T13:20:47.397 INFO:teuthology.lock.ops:Updating [trial121.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:20:47.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial121.front.sepia.ceph.com'
2026-02-24T13:20:47.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:47.465 DEBUG:teuthology.orchestra.run.trial121:> true
2026-02-24T13:20:47.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial121.front.sepia.ceph.com'
2026-02-24T13:20:47.543 DEBUG:teuthology.orchestra.run.trial121:> uname -m
2026-02-24T13:20:47.588 INFO:teuthology.orchestra.run.trial121.stdout:x86_64
2026-02-24T13:20:47.588 DEBUG:teuthology.orchestra.run.trial121:> cat /etc/os-release
2026-02-24T13:20:47.633 INFO:teuthology.orchestra.run.trial121.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:20:47.633 INFO:teuthology.orchestra.run.trial121.stdout:NAME="Ubuntu"
2026-02-24T13:20:47.633 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_ID="22.04"
2026-02-24T13:20:47.633 INFO:teuthology.orchestra.run.trial121.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:20:47.633 INFO:teuthology.orchestra.run.trial121.stdout:VERSION_CODENAME=jammy
2026-02-24T13:20:47.633 INFO:teuthology.orchestra.run.trial121.stdout:ID=ubuntu
2026-02-24T13:20:47.634 INFO:teuthology.orchestra.run.trial121.stdout:ID_LIKE=debian
2026-02-24T13:20:47.634 INFO:teuthology.orchestra.run.trial121.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:20:47.634 INFO:teuthology.orchestra.run.trial121.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:20:47.634 INFO:teuthology.orchestra.run.trial121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:20:47.634 INFO:teuthology.orchestra.run.trial121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:20:47.634 INFO:teuthology.orchestra.run.trial121.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:20:47.634 INFO:teuthology.lock.ops:Updating trial121.front.sepia.ceph.com on lock server
2026-02-24T13:20:47.732 INFO:teuthology.lock.ops:Updating [trial148.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:20:47.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial148.front.sepia.ceph.com'
2026-02-24T13:20:47.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:20:47.800 DEBUG:teuthology.orchestra.run.trial148:> true
2026-02-24T13:20:47.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial148.front.sepia.ceph.com'
2026-02-24T13:20:47.878 DEBUG:teuthology.orchestra.run.trial148:> uname -m
2026-02-24T13:20:47.925 INFO:teuthology.orchestra.run.trial148.stdout:x86_64
2026-02-24T13:20:47.925 DEBUG:teuthology.orchestra.run.trial148:> cat /etc/os-release
2026-02-24T13:20:47.969 INFO:teuthology.orchestra.run.trial148.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:NAME="Ubuntu"
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:VERSION_ID="22.04"
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:VERSION_CODENAME=jammy
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:ID=ubuntu
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:ID_LIKE=debian
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:20:47.970 INFO:teuthology.orchestra.run.trial148.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:20:47.971 INFO:teuthology.lock.ops:Updating trial148.front.sepia.ceph.com on lock server
2026-02-24T13:20:48.077 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:20:48.201 INFO:teuthology.dispatcher.supervisor:Running job 67811
2026-02-24T13:20:48.201 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_cjames@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67811 --name cjames-2026-02-24_10:01:51-rados-main-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds} ec_direct_reads/ec_direct_reads_on ec_optimizations/ec_optimizations_on mon_election/connectivity msgr-failures/fastclose objectstore/{bluestore/{alloc$/{hybrid} base mem$/{normal-2} onode-segment$/{512K} write$/{random/{compr$/{yes$/{zlib}} random}}}} rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67811/orig.config.yaml
2026-02-24T13:20:48.202 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67811
2026-02-24T13:20:48.202 INFO:teuthology.dispatcher.supervisor:Job PID: 563263
2026-02-24T13:20:48.202 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-24T13:22:48.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:24:48.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:26:48.444 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:28:48.543 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:30:48.656 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:32:48.759 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:34:48.882 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:36:48.969 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:38:49.110 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:40:49.235 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:42:49.356 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:44:49.480 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:44:49.602 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-24T13:44:49.783 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-24T13:44:50.594 INFO:teuthology.orchestra.console.trial121:Power off
2026-02-24T13:44:50.594 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:44:50.604 INFO:teuthology.orchestra.console.trial082:Power off
2026-02-24T13:44:50.604 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:44:50.623 INFO:teuthology.orchestra.console.trial148:Power off
2026-02-24T13:44:50.623 DEBUG:teuthology.orchestra.console.trial148:pexpect command: ipmitool -H trial148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:44:50.635 DEBUG:teuthology.orchestra.console.trial121:power off output: Chassis Power Control: Down/Off
2026-02-24T13:44:50.645 DEBUG:teuthology.orchestra.console.trial082:power off output: Chassis Power Control: Down/Off
2026-02-24T13:44:50.662 DEBUG:teuthology.orchestra.console.trial148:power off output: Chassis Power Control: Down/Off
2026-02-24T13:44:54.635 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:54.645 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:54.663 DEBUG:teuthology.orchestra.console.trial148:pexpect command: ipmitool -H trial148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:54.744 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is on
2026-02-24T13:44:54.753 DEBUG:teuthology.orchestra.console.trial082:check power output: Chassis Power is on
2026-02-24T13:44:54.773 DEBUG:teuthology.orchestra.console.trial148:check power output: Chassis Power is on
2026-02-24T13:44:58.745 DEBUG:teuthology.orchestra.console.trial121:pexpect command: ipmitool -H trial121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:58.754 DEBUG:teuthology.orchestra.console.trial082:pexpect command: ipmitool -H trial082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:58.774 DEBUG:teuthology.orchestra.console.trial148:pexpect command: ipmitool -H trial148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:44:58.854 DEBUG:teuthology.orchestra.console.trial121:check power output: Chassis Power is off
2026-02-24T13:44:58.854 INFO:teuthology.orchestra.console.trial121:Power off completed
2026-02-24T13:44:58.864 DEBUG:teuthology.orchestra.console.trial082:check power output: Chassis Power is off
2026-02-24T13:44:58.864 INFO:teuthology.orchestra.console.trial082:Power off completed
2026-02-24T13:44:58.884 DEBUG:teuthology.orchestra.console.trial148:check power output: Chassis Power is off
2026-02-24T13:44:58.884 INFO:teuthology.orchestra.console.trial148:Power off completed
2026-02-24T13:44:59.144 INFO:teuthology.lock.ops:unlocked: trial121.front.sepia.ceph.com
2026-02-24T13:44:59.154 INFO:teuthology.lock.ops:unlocked: trial082.front.sepia.ceph.com
2026-02-24T13:44:59.158 INFO:teuthology.lock.ops:unlocked: trial148.front.sepia.ceph.com