2026-02-24T13:21:00.179 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-24T13:21:00.179 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:21:00.251 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:21:00.500 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x72dd90171d00>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x72dd8f99bba0>, signals=[15])
2026-02-24T13:21:00.501 INFO:teuthology.lock.ops:Start node 'trial019.front.sepia.ceph.com' reimaging
2026-02-24T13:21:00.501 INFO:teuthology.lock.ops:Updating [trial019.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:21:00.501 INFO:teuthology.lock.ops:Updating trial019.front.sepia.ceph.com on lock server
2026-02-24T13:21:00.558 INFO:teuthology.lock.ops:Start node 'trial182.front.sepia.ceph.com' reimaging
2026-02-24T13:21:00.558 INFO:teuthology.lock.ops:Updating [trial182.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:21:00.558 INFO:teuthology.lock.ops:Updating trial182.front.sepia.ceph.com on lock server
2026-02-24T13:21:00.616 INFO:teuthology.lock.ops:Start node 'trial195.front.sepia.ceph.com' reimaging
2026-02-24T13:21:00.616 INFO:teuthology.lock.ops:Updating [trial195.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T13:21:00.616 INFO:teuthology.lock.ops:Updating trial195.front.sepia.ceph.com on lock server
2026-02-24T13:21:00.857 DEBUG:teuthology.provision.fog.trial019:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-24T13:21:00.857 DEBUG:teuthology.provision.fog.trial182:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-24T13:21:00.900 INFO:teuthology.provision.fog.trial019:Scheduling deploy of ubuntu 22.04
2026-02-24T13:21:00.908 INFO:teuthology.provision.fog.trial182:Scheduling deploy of ubuntu 22.04
2026-02-24T13:21:01.335 DEBUG:teuthology.provision.fog.trial195:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-24T13:21:01.388 INFO:teuthology.provision.fog.trial195:Scheduling deploy of ubuntu 22.04
2026-02-24T13:21:02.468 INFO:teuthology.orchestra.console.trial019:Power off
2026-02-24T13:21:02.468 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:21:02.488 INFO:teuthology.orchestra.console.trial182:Power off
2026-02-24T13:21:02.488 DEBUG:teuthology.orchestra.console.trial182:pexpect command: ipmitool -H trial182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:21:02.508 DEBUG:teuthology.orchestra.console.trial019:power off output: Chassis Power Control: Down/Off
2026-02-24T13:21:02.525 DEBUG:teuthology.orchestra.console.trial182:power off output: Chassis Power Control: Down/Off
2026-02-24T13:21:02.682 INFO:teuthology.orchestra.console.trial195:Power off
2026-02-24T13:21:02.682 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:21:02.720 DEBUG:teuthology.orchestra.console.trial195:power off output: Chassis Power Control: Down/Off
2026-02-24T13:21:06.512 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:21:06.526 DEBUG:teuthology.orchestra.console.trial182:pexpect command: ipmitool -H trial182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:21:06.622 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is off
2026-02-24T13:21:06.623 INFO:teuthology.orchestra.console.trial019:Power off completed
2026-02-24T13:21:06.635 DEBUG:teuthology.orchestra.console.trial182:check power output: Chassis Power is off
2026-02-24T13:21:06.635 INFO:teuthology.orchestra.console.trial182:Power off completed
2026-02-24T13:21:06.721 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:21:06.729 INFO:teuthology.orchestra.console.trial019:Power on
2026-02-24T13:21:06.730 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:21:06.738 INFO:teuthology.orchestra.console.trial182:Power on
2026-02-24T13:21:06.739 DEBUG:teuthology.orchestra.console.trial182:pexpect command: ipmitool -H trial182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:21:06.769 DEBUG:teuthology.orchestra.console.trial019:power on output: Chassis Power Control: Up/On
2026-02-24T13:21:06.779 DEBUG:teuthology.orchestra.console.trial182:power on output: Chassis Power Control: Up/On
2026-02-24T13:21:06.831 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is off
2026-02-24T13:21:06.832 INFO:teuthology.orchestra.console.trial195:Power off completed
2026-02-24T13:21:06.932 INFO:teuthology.orchestra.console.trial195:Power on
2026-02-24T13:21:06.932 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T13:21:06.971 DEBUG:teuthology.orchestra.console.trial195:power on output: Chassis Power Control: Up/On
2026-02-24T13:21:10.774 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:21:10.783 DEBUG:teuthology.orchestra.console.trial182:pexpect command: ipmitool -H trial182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:21:10.886 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is on
2026-02-24T13:21:10.886 INFO:teuthology.orchestra.console.trial019:Power on completed
2026-02-24T13:21:10.892 DEBUG:teuthology.orchestra.console.trial182:check power output: Chassis Power is on
2026-02-24T13:21:10.893 INFO:teuthology.orchestra.console.trial182:Power on completed
2026-02-24T13:21:10.972 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:21:10.988 INFO:teuthology.provision.fog.trial019:Waiting for deploy to finish
2026-02-24T13:21:10.993 INFO:teuthology.provision.fog.trial182:Waiting for deploy to finish
2026-02-24T13:21:11.082 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is on
2026-02-24T13:21:11.082 INFO:teuthology.orchestra.console.trial195:Power on completed
2026-02-24T13:21:11.183 INFO:teuthology.provision.fog.trial195:Waiting for deploy to finish
2026-02-24T13:23:15.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:15.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:15.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:18.209 WARNING:teuthology.provision.fog.trial019:[Errno None] Unable to connect to port 22 on 10.20.193.19
2026-02-24T13:23:18.336 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195
2026-02-24T13:23:18.400 WARNING:teuthology.provision.fog.trial182:[Errno None] Unable to connect to port 22 on 10.20.193.182
2026-02-24T13:23:24.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:24.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:24.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:27.296 WARNING:teuthology.provision.fog.trial019:[Errno None] Unable to connect to port 22 on 10.20.193.19
2026-02-24T13:23:27.424 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195
2026-02-24T13:23:27.488 WARNING:teuthology.provision.fog.trial182:[Errno None] Unable to connect to port 22 on 10.20.193.182
2026-02-24T13:23:33.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:33.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:33.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:36.384 WARNING:teuthology.provision.fog.trial019:[Errno None] Unable to connect to port 22 on 10.20.193.19
2026-02-24T13:23:36.512 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195
2026-02-24T13:23:36.576 WARNING:teuthology.provision.fog.trial182:[Errno None] Unable to connect to port 22 on 10.20.193.182
2026-02-24T13:23:42.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:42.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:42.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:45.471 WARNING:teuthology.provision.fog.trial019:[Errno None] Unable to connect to port 22 on 10.20.193.19
2026-02-24T13:23:45.600 WARNING:teuthology.provision.fog.trial195:[Errno None] Unable to connect to port 22 on 10.20.193.195
2026-02-24T13:23:45.664 WARNING:teuthology.provision.fog.trial182:[Errno None] Unable to connect to port 22 on 10.20.193.182
2026-02-24T13:23:51.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:51.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:23:51.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:24:27.243 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:24:27.244 DEBUG:teuthology.orchestra.run.trial019:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:24:27.630 INFO:teuthology.provision.fog.trial019:Node is ready
2026-02-24T13:24:27.631 DEBUG:teuthology.orchestra.run.trial019:> hostname
2026-02-24T13:24:27.790 INFO:teuthology.orchestra.run.trial019.stdout:trial019.front.sepia.ceph.com
2026-02-24T13:24:27.790 DEBUG:teuthology.orchestra.run.trial019:> grep trial019.front.sepia.ceph.com /etc/hosts
2026-02-24T13:24:27.799 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:24:27.799 DEBUG:teuthology.orchestra.run.trial195:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:24:27.806 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T13:24:27.806 DEBUG:teuthology.orchestra.run.trial182:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T13:24:27.835 INFO:teuthology.orchestra.run.trial019.stdout:10.20.193.19 trial019.front.sepia.ceph.com trial019
2026-02-24T13:24:27.835 DEBUG:teuthology.orchestra.run.trial019:> sudo hostname trial019
2026-02-24T13:24:27.891 DEBUG:teuthology.orchestra.run.trial019:> sudo sed -i -e 's/trial019.front.sepia.ceph.com/trial019/g' /etc/hosts
2026-02-24T13:24:27.945 DEBUG:teuthology.orchestra.run.trial019:> sudo sed -i -e 's/10.20.193.19/10.20.193.19/g' /etc/hosts
2026-02-24T13:24:27.997 DEBUG:teuthology.orchestra.run.trial019:> sudo sed -i -e 's/trial019.front.sepia.ceph.com/trial019/g' /etc/hostname
2026-02-24T13:24:28.048 DEBUG:teuthology.orchestra.run.trial019:> sudo hostname trial019
2026-02-24T13:24:28.095 DEBUG:teuthology.orchestra.run.trial019:> cat /etc/os-release
2026-02-24T13:24:28.139 INFO:teuthology.orchestra.run.trial019.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:24:28.139 INFO:teuthology.orchestra.run.trial019.stdout:NAME="Ubuntu"
2026-02-24T13:24:28.139 INFO:teuthology.orchestra.run.trial019.stdout:VERSION_ID="22.04"
2026-02-24T13:24:28.139 INFO:teuthology.orchestra.run.trial019.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:24:28.139 INFO:teuthology.orchestra.run.trial019.stdout:VERSION_CODENAME=jammy
2026-02-24T13:24:28.139 INFO:teuthology.orchestra.run.trial019.stdout:ID=ubuntu
2026-02-24T13:24:28.140 INFO:teuthology.orchestra.run.trial019.stdout:ID_LIKE=debian
2026-02-24T13:24:28.140 INFO:teuthology.orchestra.run.trial019.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:24:28.140 INFO:teuthology.orchestra.run.trial019.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:24:28.140 INFO:teuthology.orchestra.run.trial019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:24:28.140 INFO:teuthology.orchestra.run.trial019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:24:28.140 INFO:teuthology.orchestra.run.trial019.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:24:28.140 INFO:teuthology.provision.fog.trial019:Deploy complete!
2026-02-24T13:24:28.141 DEBUG:teuthology.parallel:result is None
2026-02-24T13:24:28.196 INFO:teuthology.provision.fog.trial182:Node is ready
2026-02-24T13:24:28.196 DEBUG:teuthology.orchestra.run.trial182:> hostname
2026-02-24T13:24:28.198 INFO:teuthology.provision.fog.trial195:Node is ready
2026-02-24T13:24:28.198 DEBUG:teuthology.orchestra.run.trial195:> hostname
2026-02-24T13:24:28.243 INFO:teuthology.orchestra.run.trial195.stdout:trial195.front.sepia.ceph.com
2026-02-24T13:24:28.244 DEBUG:teuthology.orchestra.run.trial195:> grep trial195.front.sepia.ceph.com /etc/hosts
2026-02-24T13:24:28.245 INFO:teuthology.orchestra.run.trial182.stdout:trial182.front.sepia.ceph.com
2026-02-24T13:24:28.245 DEBUG:teuthology.orchestra.run.trial182:> grep trial182.front.sepia.ceph.com /etc/hosts
2026-02-24T13:24:28.292 INFO:teuthology.orchestra.run.trial195.stdout:10.20.193.195 trial195.front.sepia.ceph.com trial195
2026-02-24T13:24:28.292 DEBUG:teuthology.orchestra.run.trial195:> sudo hostname trial195
2026-02-24T13:24:28.293 INFO:teuthology.orchestra.run.trial182.stdout:10.20.193.182 trial182.front.sepia.ceph.com trial182
2026-02-24T13:24:28.294 DEBUG:teuthology.orchestra.run.trial182:> sudo hostname trial182
2026-02-24T13:24:28.346 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/trial195.front.sepia.ceph.com/trial195/g' /etc/hosts
2026-02-24T13:24:28.348 DEBUG:teuthology.orchestra.run.trial182:> sudo sed -i -e 's/trial182.front.sepia.ceph.com/trial182/g' /etc/hosts
2026-02-24T13:24:28.395 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/10.20.193.195/10.20.193.195/g' /etc/hosts
2026-02-24T13:24:28.401 DEBUG:teuthology.orchestra.run.trial182:> sudo sed -i -e 's/10.20.193.182/10.20.193.182/g' /etc/hosts
2026-02-24T13:24:28.447 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i -e 's/trial195.front.sepia.ceph.com/trial195/g' /etc/hostname
2026-02-24T13:24:28.448 DEBUG:teuthology.orchestra.run.trial182:> sudo sed -i -e 's/trial182.front.sepia.ceph.com/trial182/g' /etc/hostname
2026-02-24T13:24:28.497 DEBUG:teuthology.orchestra.run.trial182:> sudo hostname trial182
2026-02-24T13:24:28.499 DEBUG:teuthology.orchestra.run.trial195:> sudo hostname trial195
2026-02-24T13:24:28.548 DEBUG:teuthology.orchestra.run.trial182:> cat /etc/os-release
2026-02-24T13:24:28.550 DEBUG:teuthology.orchestra.run.trial195:> cat /etc/os-release
2026-02-24T13:24:28.593 INFO:teuthology.orchestra.run.trial182.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:24:28.593 INFO:teuthology.orchestra.run.trial182.stdout:NAME="Ubuntu"
2026-02-24T13:24:28.593 INFO:teuthology.orchestra.run.trial182.stdout:VERSION_ID="22.04"
2026-02-24T13:24:28.593 INFO:teuthology.orchestra.run.trial182.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:24:28.593 INFO:teuthology.orchestra.run.trial182.stdout:VERSION_CODENAME=jammy
2026-02-24T13:24:28.593 INFO:teuthology.orchestra.run.trial182.stdout:ID=ubuntu
2026-02-24T13:24:28.593 INFO:teuthology.orchestra.run.trial182.stdout:ID_LIKE=debian
2026-02-24T13:24:28.593 INFO:teuthology.orchestra.run.trial182.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:24:28.594 INFO:teuthology.orchestra.run.trial182.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:24:28.594 INFO:teuthology.orchestra.run.trial182.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:24:28.594 INFO:teuthology.orchestra.run.trial182.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:24:28.594 INFO:teuthology.orchestra.run.trial182.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:24:28.594 INFO:teuthology.provision.fog.trial182:Deploy complete!
2026-02-24T13:24:28.595 DEBUG:teuthology.parallel:result is None
2026-02-24T13:24:28.599 INFO:teuthology.orchestra.run.trial195.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:24:28.599 INFO:teuthology.orchestra.run.trial195.stdout:NAME="Ubuntu"
2026-02-24T13:24:28.599 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_ID="22.04"
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_CODENAME=jammy
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:ID=ubuntu
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:ID_LIKE=debian
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:24:28.600 INFO:teuthology.orchestra.run.trial195.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:24:28.601 INFO:teuthology.provision.fog.trial195:Deploy complete!
2026-02-24T13:24:28.601 DEBUG:teuthology.parallel:result is None
2026-02-24T13:24:29.337 INFO:teuthology.lock.ops:Checking trial019.front.sepia.ceph.com
2026-02-24T13:24:29.337 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:24:29.575 INFO:teuthology.lock.ops:Checking trial182.front.sepia.ceph.com
2026-02-24T13:24:29.575 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:24:29.640 INFO:teuthology.lock.ops:Checking trial195.front.sepia.ceph.com
2026-02-24T13:24:29.640 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T13:24:29.699 INFO:teuthology.lock.ops:Updating [trial019.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:24:29.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial019.front.sepia.ceph.com'
2026-02-24T13:24:29.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:24:29.762 DEBUG:teuthology.orchestra.run.trial019:> true
2026-02-24T13:24:29.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial019.front.sepia.ceph.com'
2026-02-24T13:24:29.839 DEBUG:teuthology.orchestra.run.trial019:> uname -m
2026-02-24T13:24:29.883 INFO:teuthology.orchestra.run.trial019.stdout:x86_64
2026-02-24T13:24:29.884 DEBUG:teuthology.orchestra.run.trial019:> cat /etc/os-release
2026-02-24T13:24:29.928 INFO:teuthology.orchestra.run.trial019.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:24:29.928 INFO:teuthology.orchestra.run.trial019.stdout:NAME="Ubuntu"
2026-02-24T13:24:29.928 INFO:teuthology.orchestra.run.trial019.stdout:VERSION_ID="22.04"
2026-02-24T13:24:29.928 INFO:teuthology.orchestra.run.trial019.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:24:29.928 INFO:teuthology.orchestra.run.trial019.stdout:VERSION_CODENAME=jammy
2026-02-24T13:24:29.929 INFO:teuthology.orchestra.run.trial019.stdout:ID=ubuntu
2026-02-24T13:24:29.929 INFO:teuthology.orchestra.run.trial019.stdout:ID_LIKE=debian
2026-02-24T13:24:29.929 INFO:teuthology.orchestra.run.trial019.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:24:29.929 INFO:teuthology.orchestra.run.trial019.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:24:29.929 INFO:teuthology.orchestra.run.trial019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:24:29.929 INFO:teuthology.orchestra.run.trial019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:24:29.929 INFO:teuthology.orchestra.run.trial019.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:24:29.930 INFO:teuthology.lock.ops:Updating trial019.front.sepia.ceph.com on lock server
2026-02-24T13:24:30.143 INFO:teuthology.lock.ops:Updating [trial182.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:24:30.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial182.front.sepia.ceph.com'
2026-02-24T13:24:30.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:24:30.243 DEBUG:teuthology.orchestra.run.trial182:> true
2026-02-24T13:24:30.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial182.front.sepia.ceph.com'
2026-02-24T13:24:30.323 DEBUG:teuthology.orchestra.run.trial182:> uname -m
2026-02-24T13:24:30.368 INFO:teuthology.orchestra.run.trial182.stdout:x86_64
2026-02-24T13:24:30.369 DEBUG:teuthology.orchestra.run.trial182:> cat /etc/os-release
2026-02-24T13:24:30.417 INFO:teuthology.orchestra.run.trial182.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:24:30.417 INFO:teuthology.orchestra.run.trial182.stdout:NAME="Ubuntu"
2026-02-24T13:24:30.417 INFO:teuthology.orchestra.run.trial182.stdout:VERSION_ID="22.04"
2026-02-24T13:24:30.417 INFO:teuthology.orchestra.run.trial182.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:24:30.417 INFO:teuthology.orchestra.run.trial182.stdout:VERSION_CODENAME=jammy
2026-02-24T13:24:30.417 INFO:teuthology.orchestra.run.trial182.stdout:ID=ubuntu
2026-02-24T13:24:30.417 INFO:teuthology.orchestra.run.trial182.stdout:ID_LIKE=debian
2026-02-24T13:24:30.418 INFO:teuthology.orchestra.run.trial182.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:24:30.418 INFO:teuthology.orchestra.run.trial182.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:24:30.418 INFO:teuthology.orchestra.run.trial182.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:24:30.418 INFO:teuthology.orchestra.run.trial182.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:24:30.418 INFO:teuthology.orchestra.run.trial182.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:24:30.418 INFO:teuthology.lock.ops:Updating trial182.front.sepia.ceph.com on lock server
2026-02-24T13:24:30.524 INFO:teuthology.lock.ops:Updating [trial195.front.sepia.ceph.com]: set os type and version on server
2026-02-24T13:24:30.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com'
2026-02-24T13:24:30.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T13:24:30.596 DEBUG:teuthology.orchestra.run.trial195:> true
2026-02-24T13:24:30.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial195.front.sepia.ceph.com'
2026-02-24T13:24:30.673 DEBUG:teuthology.orchestra.run.trial195:> uname -m
2026-02-24T13:24:30.718 INFO:teuthology.orchestra.run.trial195.stdout:x86_64
2026-02-24T13:24:30.719 DEBUG:teuthology.orchestra.run.trial195:> cat /etc/os-release
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:NAME="Ubuntu"
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_ID="22.04"
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_CODENAME=jammy
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:ID=ubuntu
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:ID_LIKE=debian
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T13:24:30.763 INFO:teuthology.orchestra.run.trial195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T13:24:30.764 INFO:teuthology.orchestra.run.trial195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T13:24:30.764 INFO:teuthology.orchestra.run.trial195.stdout:UBUNTU_CODENAME=jammy
2026-02-24T13:24:30.764 INFO:teuthology.lock.ops:Updating trial195.front.sepia.ceph.com on lock server
2026-02-24T13:24:30.865 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:24:33.685 INFO:teuthology.dispatcher.supervisor:Running job 67816
2026-02-24T13:24:33.685 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_cjames@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67816 --name cjames-2026-02-24_10:01:51-rados-main-distro-default-trial --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds} ec_direct_reads/ec_direct_reads_on ec_optimizations/ec_optimizations_on mon_election/connectivity msgr-failures/osd-delay objectstore/{bluestore/{alloc$/{stupid} base mem$/{normal-2} onode-segment$/{1M} write$/{random/{compr$/{yes$/{zstd}} random}}}} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67816/orig.config.yaml
2026-02-24T13:24:33.686 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/cjames-2026-02-24_10:01:51-rados-main-distro-default-trial/67816
2026-02-24T13:24:33.686 INFO:teuthology.dispatcher.supervisor:Job PID: 597732
2026-02-24T13:24:33.686 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-24T13:26:33.699 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:28:33.867 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:30:36.543 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:32:36.743 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:34:36.929 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:36:37.131 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:38:37.249 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:40:37.559 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:42:37.765 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:44:37.959 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:46:38.153 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:48:38.236 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T13:48:38.318 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-24T13:48:38.504 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-24T13:48:39.264 INFO:teuthology.orchestra.console.trial195:Power off
2026-02-24T13:48:39.264 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:48:39.277 INFO:teuthology.orchestra.console.trial182:Power off
2026-02-24T13:48:39.277 DEBUG:teuthology.orchestra.console.trial182:pexpect command: ipmitool -H trial182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:48:39.286 INFO:teuthology.orchestra.console.trial019:Power off
2026-02-24T13:48:39.286 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T13:48:39.302 DEBUG:teuthology.orchestra.console.trial195:power off output: Chassis Power Control: Down/Off
2026-02-24T13:48:39.317 DEBUG:teuthology.orchestra.console.trial182:power off output: Chassis Power Control: Down/Off
2026-02-24T13:48:39.326 DEBUG:teuthology.orchestra.console.trial019:power off output: Chassis Power Control: Down/Off
2026-02-24T13:48:43.306 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:48:43.318 DEBUG:teuthology.orchestra.console.trial182:pexpect command: ipmitool -H trial182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:48:43.327 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:48:43.416 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is on
2026-02-24T13:48:43.426 DEBUG:teuthology.orchestra.console.trial182:check power output: Chassis Power is on
2026-02-24T13:48:43.435 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is on
2026-02-24T13:48:47.421 DEBUG:teuthology.orchestra.console.trial195:pexpect command: ipmitool -H trial195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:48:47.428 DEBUG:teuthology.orchestra.console.trial182:pexpect command: ipmitool -H trial182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:48:47.436 DEBUG:teuthology.orchestra.console.trial019:pexpect command: ipmitool -H trial019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T13:48:47.530 DEBUG:teuthology.orchestra.console.trial195:check power output: Chassis Power is off
2026-02-24T13:48:47.531 INFO:teuthology.orchestra.console.trial195:Power off completed
2026-02-24T13:48:47.536 DEBUG:teuthology.orchestra.console.trial182:check power output: Chassis Power is off
2026-02-24T13:48:47.537 INFO:teuthology.orchestra.console.trial182:Power off completed
2026-02-24T13:48:47.546 DEBUG:teuthology.orchestra.console.trial019:check power output: Chassis Power is off
2026-02-24T13:48:47.546 INFO:teuthology.orchestra.console.trial019:Power off completed
2026-02-24T13:48:47.781 INFO:teuthology.lock.ops:unlocked: trial195.front.sepia.ceph.com
2026-02-24T13:48:47.793 INFO:teuthology.lock.ops:unlocked: trial019.front.sepia.ceph.com
2026-02-24T13:48:47.802 INFO:teuthology.lock.ops:unlocked: trial182.front.sepia.ceph.com