2026-02-23T12:45:01.182 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-23T12:45:01.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:45:01.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:45:01.449 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x746deab0c890>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x746deaaa5a80>, signals=[15])
2026-02-23T12:45:01.449 INFO:teuthology.lock.ops:Start node 'trial044.front.sepia.ceph.com' reimaging
2026-02-23T12:45:01.449 INFO:teuthology.lock.ops:Updating [trial044.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T12:45:01.449 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server
2026-02-23T12:45:01.505 INFO:teuthology.lock.ops:Start node 'trial093.front.sepia.ceph.com' reimaging
2026-02-23T12:45:01.505 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: reset os type and version on server
2026-02-23T12:45:01.505 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server
2026-02-23T12:45:01.720 DEBUG:teuthology.provision.fog.trial093:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T12:45:01.730 DEBUG:teuthology.provision.fog.trial044:Requesting image trial_centos_9.stream (ID 3)
2026-02-23T12:45:01.772 INFO:teuthology.provision.fog.trial093:Scheduling deploy of centos 9.stream
2026-02-23T12:45:01.781 INFO:teuthology.provision.fog.trial044:Scheduling deploy of centos 9.stream
2026-02-23T12:45:03.192 INFO:teuthology.orchestra.console.trial044:Power off
2026-02-23T12:45:03.192 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T12:45:03.203 INFO:teuthology.orchestra.console.trial093:Power off
2026-02-23T12:45:03.203 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T12:45:03.229 DEBUG:teuthology.orchestra.console.trial044:power off output: Chassis Power Control: Down/Off
2026-02-23T12:45:03.239 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off
2026-02-23T12:45:07.234 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:45:07.242 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:45:07.344 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-23T12:45:07.345 INFO:teuthology.orchestra.console.trial044:Power off completed
2026-02-23T12:45:07.351 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off
2026-02-23T12:45:07.351 INFO:teuthology.orchestra.console.trial093:Power off completed
2026-02-23T12:45:07.446 INFO:teuthology.orchestra.console.trial044:Power on
2026-02-23T12:45:07.446 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T12:45:07.455 INFO:teuthology.orchestra.console.trial093:Power on
2026-02-23T12:45:07.455 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-23T12:45:07.485 DEBUG:teuthology.orchestra.console.trial044:power on output: Chassis Power Control: Up/On
2026-02-23T12:45:07.493 DEBUG:teuthology.orchestra.console.trial093:power on output: Chassis Power Control: Up/On
2026-02-23T12:45:11.490 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:45:11.498 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T12:45:11.600 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is on
2026-02-23T12:45:11.601 INFO:teuthology.orchestra.console.trial044:Power on completed
2026-02-23T12:45:11.608 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on
2026-02-23T12:45:11.608 INFO:teuthology.orchestra.console.trial093:Power on completed
2026-02-23T12:45:11.701 INFO:teuthology.provision.fog.trial044:Waiting for deploy to finish
2026-02-23T12:45:11.708 INFO:teuthology.provision.fog.trial093:Waiting for deploy to finish
2026-02-23T12:46:59.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:46:59.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:47:00.124 ERROR:teuthology.orchestra.connection:Error authenticating with trial093.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-23T12:47:02.912 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-23T12:47:08.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:47:12.000 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-23T12:47:18.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:47:21.088 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-23T12:47:27.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:47:30.176 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-23T12:47:36.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:47:39.264 WARNING:teuthology.provision.fog.trial044:[Errno None] Unable to connect to port 22 on 10.20.193.44
2026-02-23T12:47:45.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:48:04.127 WARNING:teuthology.provision.fog.trial093:timed out
2026-02-23T12:48:10.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:48:17.415 ERROR:teuthology.orchestra.connection:Error authenticating with trial093.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-23T12:48:21.537 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T12:48:21.537 DEBUG:teuthology.orchestra.run.trial044:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T12:48:21.616 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-23T12:48:21.616 DEBUG:teuthology.orchestra.run.trial093:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-23T12:48:21.717 INFO:teuthology.provision.fog.trial044:Node is ready
2026-02-23T12:48:21.717 DEBUG:teuthology.orchestra.run.trial044:> hostname
2026-02-23T12:48:21.773 INFO:teuthology.orchestra.run.trial044.stdout:trial044.front.sepia.ceph.com
2026-02-23T12:48:21.773 DEBUG:teuthology.orchestra.run.trial044:> grep trial044.front.sepia.ceph.com /etc/hosts
2026-02-23T12:48:21.829 INFO:teuthology.orchestra.run.trial044.stdout:10.20.193.44 trial044.front.sepia.ceph.com trial044
2026-02-23T12:48:21.829 DEBUG:teuthology.orchestra.run.trial044:> sudo hostname trial044
2026-02-23T12:48:21.906 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/trial044.front.sepia.ceph.com/trial044/g' /etc/hosts
2026-02-23T12:48:22.030 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/10.20.193.44/10.20.193.44/g' /etc/hosts
2026-02-23T12:48:22.080 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i -e 's/trial044.front.sepia.ceph.com/trial044/g' /etc/hostname
2026-02-23T12:48:22.107 DEBUG:teuthology.orchestra.run.trial044:> sudo hostname trial044
2026-02-23T12:48:22.171 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release
2026-02-23T12:48:22.227 INFO:teuthology.orchestra.run.trial044.stdout:NAME="CentOS Stream"
2026-02-23T12:48:22.227 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="9"
2026-02-23T12:48:22.227 INFO:teuthology.orchestra.run.trial044.stdout:ID="centos"
2026-02-23T12:48:22.227 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:48:22.227 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="9"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;31"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:48:22.228 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:48:22.229 INFO:teuthology.provision.fog.trial044:Deploy complete!
2026-02-23T12:48:22.230 DEBUG:teuthology.parallel:result is None
2026-02-23T12:48:26.968 INFO:teuthology.provision.fog.trial093:Node is ready
2026-02-23T12:48:26.969 DEBUG:teuthology.orchestra.run.trial093:> hostname
2026-02-23T12:48:26.987 INFO:teuthology.orchestra.run.trial093.stdout:trial093.front.sepia.ceph.com
2026-02-23T12:48:26.988 DEBUG:teuthology.orchestra.run.trial093:> grep trial093.front.sepia.ceph.com /etc/hosts
2026-02-23T12:48:27.042 INFO:teuthology.orchestra.run.trial093.stdout:10.20.193.93 trial093.front.sepia.ceph.com trial093
2026-02-23T12:48:27.043 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093
2026-02-23T12:48:27.116 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hosts
2026-02-23T12:48:27.182 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/10.20.193.93/10.20.193.93/g' /etc/hosts
2026-02-23T12:48:27.247 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hostname
2026-02-23T12:48:27.313 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093
2026-02-23T12:48:27.379 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release
2026-02-23T12:48:27.437 INFO:teuthology.orchestra.run.trial093.stdout:NAME="CentOS Stream"
2026-02-23T12:48:27.437 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="9"
2026-02-23T12:48:27.437 INFO:teuthology.orchestra.run.trial093.stdout:ID="centos"
2026-02-23T12:48:27.437 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:48:27.437 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="9"
2026-02-23T12:48:27.437 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:48:27.437 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:48:27.438 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;31"
2026-02-23T12:48:27.438 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:48:27.438 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:48:27.438 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:48:27.438 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:48:27.438 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:48:27.438 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:48:27.439 INFO:teuthology.provision.fog.trial093:Deploy complete!
2026-02-23T12:48:27.439 DEBUG:teuthology.parallel:result is None
2026-02-23T12:48:27.832 INFO:teuthology.lock.ops:Checking trial044.front.sepia.ceph.com
2026-02-23T12:48:27.833 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T12:48:27.922 INFO:teuthology.lock.ops:Checking trial093.front.sepia.ceph.com
2026-02-23T12:48:27.922 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-23T12:48:27.982 INFO:teuthology.lock.ops:Updating [trial044.front.sepia.ceph.com]: set os type and version on server
2026-02-23T12:48:27.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial044.front.sepia.ceph.com'
2026-02-23T12:48:27.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:48:28.045 DEBUG:teuthology.orchestra.run.trial044:> true
2026-02-23T12:48:28.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial044.front.sepia.ceph.com'
2026-02-23T12:48:28.122 DEBUG:teuthology.orchestra.run.trial044:> uname -m
2026-02-23T12:48:28.178 INFO:teuthology.orchestra.run.trial044.stdout:x86_64
2026-02-23T12:48:28.179 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release
2026-02-23T12:48:28.234 INFO:teuthology.orchestra.run.trial044.stdout:NAME="CentOS Stream"
2026-02-23T12:48:28.234 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="9"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:ID="centos"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="9"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;31"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:48:28.235 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:48:28.236 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server
2026-02-23T12:48:28.339 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: set os type and version on server
2026-02-23T12:48:28.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com'
2026-02-23T12:48:28.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-23T12:48:28.410 DEBUG:teuthology.orchestra.run.trial093:> true
2026-02-23T12:48:28.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com'
2026-02-23T12:48:28.484 DEBUG:teuthology.orchestra.run.trial093:> uname -m
2026-02-23T12:48:28.540 INFO:teuthology.orchestra.run.trial093.stdout:x86_64
2026-02-23T12:48:28.541 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release
2026-02-23T12:48:28.596 INFO:teuthology.orchestra.run.trial093.stdout:NAME="CentOS Stream"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="9"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:ID="centos"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel fedora"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="9"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el9"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;31"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-23T12:48:28.597 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://centos.org/"
2026-02-23T12:48:28.598 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-23T12:48:28.598 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-23T12:48:28.598 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-23T12:48:28.598 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server
2026-02-23T12:48:28.702 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:48:28.809 INFO:teuthology.dispatcher.supervisor:Running job 66453
2026-02-23T12:48:28.809 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66453 --name shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial --description crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{pggrow} thrashosds-health workloads/small-objects-localized} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66453/orig.config.yaml
2026-02-23T12:48:28.810 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-23_12:27:41-crimson-rados-main-distro-debug-trial/66453
2026-02-23T12:48:28.810 INFO:teuthology.dispatcher.supervisor:Job PID: 717125
2026-02-23T12:48:28.810 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-23T12:50:28.811 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:52:28.930 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:54:29.051 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:56:29.168 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T12:58:29.288 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:00:29.411 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:02:29.532 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:04:29.639 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:06:29.776 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:08:29.864 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:10:29.964 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:12:30.048 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:14:30.148 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:16:30.269 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:18:30.395 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-23T13:18:30.493 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-23T13:18:30.613 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-23T13:18:31.140 INFO:teuthology.orchestra.console.trial044:Power off
2026-02-23T13:18:31.140 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T13:18:31.152 INFO:teuthology.orchestra.console.trial093:Power off
2026-02-23T13:18:31.152 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-23T13:18:31.178 DEBUG:teuthology.orchestra.console.trial044:power off output: Chassis Power Control: Down/Off
2026-02-23T13:18:31.189 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off
2026-02-23T13:18:35.179 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:18:35.190 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:18:35.291 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is on
2026-02-23T13:18:35.300 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on
2026-02-23T13:18:39.291 DEBUG:teuthology.orchestra.console.trial044:pexpect command: ipmitool -H trial044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:18:39.300 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-23T13:18:39.403 DEBUG:teuthology.orchestra.console.trial044:check power output: Chassis Power is off
2026-02-23T13:18:39.403 INFO:teuthology.orchestra.console.trial044:Power off completed
2026-02-23T13:18:39.411 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off
2026-02-23T13:18:39.411 INFO:teuthology.orchestra.console.trial093:Power off completed
2026-02-23T13:18:39.650 INFO:teuthology.lock.ops:unlocked: trial044.front.sepia.ceph.com
2026-02-23T13:18:39.662 INFO:teuthology.lock.ops:unlocked: trial093.front.sepia.ceph.com