2026-02-13T04:50:19.826 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T04:50:19.827 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:50:19.899 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:50:20.151 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x79f95e444560>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x79f95dc39f80>, signals=[15])
2026-02-13T04:50:20.151 INFO:teuthology.lock.ops:Start node 'trial006.front.sepia.ceph.com' reimaging
2026-02-13T04:50:20.151 INFO:teuthology.lock.ops:Updating [trial006.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T04:50:20.151 INFO:teuthology.lock.ops:Updating trial006.front.sepia.ceph.com on lock server
2026-02-13T04:50:20.208 INFO:teuthology.lock.ops:Start node 'trial025.front.sepia.ceph.com' reimaging
2026-02-13T04:50:20.209 INFO:teuthology.lock.ops:Updating [trial025.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T04:50:20.209 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server
2026-02-13T04:50:20.266 INFO:teuthology.lock.ops:Start node 'trial091.front.sepia.ceph.com' reimaging
2026-02-13T04:50:20.267 INFO:teuthology.lock.ops:Updating [trial091.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T04:50:20.267 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server
2026-02-13T04:50:20.495 DEBUG:teuthology.provision.fog.trial006:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T04:50:20.495 DEBUG:teuthology.provision.fog.trial025:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T04:50:20.552 DEBUG:teuthology.provision.fog.trial091:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T04:50:20.554 INFO:teuthology.provision.fog.trial006:Scheduling deploy of rocky 10.1
2026-02-13T04:50:20.555 INFO:teuthology.provision.fog.trial025:Scheduling deploy of rocky 10.1
2026-02-13T04:50:20.606 INFO:teuthology.provision.fog.trial091:Scheduling deploy of rocky 10.1
2026-02-13T04:50:21.592 INFO:teuthology.orchestra.console.trial025:Power off
2026-02-13T04:50:21.592 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T04:50:21.603 INFO:teuthology.orchestra.console.trial091:Power off
2026-02-13T04:50:21.603 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T04:50:21.612 INFO:teuthology.orchestra.console.trial006:Power off
2026-02-13T04:50:21.613 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T04:50:21.632 DEBUG:teuthology.orchestra.console.trial025:power off output: Chassis Power Control: Down/Off
2026-02-13T04:50:21.641 DEBUG:teuthology.orchestra.console.trial091:power off output: Chassis Power Control: Down/Off
2026-02-13T04:50:21.650 DEBUG:teuthology.orchestra.console.trial006:power off output: Chassis Power Control: Down/Off
2026-02-13T04:50:25.636 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:50:25.643 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:50:25.650 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:50:25.745 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is off
2026-02-13T04:50:25.746 INFO:teuthology.orchestra.console.trial025:Power off completed
2026-02-13T04:50:25.750 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is off
2026-02-13T04:50:25.751 INFO:teuthology.orchestra.console.trial091:Power off completed
2026-02-13T04:50:25.757 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is off
2026-02-13T04:50:25.757 INFO:teuthology.orchestra.console.trial006:Power off completed
2026-02-13T04:50:25.847 INFO:teuthology.orchestra.console.trial025:Power on
2026-02-13T04:50:25.847 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T04:50:25.855 INFO:teuthology.orchestra.console.trial091:Power on
2026-02-13T04:50:25.855 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T04:50:25.863 INFO:teuthology.orchestra.console.trial006:Power on
2026-02-13T04:50:25.863 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T04:50:25.887 DEBUG:teuthology.orchestra.console.trial025:power on output: Chassis Power Control: Up/On
2026-02-13T04:50:25.894 DEBUG:teuthology.orchestra.console.trial091:power on output: Chassis Power Control: Up/On
2026-02-13T04:50:25.902 DEBUG:teuthology.orchestra.console.trial006:power on output: Chassis Power Control: Up/On
2026-02-13T04:50:29.892 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:50:29.901 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:50:29.908 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T04:50:30.003 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is on
2026-02-13T04:50:30.003 INFO:teuthology.orchestra.console.trial025:Power on completed
2026-02-13T04:50:30.010 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is on
2026-02-13T04:50:30.010 INFO:teuthology.orchestra.console.trial091:Power on completed
2026-02-13T04:50:30.017 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is on
2026-02-13T04:50:30.017 INFO:teuthology.orchestra.console.trial006:Power on completed
2026-02-13T04:50:30.104 INFO:teuthology.provision.fog.trial025:Waiting for deploy to finish
2026-02-13T04:50:30.111 INFO:teuthology.provision.fog.trial091:Waiting for deploy to finish
2026-02-13T04:50:30.118 INFO:teuthology.provision.fog.trial006:Waiting for deploy to finish
2026-02-13T04:52:17.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:17.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:17.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:31.709 WARNING:teuthology.provision.fog.trial006:[Errno None] Unable to connect to port 22 on 10.20.193.6
2026-02-13T04:52:31.709 WARNING:teuthology.provision.fog.trial025:[Errno None] Unable to connect to port 22 on 10.20.193.25
2026-02-13T04:52:31.710 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91
2026-02-13T04:52:37.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:37.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:37.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:40.797 WARNING:teuthology.provision.fog.trial006:[Errno None] Unable to connect to port 22 on 10.20.193.6
2026-02-13T04:52:40.797 WARNING:teuthology.provision.fog.trial025:[Errno None] Unable to connect to port 22 on 10.20.193.25
2026-02-13T04:52:40.797 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91
2026-02-13T04:52:46.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:46.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:46.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:49.885 WARNING:teuthology.provision.fog.trial006:[Errno None] Unable to connect to port 22 on 10.20.193.6
2026-02-13T04:52:49.885 WARNING:teuthology.provision.fog.trial025:[Errno None] Unable to connect to port 22 on 10.20.193.25
2026-02-13T04:52:49.885 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91
2026-02-13T04:52:55.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:55.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:52:55.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:32.057 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T04:53:32.058 DEBUG:teuthology.orchestra.run.trial025:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T04:53:32.198 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T04:53:32.198 DEBUG:teuthology.orchestra.run.trial091:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T04:53:32.210 ERROR:teuthology.orchestra.connection:Error authenticating with trial006.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-13T04:53:36.319 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T04:53:36.319 DEBUG:teuthology.orchestra.run.trial006:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T04:53:36.530 INFO:teuthology.provision.fog.trial006:Node is ready
2026-02-13T04:53:36.530 DEBUG:teuthology.orchestra.run.trial006:> hostname
2026-02-13T04:53:36.549 INFO:teuthology.orchestra.run.trial006.stdout:trial006.front.sepia.ceph.com
2026-02-13T04:53:36.550 DEBUG:teuthology.orchestra.run.trial006:> grep trial006.front.sepia.ceph.com /etc/hosts
2026-02-13T04:53:36.607 INFO:teuthology.orchestra.run.trial006.stdout:10.20.193.6 trial006.front.sepia.ceph.com trial006
2026-02-13T04:53:36.608 DEBUG:teuthology.orchestra.run.trial006:> sudo hostname trial006
2026-02-13T04:53:36.681 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/trial006.front.sepia.ceph.com/trial006/g' /etc/hosts
2026-02-13T04:53:36.748 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/10.20.193.6/10.20.193.6/g' /etc/hosts
2026-02-13T04:53:36.815 DEBUG:teuthology.orchestra.run.trial006:> sudo sed -i -e 's/trial006.front.sepia.ceph.com/trial006/g' /etc/hostname
2026-02-13T04:53:36.890 DEBUG:teuthology.orchestra.run.trial006:> sudo hostname trial006
2026-02-13T04:53:36.955 DEBUG:teuthology.orchestra.run.trial006:> cat /etc/os-release
2026-02-13T04:53:37.005 INFO:teuthology.provision.fog.trial091:Node is ready
2026-02-13T04:53:37.005 DEBUG:teuthology.orchestra.run.trial091:> hostname
2026-02-13T04:53:37.013 INFO:teuthology.orchestra.run.trial006.stdout:NAME="Rocky Linux"
2026-02-13T04:53:37.013 INFO:teuthology.orchestra.run.trial006.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:53:37.013 INFO:teuthology.orchestra.run.trial006.stdout:ID="rocky"
2026-02-13T04:53:37.013 INFO:teuthology.orchestra.run.trial006.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:VERSION_ID="10.1"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:ANSI_COLOR="0;32"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:VENDOR_NAME="RESF"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:53:37.014 INFO:teuthology.orchestra.run.trial006.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:53:37.015 INFO:teuthology.orchestra.run.trial006.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:37.015 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:53:37.015 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:37.016 INFO:teuthology.provision.fog.trial006:Deploy complete!
2026-02-13T04:53:37.017 DEBUG:teuthology.parallel:result is None
2026-02-13T04:53:37.023 INFO:teuthology.orchestra.run.trial091.stdout:trial091.front.sepia.ceph.com
2026-02-13T04:53:37.023 DEBUG:teuthology.orchestra.run.trial091:> grep trial091.front.sepia.ceph.com /etc/hosts
2026-02-13T04:53:37.077 INFO:teuthology.orchestra.run.trial091.stdout:10.20.193.91 trial091.front.sepia.ceph.com trial091
2026-02-13T04:53:37.078 DEBUG:teuthology.orchestra.run.trial091:> sudo hostname trial091
2026-02-13T04:53:37.148 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/trial091.front.sepia.ceph.com/trial091/g' /etc/hosts
2026-02-13T04:53:37.213 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/10.20.193.91/10.20.193.91/g' /etc/hosts
2026-02-13T04:53:37.244 INFO:teuthology.provision.fog.trial025:Node is ready
2026-02-13T04:53:37.244 DEBUG:teuthology.orchestra.run.trial025:> hostname
2026-02-13T04:53:37.262 INFO:teuthology.orchestra.run.trial025.stdout:trial025.front.sepia.ceph.com
2026-02-13T04:53:37.262 DEBUG:teuthology.orchestra.run.trial025:> grep trial025.front.sepia.ceph.com /etc/hosts
2026-02-13T04:53:37.277 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/trial091.front.sepia.ceph.com/trial091/g' /etc/hostname
2026-02-13T04:53:37.320 INFO:teuthology.orchestra.run.trial025.stdout:10.20.193.25 trial025.front.sepia.ceph.com trial025
2026-02-13T04:53:37.320 DEBUG:teuthology.orchestra.run.trial025:> sudo hostname trial025
2026-02-13T04:53:37.342 DEBUG:teuthology.orchestra.run.trial091:> sudo hostname trial091
2026-02-13T04:53:37.394 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/trial025.front.sepia.ceph.com/trial025/g' /etc/hosts
2026-02-13T04:53:37.406 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release
2026-02-13T04:53:37.460 INFO:teuthology.orchestra.run.trial091.stdout:NAME="Rocky Linux"
2026-02-13T04:53:37.460 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:53:37.460 INFO:teuthology.orchestra.run.trial091.stdout:ID="rocky"
2026-02-13T04:53:37.460 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:53:37.460 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="10.1"
2026-02-13T04:53:37.460 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:53:37.460 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:53:37.460 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;32"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:VENDOR_NAME="RESF"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:53:37.461 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:37.462 INFO:teuthology.provision.fog.trial091:Deploy complete!
2026-02-13T04:53:37.463 DEBUG:teuthology.parallel:result is None
2026-02-13T04:53:37.464 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/10.20.193.25/10.20.193.25/g' /etc/hosts
2026-02-13T04:53:37.531 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i -e 's/trial025.front.sepia.ceph.com/trial025/g' /etc/hostname
2026-02-13T04:53:37.597 DEBUG:teuthology.orchestra.run.trial025:> sudo hostname trial025
2026-02-13T04:53:37.663 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release
2026-02-13T04:53:37.721 INFO:teuthology.orchestra.run.trial025.stdout:NAME="Rocky Linux"
2026-02-13T04:53:37.721 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:53:37.721 INFO:teuthology.orchestra.run.trial025.stdout:ID="rocky"
2026-02-13T04:53:37.721 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:53:37.721 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="10.1"
2026-02-13T04:53:37.721 INFO:teuthology.orchestra.run.trial025.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:53:37.721 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:ANSI_COLOR="0;32"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:VENDOR_NAME="RESF"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:53:37.722 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:37.723 INFO:teuthology.provision.fog.trial025:Deploy complete!
2026-02-13T04:53:37.724 DEBUG:teuthology.parallel:result is None
2026-02-13T04:53:38.250 INFO:teuthology.lock.ops:Checking trial006.front.sepia.ceph.com
2026-02-13T04:53:38.250 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T04:53:38.357 INFO:teuthology.lock.ops:Checking trial025.front.sepia.ceph.com
2026-02-13T04:53:38.357 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T04:53:38.419 INFO:teuthology.lock.ops:Checking trial091.front.sepia.ceph.com
2026-02-13T04:53:38.419 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T04:53:38.476 INFO:teuthology.lock.ops:Updating [trial006.front.sepia.ceph.com]: set os type and version on server
2026-02-13T04:53:38.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial006.front.sepia.ceph.com'
2026-02-13T04:53:38.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:38.535 DEBUG:teuthology.orchestra.run.trial006:> true
2026-02-13T04:53:38.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial006.front.sepia.ceph.com'
2026-02-13T04:53:38.620 DEBUG:teuthology.orchestra.run.trial006:> uname -m
2026-02-13T04:53:38.678 INFO:teuthology.orchestra.run.trial006.stdout:x86_64
2026-02-13T04:53:38.678 DEBUG:teuthology.orchestra.run.trial006:> cat /etc/os-release
2026-02-13T04:53:38.735 INFO:teuthology.orchestra.run.trial006.stdout:NAME="Rocky Linux"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:ID="rocky"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:VERSION_ID="10.1"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:ANSI_COLOR="0;32"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:53:38.736 INFO:teuthology.orchestra.run.trial006.stdout:VENDOR_NAME="RESF"
2026-02-13T04:53:38.737 INFO:teuthology.orchestra.run.trial006.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:53:38.737 INFO:teuthology.orchestra.run.trial006.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:53:38.737 INFO:teuthology.orchestra.run.trial006.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:53:38.737 INFO:teuthology.orchestra.run.trial006.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:53:38.737 INFO:teuthology.orchestra.run.trial006.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:38.737 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:53:38.737 INFO:teuthology.orchestra.run.trial006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:38.738 INFO:teuthology.lock.ops:Updating trial006.front.sepia.ceph.com on lock server
2026-02-13T04:53:38.839 INFO:teuthology.lock.ops:Updating [trial025.front.sepia.ceph.com]: set os type and version on server
2026-02-13T04:53:38.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com'
2026-02-13T04:53:38.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:38.908 DEBUG:teuthology.orchestra.run.trial025:> true
2026-02-13T04:53:38.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com'
2026-02-13T04:53:38.979 DEBUG:teuthology.orchestra.run.trial025:> uname -m
2026-02-13T04:53:39.037 INFO:teuthology.orchestra.run.trial025.stdout:x86_64
2026-02-13T04:53:39.037 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release
2026-02-13T04:53:39.095 INFO:teuthology.orchestra.run.trial025.stdout:NAME="Rocky Linux"
2026-02-13T04:53:39.095 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:53:39.095 INFO:teuthology.orchestra.run.trial025.stdout:ID="rocky"
2026-02-13T04:53:39.095 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="10.1"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:ANSI_COLOR="0;32"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:VENDOR_NAME="RESF"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:53:39.096 INFO:teuthology.orchestra.run.trial025.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:53:39.097 INFO:teuthology.orchestra.run.trial025.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:53:39.097 INFO:teuthology.orchestra.run.trial025.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:39.097 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:53:39.097 INFO:teuthology.orchestra.run.trial025.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:39.097 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server
2026-02-13T04:53:39.199 INFO:teuthology.lock.ops:Updating [trial091.front.sepia.ceph.com]: set os type and version on server
2026-02-13T04:53:39.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com'
2026-02-13T04:53:39.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T04:53:39.276 DEBUG:teuthology.orchestra.run.trial091:> true
2026-02-13T04:53:39.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial091.front.sepia.ceph.com'
2026-02-13T04:53:39.352 DEBUG:teuthology.orchestra.run.trial091:> uname -m
2026-02-13T04:53:39.409 INFO:teuthology.orchestra.run.trial091.stdout:x86_64
2026-02-13T04:53:39.409 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release
2026-02-13T04:53:39.467 INFO:teuthology.orchestra.run.trial091.stdout:NAME="Rocky Linux"
2026-02-13T04:53:39.467 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T04:53:39.467 INFO:teuthology.orchestra.run.trial091.stdout:ID="rocky"
2026-02-13T04:53:39.467 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T04:53:39.467 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="10.1"
2026-02-13T04:53:39.467 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el10"
2026-02-13T04:53:39.467 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T04:53:39.467 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;32"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:VENDOR_NAME="RESF"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:SUPPORT_END="2035-05-31"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T04:53:39.468 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T04:53:39.469 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server
2026-02-13T04:53:39.569 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:53:39.668 INFO:teuthology.dispatcher.supervisor:Running job 48184
2026-02-13T04:53:39.668 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48184 --name pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/postgres}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48184/orig.config.yaml
2026-02-13T04:53:39.668 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48184
2026-02-13T04:53:39.668 INFO:teuthology.dispatcher.supervisor:Job PID: 1585065
2026-02-13T04:53:39.668 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T04:55:39.730 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:57:39.913 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T04:59:40.118 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:01:40.233 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:03:40.363 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:05:40.572 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:07:40.698 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T05:07:40.788 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T05:07:40.958 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T05:07:41.622 INFO:teuthology.orchestra.console.trial025:Power off
2026-02-13T05:07:41.622 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T05:07:41.675 DEBUG:teuthology.orchestra.console.trial025:power off output: Chassis Power Control: Down/Off
2026-02-13T05:07:41.685 INFO:teuthology.orchestra.console.trial006:Power off
2026-02-13T05:07:41.685 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T05:07:41.695 INFO:teuthology.orchestra.console.trial091:Power off
2026-02-13T05:07:41.695 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T05:07:41.726 DEBUG:teuthology.orchestra.console.trial006:power off output: Chassis Power Control: Down/Off
2026-02-13T05:07:41.732 DEBUG:teuthology.orchestra.console.trial091:power off output: Chassis Power Control: Down/Off
2026-02-13T05:07:45.680 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T05:07:45.727 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T05:07:45.732 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T05:07:45.789 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is on
2026-02-13T05:07:45.834 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is on
2026-02-13T05:07:45.842 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is on
2026-02-13T05:07:49.794 DEBUG:teuthology.orchestra.console.trial025:pexpect command: ipmitool -H trial025.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T05:07:49.835 DEBUG:teuthology.orchestra.console.trial006:pexpect command: ipmitool -H trial006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T05:07:49.842 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T05:07:49.906 DEBUG:teuthology.orchestra.console.trial025:check power output: Chassis Power is off
2026-02-13T05:07:49.906 INFO:teuthology.orchestra.console.trial025:Power off completed
2026-02-13T05:07:49.944 DEBUG:teuthology.orchestra.console.trial006:check power output: Chassis Power is off
2026-02-13T05:07:49.944 INFO:teuthology.orchestra.console.trial006:Power off completed
2026-02-13T05:07:49.950 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is off
2026-02-13T05:07:49.951 INFO:teuthology.orchestra.console.trial091:Power off completed
2026-02-13T05:07:50.194 INFO:teuthology.lock.ops:unlocked: trial025.front.sepia.ceph.com
2026-02-13T05:07:50.205 INFO:teuthology.lock.ops:unlocked: trial006.front.sepia.ceph.com
2026-02-13T05:07:50.209 INFO:teuthology.lock.ops:unlocked: trial091.front.sepia.ceph.com