2026-02-12T22:21:34.919 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473
2026-02-12T22:21:34.920 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:21:34.993 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:21:35.246 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7c7624d30650>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7c7624558900>, signals=[15])
2026-02-12T22:21:35.247 INFO:teuthology.lock.ops:Start node 'trial022.front.sepia.ceph.com' reimaging
2026-02-12T22:21:35.247 INFO:teuthology.lock.ops:Updating [trial022.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T22:21:35.247 INFO:teuthology.lock.ops:Updating trial022.front.sepia.ceph.com on lock server
2026-02-12T22:21:35.303 INFO:teuthology.lock.ops:Start node 'trial089.front.sepia.ceph.com' reimaging
2026-02-12T22:21:35.303 INFO:teuthology.lock.ops:Updating [trial089.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T22:21:35.303 INFO:teuthology.lock.ops:Updating trial089.front.sepia.ceph.com on lock server
2026-02-12T22:21:35.360 INFO:teuthology.lock.ops:Start node 'trial110.front.sepia.ceph.com' reimaging
2026-02-12T22:21:35.360 INFO:teuthology.lock.ops:Updating [trial110.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T22:21:35.360 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server
2026-02-12T22:21:35.534 DEBUG:teuthology.provision.fog.trial022:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T22:21:35.589 INFO:teuthology.provision.fog.trial022:Scheduling deploy of rocky 10.1
2026-02-12T22:21:35.590 DEBUG:teuthology.provision.fog.trial089:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T22:21:35.638 INFO:teuthology.provision.fog.trial089:Scheduling deploy of rocky 10.1
2026-02-12T22:21:35.642 DEBUG:teuthology.provision.fog.trial110:Requesting image trial_rocky_10.1 (ID 4)
2026-02-12T22:21:35.699 INFO:teuthology.provision.fog.trial110:Scheduling deploy of rocky 10.1
2026-02-12T22:21:37.265 INFO:teuthology.orchestra.console.trial089:Power off
2026-02-12T22:21:37.265 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:21:37.325 INFO:teuthology.orchestra.console.trial022:Power off
2026-02-12T22:21:37.325 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:21:37.330 DEBUG:teuthology.orchestra.console.trial089:power off output: Chassis Power Control: Down/Off
2026-02-12T22:21:37.344 INFO:teuthology.orchestra.console.trial110:Power off
2026-02-12T22:21:37.344 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:21:37.363 DEBUG:teuthology.orchestra.console.trial022:power off output: Chassis Power Control: Down/Off
2026-02-12T22:21:37.382 DEBUG:teuthology.orchestra.console.trial110:power off output: Chassis Power Control: Down/Off
2026-02-12T22:21:41.335 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:21:41.364 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:21:41.384 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:21:41.442 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is off
2026-02-12T22:21:41.443 INFO:teuthology.orchestra.console.trial089:Power off completed
2026-02-12T22:21:41.472 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is off
2026-02-12T22:21:41.472 INFO:teuthology.orchestra.console.trial022:Power off completed
2026-02-12T22:21:41.492 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-12T22:21:41.493 INFO:teuthology.orchestra.console.trial110:Power off completed
2026-02-12T22:21:41.544 INFO:teuthology.orchestra.console.trial089:Power on
2026-02-12T22:21:41.544 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T22:21:41.572 INFO:teuthology.orchestra.console.trial022:Power on
2026-02-12T22:21:41.573 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T22:21:41.583 DEBUG:teuthology.orchestra.console.trial089:power on output: Chassis Power Control: Up/On
2026-02-12T22:21:41.593 INFO:teuthology.orchestra.console.trial110:Power on
2026-02-12T22:21:41.594 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T22:21:41.613 DEBUG:teuthology.orchestra.console.trial022:power on output: Chassis Power Control: Up/On
2026-02-12T22:21:41.636 DEBUG:teuthology.orchestra.console.trial110:power on output: Chassis Power Control: Up/On
2026-02-12T22:21:45.588 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:21:45.615 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:21:45.637 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:21:45.697 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is on
2026-02-12T22:21:45.697 INFO:teuthology.orchestra.console.trial089:Power on completed
2026-02-12T22:21:45.724 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is off
2026-02-12T22:21:45.746 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is on
2026-02-12T22:21:45.746 INFO:teuthology.orchestra.console.trial110:Power on completed
2026-02-12T22:21:45.798 INFO:teuthology.provision.fog.trial089:Waiting for deploy to finish
2026-02-12T22:21:45.846 INFO:teuthology.provision.fog.trial110:Waiting for deploy to finish
2026-02-12T22:21:49.728 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:21:49.837 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is on
2026-02-12T22:21:49.837 INFO:teuthology.orchestra.console.trial022:Power on completed
2026-02-12T22:21:49.938 INFO:teuthology.provision.fog.trial022:Waiting for deploy to finish
2026-02-12T22:23:33.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:23:36.413 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89
2026-02-12T22:23:37.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:23:40.125 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-12T22:23:42.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:23:45.501 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89
2026-02-12T22:23:46.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:23:48.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:23:49.213 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-12T22:23:51.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:23:51.709 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-12T22:23:54.590 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89
2026-02-12T22:23:55.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:23:57.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:23:58.301 WARNING:teuthology.provision.fog.trial022:[Errno None] Unable to connect to port 22 on 10.20.193.22
2026-02-12T22:24:00.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:24:00.797 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-12T22:24:03.677 WARNING:teuthology.provision.fog.trial089:[Errno None] Unable to connect to port 22 on 10.20.193.89
2026-02-12T22:24:04.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:24:06.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:24:09.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:24:09.885 WARNING:teuthology.provision.fog.trial110:[Errno None] Unable to connect to port 22 on 10.20.193.110
2026-02-12T22:24:15.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:24:45.849 ERROR:teuthology.orchestra.connection:Error authenticating with trial089.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T22:24:49.946 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T22:24:49.947 DEBUG:teuthology.orchestra.run.trial089:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T22:24:50.159 INFO:teuthology.provision.fog.trial089:Node is ready
2026-02-12T22:24:50.159 DEBUG:teuthology.orchestra.run.trial089:> hostname
2026-02-12T22:24:50.216 INFO:teuthology.orchestra.run.trial089.stdout:trial089.front.sepia.ceph.com
2026-02-12T22:24:50.217 DEBUG:teuthology.orchestra.run.trial089:> grep trial089.front.sepia.ceph.com /etc/hosts
2026-02-12T22:24:50.274 INFO:teuthology.orchestra.run.trial089.stdout:10.20.193.89 trial089.front.sepia.ceph.com trial089
2026-02-12T22:24:50.274 DEBUG:teuthology.orchestra.run.trial089:> sudo hostname trial089
2026-02-12T22:24:50.348 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/trial089.front.sepia.ceph.com/trial089/g' /etc/hosts
2026-02-12T22:24:50.415 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/10.20.193.89/10.20.193.89/g' /etc/hosts
2026-02-12T22:24:50.482 DEBUG:teuthology.orchestra.run.trial089:> sudo sed -i -e 's/trial089.front.sepia.ceph.com/trial089/g' /etc/hostname
2026-02-12T22:24:50.549 DEBUG:teuthology.orchestra.run.trial089:> sudo hostname trial089
2026-02-12T22:24:50.614 DEBUG:teuthology.orchestra.run.trial089:> cat /etc/os-release
2026-02-12T22:24:50.672 INFO:teuthology.orchestra.run.trial089.stdout:NAME="Rocky Linux"
2026-02-12T22:24:50.672 INFO:teuthology.orchestra.run.trial089.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:24:50.672 INFO:teuthology.orchestra.run.trial089.stdout:ID="rocky"
2026-02-12T22:24:50.672 INFO:teuthology.orchestra.run.trial089.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:VERSION_ID="10.1"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:ANSI_COLOR="0;32"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_NAME="RESF"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:24:50.673 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:24:50.674 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:24:50.674 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:24:50.674 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:24:50.675 INFO:teuthology.provision.fog.trial089:Deploy complete!
2026-02-12T22:24:50.676 DEBUG:teuthology.parallel:result is None
2026-02-12T22:24:51.954 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T22:24:51.954 DEBUG:teuthology.orchestra.run.trial110:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T22:24:57.038 INFO:teuthology.provision.fog.trial110:Node is ready
2026-02-12T22:24:57.038 DEBUG:teuthology.orchestra.run.trial110:> hostname
2026-02-12T22:24:57.055 INFO:teuthology.orchestra.run.trial110.stdout:trial110.front.sepia.ceph.com
2026-02-12T22:24:57.055 DEBUG:teuthology.orchestra.run.trial110:> grep trial110.front.sepia.ceph.com /etc/hosts
2026-02-12T22:24:57.113 INFO:teuthology.orchestra.run.trial110.stdout:10.20.193.110 trial110.front.sepia.ceph.com trial110
2026-02-12T22:24:57.114 DEBUG:teuthology.orchestra.run.trial110:> sudo hostname trial110
2026-02-12T22:24:57.187 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/trial110.front.sepia.ceph.com/trial110/g' /etc/hosts
2026-02-12T22:24:57.254 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/10.20.193.110/10.20.193.110/g' /etc/hosts
2026-02-12T22:24:57.320 DEBUG:teuthology.orchestra.run.trial110:> sudo sed -i -e 's/trial110.front.sepia.ceph.com/trial110/g' /etc/hostname
2026-02-12T22:24:57.388 DEBUG:teuthology.orchestra.run.trial110:> sudo hostname trial110
2026-02-12T22:24:57.454 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release
2026-02-12T22:24:57.511 INFO:teuthology.orchestra.run.trial110.stdout:NAME="Rocky Linux"
2026-02-12T22:24:57.511 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:24:57.511 INFO:teuthology.orchestra.run.trial110.stdout:ID="rocky"
2026-02-12T22:24:57.511 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="10.1"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;32"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:VENDOR_NAME="RESF"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:24:57.512 INFO:teuthology.orchestra.run.trial110.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:24:57.513 INFO:teuthology.orchestra.run.trial110.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:24:57.513 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:24:57.513 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:24:57.513 INFO:teuthology.provision.fog.trial110:Deploy complete!
2026-02-12T22:24:57.514 DEBUG:teuthology.parallel:result is None
2026-02-12T22:25:04.308 WARNING:teuthology.provision.fog.trial022:timed out
2026-02-12T22:25:10.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:25:10.450 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T22:25:10.450 DEBUG:teuthology.orchestra.run.trial022:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T22:25:10.649 INFO:teuthology.provision.fog.trial022:Node is ready
2026-02-12T22:25:10.649 DEBUG:teuthology.orchestra.run.trial022:> hostname
2026-02-12T22:25:10.706 INFO:teuthology.orchestra.run.trial022.stdout:trial022.front.sepia.ceph.com
2026-02-12T22:25:10.707 DEBUG:teuthology.orchestra.run.trial022:> grep trial022.front.sepia.ceph.com /etc/hosts
2026-02-12T22:25:10.765 INFO:teuthology.orchestra.run.trial022.stdout:10.20.193.22 trial022.front.sepia.ceph.com trial022
2026-02-12T22:25:10.765 DEBUG:teuthology.orchestra.run.trial022:> sudo hostname trial022
2026-02-12T22:25:10.837 DEBUG:teuthology.orchestra.run.trial022:> sudo sed -i -e 's/trial022.front.sepia.ceph.com/trial022/g' /etc/hosts
2026-02-12T22:25:10.904 DEBUG:teuthology.orchestra.run.trial022:> sudo sed -i -e 's/10.20.193.22/10.20.193.22/g' /etc/hosts
2026-02-12T22:25:10.971 DEBUG:teuthology.orchestra.run.trial022:> sudo sed -i -e 's/trial022.front.sepia.ceph.com/trial022/g' /etc/hostname
2026-02-12T22:25:11.039 DEBUG:teuthology.orchestra.run.trial022:> sudo hostname trial022
2026-02-12T22:25:11.105 DEBUG:teuthology.orchestra.run.trial022:> cat /etc/os-release
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:NAME="Rocky Linux"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:ID="rocky"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:VERSION_ID="10.1"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:ANSI_COLOR="0;32"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:VENDOR_NAME="RESF"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:25:11.162 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:25:11.162 INFO:teuthology.provision.fog.trial022:Deploy complete!
2026-02-12T22:25:11.163 DEBUG:teuthology.parallel:result is None
2026-02-12T22:25:11.653 INFO:teuthology.lock.ops:Checking trial022.front.sepia.ceph.com
2026-02-12T22:25:11.653 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T22:25:11.748 INFO:teuthology.lock.ops:Checking trial089.front.sepia.ceph.com
2026-02-12T22:25:11.748 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T22:25:11.809 INFO:teuthology.lock.ops:Checking trial110.front.sepia.ceph.com
2026-02-12T22:25:11.809 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T22:25:11.865 INFO:teuthology.lock.ops:Updating [trial022.front.sepia.ceph.com]: set os type and version on server
2026-02-12T22:25:11.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial022.front.sepia.ceph.com'
2026-02-12T22:25:11.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:25:11.927 DEBUG:teuthology.orchestra.run.trial022:> true
2026-02-12T22:25:12.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial022.front.sepia.ceph.com'
2026-02-12T22:25:12.013 DEBUG:teuthology.orchestra.run.trial022:> uname -m
2026-02-12T22:25:12.070 INFO:teuthology.orchestra.run.trial022.stdout:x86_64
2026-02-12T22:25:12.070 DEBUG:teuthology.orchestra.run.trial022:> cat /etc/os-release
2026-02-12T22:25:12.127 INFO:teuthology.orchestra.run.trial022.stdout:NAME="Rocky Linux"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:ID="rocky"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:VERSION_ID="10.1"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:ANSI_COLOR="0;32"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:25:12.128 INFO:teuthology.orchestra.run.trial022.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:VENDOR_NAME="RESF"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:25:12.129 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:25:12.130 INFO:teuthology.lock.ops:Updating trial022.front.sepia.ceph.com on lock server
2026-02-12T22:25:12.231 INFO:teuthology.lock.ops:Updating [trial089.front.sepia.ceph.com]: set os type and version on server
2026-02-12T22:25:12.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial089.front.sepia.ceph.com'
2026-02-12T22:25:12.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:25:12.318 DEBUG:teuthology.orchestra.run.trial089:> true
2026-02-12T22:25:12.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial089.front.sepia.ceph.com'
2026-02-12T22:25:12.495 DEBUG:teuthology.orchestra.run.trial089:> uname -m
2026-02-12T22:25:12.552 INFO:teuthology.orchestra.run.trial089.stdout:x86_64
2026-02-12T22:25:12.552 DEBUG:teuthology.orchestra.run.trial089:> cat /etc/os-release
2026-02-12T22:25:12.611 INFO:teuthology.orchestra.run.trial089.stdout:NAME="Rocky Linux"
2026-02-12T22:25:12.611 INFO:teuthology.orchestra.run.trial089.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:25:12.611 INFO:teuthology.orchestra.run.trial089.stdout:ID="rocky"
2026-02-12T22:25:12.611 INFO:teuthology.orchestra.run.trial089.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:25:12.611 INFO:teuthology.orchestra.run.trial089.stdout:VERSION_ID="10.1"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:ANSI_COLOR="0;32"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_NAME="RESF"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:25:12.612 INFO:teuthology.orchestra.run.trial089.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:25:12.613 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:25:12.613 INFO:teuthology.orchestra.run.trial089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:25:12.613 INFO:teuthology.lock.ops:Updating trial089.front.sepia.ceph.com on lock server
2026-02-12T22:25:12.684 INFO:teuthology.lock.ops:Updating [trial110.front.sepia.ceph.com]: set os type and version on server
2026-02-12T22:25:12.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial110.front.sepia.ceph.com'
2026-02-12T22:25:12.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T22:25:12.745 DEBUG:teuthology.orchestra.run.trial110:> true
2026-02-12T22:25:12.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial110.front.sepia.ceph.com'
2026-02-12T22:25:12.914 DEBUG:teuthology.orchestra.run.trial110:> uname -m
2026-02-12T22:25:12.972 INFO:teuthology.orchestra.run.trial110.stdout:x86_64
2026-02-12T22:25:12.973 DEBUG:teuthology.orchestra.run.trial110:> cat /etc/os-release
2026-02-12T22:25:13.030 INFO:teuthology.orchestra.run.trial110.stdout:NAME="Rocky Linux"
2026-02-12T22:25:13.030 INFO:teuthology.orchestra.run.trial110.stdout:VERSION="10.1 (Red Quartz)"
2026-02-12T22:25:13.030 INFO:teuthology.orchestra.run.trial110.stdout:ID="rocky"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:ID_LIKE="rhel centos fedora"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:VERSION_ID="10.1"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:PLATFORM_ID="platform:el10"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:ANSI_COLOR="0;32"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:LOGO="fedora-logo-icon"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:HOME_URL="https://rockylinux.org/"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:VENDOR_NAME="RESF"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:VENDOR_URL="https://resf.org/"
2026-02-12T22:25:13.031 INFO:teuthology.orchestra.run.trial110.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-12T22:25:13.032 INFO:teuthology.orchestra.run.trial110.stdout:SUPPORT_END="2035-05-31"
2026-02-12T22:25:13.032 INFO:teuthology.orchestra.run.trial110.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-12T22:25:13.032 INFO:teuthology.orchestra.run.trial110.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:25:13.032 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-12T22:25:13.032 INFO:teuthology.orchestra.run.trial110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-12T22:25:13.033 INFO:teuthology.lock.ops:Updating trial110.front.sepia.ceph.com on lock server
2026-02-12T22:25:13.137 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:25:13.245 INFO:teuthology.dispatcher.supervisor:Running job 47204
2026-02-12T22:25:13.245 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47204 --name pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/pjd}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47204/orig.config.yaml
2026-02-12T22:25:13.246 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47204
2026-02-12T22:25:13.246 INFO:teuthology.dispatcher.supervisor:Job PID: 821807
2026-02-12T22:25:13.246 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T22:27:13.346 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:29:13.530 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:31:13.637 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:33:13.808 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:33:13.895 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-12T22:33:14.095 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T22:33:14.760 INFO:teuthology.orchestra.console.trial022:Power off
2026-02-12T22:33:14.760 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:33:14.816 INFO:teuthology.orchestra.console.trial110:Power off
2026-02-12T22:33:14.816 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:33:14.825 DEBUG:teuthology.orchestra.console.trial022:power off output: Chassis Power Control: Down/Off
2026-02-12T22:33:14.835 INFO:teuthology.orchestra.console.trial089:Power off
2026-02-12T22:33:14.835 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:33:14.860 DEBUG:teuthology.orchestra.console.trial110:power off output: Chassis Power Control: Down/Off
2026-02-12T22:33:14.873 DEBUG:teuthology.orchestra.console.trial089:power off output: Chassis Power Control: Down/Off
2026-02-12T22:33:18.830 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:33:18.861 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:33:18.874 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:33:18.940 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is on
2026-02-12T22:33:18.969 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is on
2026-02-12T22:33:18.983 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is on
2026-02-12T22:33:22.945 DEBUG:teuthology.orchestra.console.trial022:pexpect command: ipmitool -H trial022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:33:22.969 DEBUG:teuthology.orchestra.console.trial110:pexpect command: ipmitool -H trial110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:33:22.983 DEBUG:teuthology.orchestra.console.trial089:pexpect command: ipmitool -H trial089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:33:23.056 DEBUG:teuthology.orchestra.console.trial022:check power output: Chassis Power is off
2026-02-12T22:33:23.056 INFO:teuthology.orchestra.console.trial022:Power off completed
2026-02-12T22:33:23.080 DEBUG:teuthology.orchestra.console.trial110:check power output: Chassis Power is off
2026-02-12T22:33:23.080 INFO:teuthology.orchestra.console.trial110:Power off completed
2026-02-12T22:33:23.093 DEBUG:teuthology.orchestra.console.trial089:check power output: Chassis Power is off
2026-02-12T22:33:23.093 INFO:teuthology.orchestra.console.trial089:Power off completed
2026-02-12T22:33:23.348 INFO:teuthology.lock.ops:unlocked: trial022.front.sepia.ceph.com
2026-02-12T22:33:23.358 INFO:teuthology.lock.ops:unlocked: trial110.front.sepia.ceph.com
2026-02-12T22:33:23.362 INFO:teuthology.lock.ops:unlocked: trial089.front.sepia.ceph.com