2026-02-25T13:47:27.265 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-25T13:47:27.265 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:47:27.333 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:47:27.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x78af0b33a2a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x78af0ad9f560>, signals=[15])
2026-02-25T13:47:27.585 INFO:teuthology.lock.ops:Start node 'trial011.front.sepia.ceph.com' reimaging
2026-02-25T13:47:27.585 INFO:teuthology.lock.ops:Updating [trial011.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T13:47:27.585 INFO:teuthology.lock.ops:Updating trial011.front.sepia.ceph.com on lock server
2026-02-25T13:47:27.641 INFO:teuthology.lock.ops:Start node 'trial084.front.sepia.ceph.com' reimaging
2026-02-25T13:47:27.641 INFO:teuthology.lock.ops:Updating [trial084.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T13:47:27.641 INFO:teuthology.lock.ops:Updating trial084.front.sepia.ceph.com on lock server
2026-02-25T13:47:27.698 INFO:teuthology.lock.ops:Start node 'trial192.front.sepia.ceph.com' reimaging
2026-02-25T13:47:27.698 INFO:teuthology.lock.ops:Updating [trial192.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T13:47:27.698 INFO:teuthology.lock.ops:Updating trial192.front.sepia.ceph.com on lock server
2026-02-25T13:47:27.935 DEBUG:teuthology.provision.fog.trial011:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T13:47:27.935 DEBUG:teuthology.provision.fog.trial084:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T13:47:27.988 INFO:teuthology.provision.fog.trial011:Scheduling deploy of centos 9.stream
2026-02-25T13:47:27.989 INFO:teuthology.provision.fog.trial084:Scheduling deploy of centos 9.stream
2026-02-25T13:47:27.991 DEBUG:teuthology.provision.fog.trial192:Requesting image trial_centos_9.stream (ID 3)
2026-02-25T13:47:28.041 INFO:teuthology.provision.fog.trial192:Scheduling deploy of centos 9.stream
2026-02-25T13:47:29.530 INFO:teuthology.orchestra.console.trial011:Power off
2026-02-25T13:47:29.531 DEBUG:teuthology.orchestra.console.trial011:pexpect command: ipmitool -H trial011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T13:47:29.590 INFO:teuthology.orchestra.console.trial084:Power off
2026-02-25T13:47:29.591 DEBUG:teuthology.orchestra.console.trial084:pexpect command: ipmitool -H trial084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T13:47:29.596 DEBUG:teuthology.orchestra.console.trial011:power off output: Chassis Power Control: Down/Off
2026-02-25T13:47:29.608 INFO:teuthology.orchestra.console.trial192:Power off
2026-02-25T13:47:29.609 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T13:47:29.629 DEBUG:teuthology.orchestra.console.trial084:power off output: Chassis Power Control: Down/Off
2026-02-25T13:47:29.648 DEBUG:teuthology.orchestra.console.trial192:power off output: Chassis Power Control: Down/Off
2026-02-25T13:47:33.601 DEBUG:teuthology.orchestra.console.trial011:pexpect command: ipmitool -H trial011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T13:47:33.630 DEBUG:teuthology.orchestra.console.trial084:pexpect command: ipmitool -H trial084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T13:47:33.648 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T13:47:33.709 DEBUG:teuthology.orchestra.console.trial011:check power output: Chassis Power is off
2026-02-25T13:47:33.709 INFO:teuthology.orchestra.console.trial011:Power off completed
2026-02-25T13:47:33.738 DEBUG:teuthology.orchestra.console.trial084:check power output: Chassis Power is off
2026-02-25T13:47:33.739 INFO:teuthology.orchestra.console.trial084:Power off completed
2026-02-25T13:47:33.757 DEBUG:teuthology.orchestra.console.trial192:check power output: Chassis Power is off
2026-02-25T13:47:33.758 INFO:teuthology.orchestra.console.trial192:Power off completed
2026-02-25T13:47:33.810 INFO:teuthology.orchestra.console.trial011:Power on
2026-02-25T13:47:33.810 DEBUG:teuthology.orchestra.console.trial011:pexpect command: ipmitool -H trial011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T13:47:33.839 INFO:teuthology.orchestra.console.trial084:Power on
2026-02-25T13:47:33.840 DEBUG:teuthology.orchestra.console.trial084:pexpect command: ipmitool -H trial084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T13:47:33.851 DEBUG:teuthology.orchestra.console.trial011:power on output: Chassis Power Control: Up/On
2026-02-25T13:47:33.858 INFO:teuthology.orchestra.console.trial192:Power on
2026-02-25T13:47:33.859 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T13:47:33.880 DEBUG:teuthology.orchestra.console.trial084:power on output: Chassis Power Control: Up/On
2026-02-25T13:47:33.897 DEBUG:teuthology.orchestra.console.trial192:power on output: Chassis Power Control: Up/On
2026-02-25T13:47:37.856 DEBUG:teuthology.orchestra.console.trial011:pexpect command: ipmitool -H trial011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T13:47:37.881 DEBUG:teuthology.orchestra.console.trial084:pexpect command: ipmitool -H trial084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T13:47:37.898 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T13:47:37.968 DEBUG:teuthology.orchestra.console.trial011:check power output: Chassis Power is on
2026-02-25T13:47:37.968 INFO:teuthology.orchestra.console.trial011:Power on completed
2026-02-25T13:47:37.991 DEBUG:teuthology.orchestra.console.trial084:check power output: Chassis Power is on
2026-02-25T13:47:37.991 INFO:teuthology.orchestra.console.trial084:Power on completed
2026-02-25T13:47:38.008 DEBUG:teuthology.orchestra.console.trial192:check power output: Chassis Power is on
2026-02-25T13:47:38.008 INFO:teuthology.orchestra.console.trial192:Power on completed
2026-02-25T13:47:38.069 INFO:teuthology.provision.fog.trial011:Waiting for deploy to finish
2026-02-25T13:47:38.092 INFO:teuthology.provision.fog.trial084:Waiting for deploy to finish
2026-02-25T13:47:38.109 INFO:teuthology.provision.fog.trial192:Waiting for deploy to finish
2026-02-25T13:49:26.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:49:26.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:49:41.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:49:44.577 WARNING:teuthology.provision.fog.trial192:[Errno None] Unable to connect to port 22 on 10.20.193.192
2026-02-25T13:49:50.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:49:53.663 WARNING:teuthology.provision.fog.trial192:[Errno None] Unable to connect to port 22 on 10.20.193.192
2026-02-25T13:49:59.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:50:02.751 WARNING:teuthology.provision.fog.trial192:[Errno None] Unable to connect to port 22 on 10.20.193.192
2026-02-25T13:50:08.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:50:11.840 WARNING:teuthology.provision.fog.trial192:[Errno None] Unable to connect to port 22 on 10.20.193.192
2026-02-25T13:50:17.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:50:26.400 WARNING:teuthology.provision.fog.trial084:timed out
2026-02-25T13:50:26.451 WARNING:teuthology.provision.fog.trial011:timed out
2026-02-25T13:50:32.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:50:32.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:50:39.769 ERROR:teuthology.orchestra.connection:Error authenticating with trial084.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-25T13:50:39.790 ERROR:teuthology.orchestra.connection:Error authenticating with trial011.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-25T13:50:43.878 ERROR:teuthology.orchestra.connection:Error authenticating with trial084.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-25T13:50:44.069 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T13:50:44.069 DEBUG:teuthology.orchestra.run.trial011:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T13:50:48.940 INFO:teuthology.provision.fog.trial011:Node is ready
2026-02-25T13:50:48.940 DEBUG:teuthology.orchestra.run.trial011:> hostname
2026-02-25T13:50:48.958 INFO:teuthology.orchestra.run.trial011.stdout:trial011.front.sepia.ceph.com
2026-02-25T13:50:48.958 DEBUG:teuthology.orchestra.run.trial011:> grep trial011.front.sepia.ceph.com /etc/hosts
2026-02-25T13:50:49.011 INFO:teuthology.orchestra.run.trial011.stdout:10.20.193.11 trial011.front.sepia.ceph.com trial011
2026-02-25T13:50:49.011 DEBUG:teuthology.orchestra.run.trial011:> sudo hostname trial011
2026-02-25T13:50:49.081 DEBUG:teuthology.orchestra.run.trial011:> sudo sed -i -e 's/trial011.front.sepia.ceph.com/trial011/g' /etc/hosts
2026-02-25T13:50:49.143 DEBUG:teuthology.orchestra.run.trial011:> sudo sed -i -e 's/10.20.193.11/10.20.193.11/g' /etc/hosts
2026-02-25T13:50:49.205 DEBUG:teuthology.orchestra.run.trial011:> sudo sed -i -e 's/trial011.front.sepia.ceph.com/trial011/g' /etc/hostname
2026-02-25T13:50:49.267 DEBUG:teuthology.orchestra.run.trial011:> sudo hostname trial011
2026-02-25T13:50:49.330 DEBUG:teuthology.orchestra.run.trial011:> cat /etc/os-release
2026-02-25T13:50:49.400 INFO:teuthology.orchestra.run.trial011.stdout:NAME="CentOS Stream"
2026-02-25T13:50:49.400 INFO:teuthology.orchestra.run.trial011.stdout:VERSION="9"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:ID="centos"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:ID_LIKE="rhel fedora"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:VERSION_ID="9"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:PLATFORM_ID="platform:el9"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:ANSI_COLOR="0;31"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:LOGO="fedora-logo-icon"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:HOME_URL="https://centos.org/"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T13:50:49.401 INFO:teuthology.orchestra.run.trial011.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T13:50:49.402 INFO:teuthology.orchestra.run.trial011.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T13:50:49.403 INFO:teuthology.provision.fog.trial011:Deploy complete!
2026-02-25T13:50:49.404 DEBUG:teuthology.parallel:result is None
2026-02-25T13:50:50.984 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T13:50:50.984 DEBUG:teuthology.orchestra.run.trial084:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T13:50:51.137 INFO:teuthology.provision.fog.trial084:Node is ready
2026-02-25T13:50:51.137 DEBUG:teuthology.orchestra.run.trial084:> hostname
2026-02-25T13:50:51.192 INFO:teuthology.orchestra.run.trial084.stdout:trial084.front.sepia.ceph.com
2026-02-25T13:50:51.192 DEBUG:teuthology.orchestra.run.trial084:> grep trial084.front.sepia.ceph.com /etc/hosts
2026-02-25T13:50:51.248 INFO:teuthology.orchestra.run.trial084.stdout:10.20.193.84 trial084.front.sepia.ceph.com trial084
2026-02-25T13:50:51.249 DEBUG:teuthology.orchestra.run.trial084:> sudo hostname trial084
2026-02-25T13:50:51.318 DEBUG:teuthology.orchestra.run.trial084:> sudo sed -i -e 's/trial084.front.sepia.ceph.com/trial084/g' /etc/hosts
2026-02-25T13:50:51.382 DEBUG:teuthology.orchestra.run.trial084:> sudo sed -i -e 's/10.20.193.84/10.20.193.84/g' /etc/hosts
2026-02-25T13:50:51.446 DEBUG:teuthology.orchestra.run.trial084:> sudo sed -i -e 's/trial084.front.sepia.ceph.com/trial084/g' /etc/hostname
2026-02-25T13:50:51.509 DEBUG:teuthology.orchestra.run.trial084:> sudo hostname trial084
2026-02-25T13:50:51.572 DEBUG:teuthology.orchestra.run.trial084:> cat /etc/os-release
2026-02-25T13:50:51.628 INFO:teuthology.orchestra.run.trial084.stdout:NAME="CentOS Stream"
2026-02-25T13:50:51.628 INFO:teuthology.orchestra.run.trial084.stdout:VERSION="9"
2026-02-25T13:50:51.628 INFO:teuthology.orchestra.run.trial084.stdout:ID="centos"
2026-02-25T13:50:51.628 INFO:teuthology.orchestra.run.trial084.stdout:ID_LIKE="rhel fedora"
2026-02-25T13:50:51.628 INFO:teuthology.orchestra.run.trial084.stdout:VERSION_ID="9"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:PLATFORM_ID="platform:el9"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:ANSI_COLOR="0;31"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:LOGO="fedora-logo-icon"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:HOME_URL="https://centos.org/"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T13:50:51.629 INFO:teuthology.orchestra.run.trial084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T13:50:51.630 INFO:teuthology.provision.fog.trial084:Deploy complete!
2026-02-25T13:50:51.630 DEBUG:teuthology.parallel:result is None
2026-02-25T13:50:53.904 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T13:50:53.904 DEBUG:teuthology.orchestra.run.trial192:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T13:50:54.081 INFO:teuthology.provision.fog.trial192:Node is ready
2026-02-25T13:50:54.082 DEBUG:teuthology.orchestra.run.trial192:> hostname
2026-02-25T13:50:54.141 INFO:teuthology.orchestra.run.trial192.stdout:trial192.front.sepia.ceph.com
2026-02-25T13:50:54.142 DEBUG:teuthology.orchestra.run.trial192:> grep trial192.front.sepia.ceph.com /etc/hosts
2026-02-25T13:50:54.202 INFO:teuthology.orchestra.run.trial192.stdout:10.20.193.192 trial192.front.sepia.ceph.com trial192
2026-02-25T13:50:54.202 DEBUG:teuthology.orchestra.run.trial192:> sudo hostname trial192
2026-02-25T13:50:54.274 DEBUG:teuthology.orchestra.run.trial192:> sudo sed -i -e 's/trial192.front.sepia.ceph.com/trial192/g' /etc/hosts
2026-02-25T13:50:54.342 DEBUG:teuthology.orchestra.run.trial192:> sudo sed -i -e 's/10.20.193.192/10.20.193.192/g' /etc/hosts
2026-02-25T13:50:54.410 DEBUG:teuthology.orchestra.run.trial192:> sudo sed -i -e 's/trial192.front.sepia.ceph.com/trial192/g' /etc/hostname
2026-02-25T13:50:54.483 DEBUG:teuthology.orchestra.run.trial192:> sudo hostname trial192
2026-02-25T13:50:54.547 DEBUG:teuthology.orchestra.run.trial192:> cat /etc/os-release
2026-02-25T13:50:54.603 INFO:teuthology.orchestra.run.trial192.stdout:NAME="CentOS Stream"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:VERSION="9"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:ID="centos"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:ID_LIKE="rhel fedora"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:VERSION_ID="9"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:PLATFORM_ID="platform:el9"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:ANSI_COLOR="0;31"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:LOGO="fedora-logo-icon"
2026-02-25T13:50:54.604 INFO:teuthology.orchestra.run.trial192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T13:50:54.605 INFO:teuthology.orchestra.run.trial192.stdout:HOME_URL="https://centos.org/"
2026-02-25T13:50:54.605 INFO:teuthology.orchestra.run.trial192.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T13:50:54.605 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T13:50:54.605 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T13:50:54.605 INFO:teuthology.provision.fog.trial192:Deploy complete!
2026-02-25T13:50:54.606 DEBUG:teuthology.parallel:result is None
2026-02-25T13:50:55.141 INFO:teuthology.lock.ops:Checking trial011.front.sepia.ceph.com
2026-02-25T13:50:55.141 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T13:50:55.207 INFO:teuthology.lock.ops:Checking trial084.front.sepia.ceph.com
2026-02-25T13:50:55.207 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T13:50:55.265 INFO:teuthology.lock.ops:Checking trial192.front.sepia.ceph.com
2026-02-25T13:50:55.265 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T13:50:55.321 INFO:teuthology.lock.ops:Updating [trial011.front.sepia.ceph.com]: set os type and version on server
2026-02-25T13:50:55.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial011.front.sepia.ceph.com'
2026-02-25T13:50:55.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:50:55.382 DEBUG:teuthology.orchestra.run.trial011:> true
2026-02-25T13:50:55.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial011.front.sepia.ceph.com'
2026-02-25T13:50:55.455 DEBUG:teuthology.orchestra.run.trial011:> uname -m
2026-02-25T13:50:55.510 INFO:teuthology.orchestra.run.trial011.stdout:x86_64
2026-02-25T13:50:55.510 DEBUG:teuthology.orchestra.run.trial011:> cat /etc/os-release
2026-02-25T13:50:55.567 INFO:teuthology.orchestra.run.trial011.stdout:NAME="CentOS Stream"
2026-02-25T13:50:55.567 INFO:teuthology.orchestra.run.trial011.stdout:VERSION="9"
2026-02-25T13:50:55.567 INFO:teuthology.orchestra.run.trial011.stdout:ID="centos"
2026-02-25T13:50:55.567 INFO:teuthology.orchestra.run.trial011.stdout:ID_LIKE="rhel fedora"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:VERSION_ID="9"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:PLATFORM_ID="platform:el9"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:ANSI_COLOR="0;31"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:LOGO="fedora-logo-icon"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:HOME_URL="https://centos.org/"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T13:50:55.568 INFO:teuthology.orchestra.run.trial011.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T13:50:55.569 INFO:teuthology.lock.ops:Updating trial011.front.sepia.ceph.com on lock server
2026-02-25T13:50:55.673 INFO:teuthology.lock.ops:Updating [trial084.front.sepia.ceph.com]: set os type and version on server
2026-02-25T13:50:55.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial084.front.sepia.ceph.com'
2026-02-25T13:50:55.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:50:55.734 DEBUG:teuthology.orchestra.run.trial084:> true
2026-02-25T13:50:55.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial084.front.sepia.ceph.com'
2026-02-25T13:50:55.808 DEBUG:teuthology.orchestra.run.trial084:> uname -m
2026-02-25T13:50:55.864 INFO:teuthology.orchestra.run.trial084.stdout:x86_64
2026-02-25T13:50:55.864 DEBUG:teuthology.orchestra.run.trial084:> cat /etc/os-release
2026-02-25T13:50:55.921 INFO:teuthology.orchestra.run.trial084.stdout:NAME="CentOS Stream"
2026-02-25T13:50:55.921 INFO:teuthology.orchestra.run.trial084.stdout:VERSION="9"
2026-02-25T13:50:55.921 INFO:teuthology.orchestra.run.trial084.stdout:ID="centos"
2026-02-25T13:50:55.921 INFO:teuthology.orchestra.run.trial084.stdout:ID_LIKE="rhel fedora"
2026-02-25T13:50:55.921 INFO:teuthology.orchestra.run.trial084.stdout:VERSION_ID="9"
2026-02-25T13:50:55.922 INFO:teuthology.orchestra.run.trial084.stdout:PLATFORM_ID="platform:el9"
2026-02-25T13:50:55.922 INFO:teuthology.orchestra.run.trial084.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T13:50:55.922 INFO:teuthology.orchestra.run.trial084.stdout:ANSI_COLOR="0;31"
2026-02-25T13:50:55.922 INFO:teuthology.orchestra.run.trial084.stdout:LOGO="fedora-logo-icon"
2026-02-25T13:50:55.922 INFO:teuthology.orchestra.run.trial084.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T13:50:55.922 INFO:teuthology.orchestra.run.trial084.stdout:HOME_URL="https://centos.org/"
2026-02-25T13:50:55.922 INFO:teuthology.orchestra.run.trial084.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T13:50:55.923 INFO:teuthology.orchestra.run.trial084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T13:50:55.923 INFO:teuthology.orchestra.run.trial084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T13:50:55.924 INFO:teuthology.lock.ops:Updating trial084.front.sepia.ceph.com on lock server
2026-02-25T13:50:56.023 INFO:teuthology.lock.ops:Updating [trial192.front.sepia.ceph.com]: set os type and version on server
2026-02-25T13:50:56.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial192.front.sepia.ceph.com'
2026-02-25T13:50:56.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T13:50:56.086 DEBUG:teuthology.orchestra.run.trial192:> true
2026-02-25T13:50:56.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial192.front.sepia.ceph.com'
2026-02-25T13:50:56.157 DEBUG:teuthology.orchestra.run.trial192:> uname -m
2026-02-25T13:50:56.213 INFO:teuthology.orchestra.run.trial192.stdout:x86_64
2026-02-25T13:50:56.213 DEBUG:teuthology.orchestra.run.trial192:> cat /etc/os-release
2026-02-25T13:50:56.268 INFO:teuthology.orchestra.run.trial192.stdout:NAME="CentOS Stream"
2026-02-25T13:50:56.268 INFO:teuthology.orchestra.run.trial192.stdout:VERSION="9"
2026-02-25T13:50:56.268 INFO:teuthology.orchestra.run.trial192.stdout:ID="centos"
2026-02-25T13:50:56.268 INFO:teuthology.orchestra.run.trial192.stdout:ID_LIKE="rhel fedora"
2026-02-25T13:50:56.268 INFO:teuthology.orchestra.run.trial192.stdout:VERSION_ID="9"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:PLATFORM_ID="platform:el9"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:ANSI_COLOR="0;31"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:LOGO="fedora-logo-icon"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:HOME_URL="https://centos.org/"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-25T13:50:56.269 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-25T13:50:56.269 INFO:teuthology.lock.ops:Updating trial192.front.sepia.ceph.com on lock server
2026-02-25T13:50:56.342 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:50:56.432 INFO:teuthology.dispatcher.supervisor:Running job 69517
2026-02-25T13:50:56.432 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69517 --name vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/dbench}} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69517/orig.config.yaml
2026-02-25T13:50:56.432 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-25_09:28:04-fs-wip-vshankar-testing-20260224.100235-testing-default-trial/69517
2026-02-25T13:50:56.432 INFO:teuthology.dispatcher.supervisor:Job PID: 1790520
2026-02-25T13:50:56.432 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-25T13:52:56.533 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:54:56.708 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:56:56.900 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T13:58:57.117 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:00:57.312 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:02:57.490 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:04:57.694 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:06:57.794 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:08:57.970 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:10:58.167 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:12:58.354 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:14:58.536 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:16:58.733 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:18:58.896 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:20:59.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:22:59.285 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:24:59.466 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T14:24:59.547 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-25T14:24:59.715 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-25T14:25:00.429 INFO:teuthology.orchestra.console.trial011:Power off
2026-02-25T14:25:00.430 DEBUG:teuthology.orchestra.console.trial011:pexpect command: ipmitool -H trial011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T14:25:00.441 INFO:teuthology.orchestra.console.trial192:Power off
2026-02-25T14:25:00.441 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T14:25:00.452 INFO:teuthology.orchestra.console.trial084:Power off
2026-02-25T14:25:00.452 DEBUG:teuthology.orchestra.console.trial084:pexpect command: ipmitool -H trial084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T14:25:00.468 DEBUG:teuthology.orchestra.console.trial011:power off output: Chassis Power Control: Down/Off
2026-02-25T14:25:00.479 DEBUG:teuthology.orchestra.console.trial192:power off output: Chassis Power Control: Down/Off
2026-02-25T14:25:00.489 DEBUG:teuthology.orchestra.console.trial084:power off output: Chassis Power Control: Down/Off
2026-02-25T14:25:04.472 DEBUG:teuthology.orchestra.console.trial011:pexpect command: ipmitool -H trial011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T14:25:04.480 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T14:25:04.491 DEBUG:teuthology.orchestra.console.trial084:pexpect command: ipmitool -H trial084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T14:25:04.581 DEBUG:teuthology.orchestra.console.trial011:check power output: Chassis Power is on
2026-02-25T14:25:04.587 DEBUG:teuthology.orchestra.console.trial192:check power output: Chassis Power is on
2026-02-25T14:25:04.599 DEBUG:teuthology.orchestra.console.trial084:check power output: Chassis Power is on
2026-02-25T14:25:08.586 DEBUG:teuthology.orchestra.console.trial011:pexpect command: ipmitool -H trial011.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T14:25:08.595 DEBUG:teuthology.orchestra.console.trial192:pexpect command: ipmitool -H trial192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T14:25:08.602 DEBUG:teuthology.orchestra.console.trial084:pexpect command: ipmitool -H trial084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T14:25:08.697 DEBUG:teuthology.orchestra.console.trial011:check power output: Chassis Power is off
2026-02-25T14:25:08.697 INFO:teuthology.orchestra.console.trial011:Power off completed
2026-02-25T14:25:08.704 DEBUG:teuthology.orchestra.console.trial192:check power output: Chassis Power is off
2026-02-25T14:25:08.704 INFO:teuthology.orchestra.console.trial192:Power off completed
2026-02-25T14:25:08.712 DEBUG:teuthology.orchestra.console.trial084:check power output: Chassis Power is off
2026-02-25T14:25:08.712 INFO:teuthology.orchestra.console.trial084:Power off completed
2026-02-25T14:25:08.998 INFO:teuthology.lock.ops:unlocked: trial011.front.sepia.ceph.com
2026-02-25T14:25:09.007 INFO:teuthology.lock.ops:unlocked: trial192.front.sepia.ceph.com
2026-02-25T14:25:09.011 INFO:teuthology.lock.ops:unlocked: trial084.front.sepia.ceph.com