2026-02-12T21:53:34.159 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473
2026-02-12T21:53:34.160 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T21:53:34.231 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T21:53:34.479 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x78bc4d853050>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x78bc4d07a700>, signals=[15])
2026-02-12T21:53:34.479 INFO:teuthology.lock.ops:Start node 'trial093.front.sepia.ceph.com' reimaging
2026-02-12T21:53:34.479 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T21:53:34.479 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server
2026-02-12T21:53:34.536 INFO:teuthology.lock.ops:Start node 'trial096.front.sepia.ceph.com' reimaging
2026-02-12T21:53:34.536 INFO:teuthology.lock.ops:Updating [trial096.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T21:53:34.536 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server
2026-02-12T21:53:34.592 INFO:teuthology.lock.ops:Start node 'trial194.front.sepia.ceph.com' reimaging
2026-02-12T21:53:34.592 INFO:teuthology.lock.ops:Updating [trial194.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T21:53:34.592 INFO:teuthology.lock.ops:Updating trial194.front.sepia.ceph.com on lock server
2026-02-12T21:53:34.823 DEBUG:teuthology.provision.fog.trial096:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T21:53:34.823 DEBUG:teuthology.provision.fog.trial093:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T21:53:34.865 INFO:teuthology.provision.fog.trial093:Scheduling deploy of centos 9.stream
2026-02-12T21:53:34.879 INFO:teuthology.provision.fog.trial096:Scheduling deploy of centos 9.stream
2026-02-12T21:53:34.881 DEBUG:teuthology.provision.fog.trial194:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T21:53:34.927 INFO:teuthology.provision.fog.trial194:Scheduling deploy of centos 9.stream
2026-02-12T21:53:36.149 INFO:teuthology.orchestra.console.trial194:Power off
2026-02-12T21:53:36.149 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T21:53:36.170 INFO:teuthology.orchestra.console.trial096:Power off
2026-02-12T21:53:36.170 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T21:53:36.187 DEBUG:teuthology.orchestra.console.trial194:power off output: Chassis Power Control: Down/Off
2026-02-12T21:53:36.206 DEBUG:teuthology.orchestra.console.trial096:power off output: Chassis Power Control: Down/Off
2026-02-12T21:53:36.991 INFO:teuthology.orchestra.console.trial093:Power off
2026-02-12T21:53:36.991 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T21:53:37.029 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off
2026-02-12T21:53:40.191 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:53:40.207 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:53:40.301 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is off
2026-02-12T21:53:40.302 INFO:teuthology.orchestra.console.trial194:Power off completed
2026-02-12T21:53:40.315 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off
2026-02-12T21:53:40.316 INFO:teuthology.orchestra.console.trial096:Power off completed
2026-02-12T21:53:40.403 INFO:teuthology.orchestra.console.trial194:Power on
2026-02-12T21:53:40.403 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T21:53:40.417 INFO:teuthology.orchestra.console.trial096:Power on
2026-02-12T21:53:40.417 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T21:53:40.441 DEBUG:teuthology.orchestra.console.trial194:power on output: Chassis Power Control: Up/On
2026-02-12T21:53:40.455 DEBUG:teuthology.orchestra.console.trial096:power on output: Chassis Power Control: Up/On
2026-02-12T21:53:41.030 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:53:41.139 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off
2026-02-12T21:53:41.139 INFO:teuthology.orchestra.console.trial093:Power off completed
2026-02-12T21:53:41.240 INFO:teuthology.orchestra.console.trial093:Power on
2026-02-12T21:53:41.240 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T21:53:41.278 DEBUG:teuthology.orchestra.console.trial093:power on output: Chassis Power Control: Up/On
2026-02-12T21:53:44.446 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:53:44.455 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:53:44.556 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is on
2026-02-12T21:53:44.557 INFO:teuthology.orchestra.console.trial194:Power on completed
2026-02-12T21:53:44.565 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off
2026-02-12T21:53:44.658 INFO:teuthology.provision.fog.trial194:Waiting for deploy to finish
2026-02-12T21:53:45.280 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:53:45.389 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on
2026-02-12T21:53:45.390 INFO:teuthology.orchestra.console.trial093:Power on completed
2026-02-12T21:53:45.490 INFO:teuthology.provision.fog.trial093:Waiting for deploy to finish
2026-02-12T21:53:48.569 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T21:53:48.678 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is on
2026-02-12T21:53:48.679 INFO:teuthology.orchestra.console.trial096:Power on completed
2026-02-12T21:53:48.779 INFO:teuthology.provision.fog.trial096:Waiting for deploy to finish
2026-02-12T21:55:31.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:55:32.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:55:35.005 WARNING:teuthology.provision.fog.trial194:[Errno None] Unable to connect to port 22 on 10.20.193.194
2026-02-12T21:55:35.837 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-12T21:55:41.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:55:41.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:55:44.093 WARNING:teuthology.provision.fog.trial194:[Errno None] Unable to connect to port 22 on 10.20.193.194
2026-02-12T21:55:44.925 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-12T21:55:50.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:55:50.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:55:53.181 WARNING:teuthology.provision.fog.trial194:[Errno None] Unable to connect to port 22 on 10.20.193.194
2026-02-12T21:55:54.013 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-12T21:55:59.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:00.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:02.269 WARNING:teuthology.provision.fog.trial194:[Errno None] Unable to connect to port 22 on 10.20.193.194
2026-02-12T21:56:03.101 WARNING:teuthology.provision.fog.trial093:[Errno None] Unable to connect to port 22 on 10.20.193.93
2026-02-12T21:56:08.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:09.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:11.357 WARNING:teuthology.provision.fog.trial194:[Errno None] Unable to connect to port 22 on 10.20.193.194
2026-02-12T21:56:17.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:20.445 WARNING:teuthology.provision.fog.trial194:[Errno None] Unable to connect to port 22 on 10.20.193.194
2026-02-12T21:56:21.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:24.797 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96
2026-02-12T21:56:26.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:29.533 WARNING:teuthology.provision.fog.trial194:[Errno None] Unable to connect to port 22 on 10.20.193.194
2026-02-12T21:56:30.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:33.885 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96
2026-02-12T21:56:35.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:38.621 WARNING:teuthology.provision.fog.trial194:[Errno None] Unable to connect to port 22 on 10.20.193.194
2026-02-12T21:56:39.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:42.973 WARNING:teuthology.provision.fog.trial096:[Errno None] Unable to connect to port 22 on 10.20.193.96
2026-02-12T21:56:44.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:44.967 ERROR:teuthology.orchestra.connection:Error authenticating with trial093.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-12T21:56:48.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:56:49.078 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T21:56:49.078 DEBUG:teuthology.orchestra.run.trial093:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T21:56:49.311 INFO:teuthology.provision.fog.trial093:Node is ready
2026-02-12T21:56:49.312 DEBUG:teuthology.orchestra.run.trial093:> hostname
2026-02-12T21:56:49.371 INFO:teuthology.orchestra.run.trial093.stdout:trial093.front.sepia.ceph.com
2026-02-12T21:56:49.372 DEBUG:teuthology.orchestra.run.trial093:> grep trial093.front.sepia.ceph.com /etc/hosts
2026-02-12T21:56:49.431 INFO:teuthology.orchestra.run.trial093.stdout:10.20.193.93 trial093.front.sepia.ceph.com trial093
2026-02-12T21:56:49.432 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093
2026-02-12T21:56:49.506 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hosts
2026-02-12T21:56:49.573 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/10.20.193.93/10.20.193.93/g' /etc/hosts
2026-02-12T21:56:49.640 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i -e 's/trial093.front.sepia.ceph.com/trial093/g' /etc/hostname
2026-02-12T21:56:49.709 DEBUG:teuthology.orchestra.run.trial093:> sudo hostname trial093
2026-02-12T21:56:49.776 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release
2026-02-12T21:56:49.865 INFO:teuthology.orchestra.run.trial093.stdout:NAME="CentOS Stream"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="9"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:ID="centos"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel fedora"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="9"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el9"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;31"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T21:56:49.866 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://centos.org/"
2026-02-12T21:56:49.867 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T21:56:49.867 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T21:56:49.867 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T21:56:49.868 INFO:teuthology.provision.fog.trial093:Deploy complete!
2026-02-12T21:56:49.869 DEBUG:teuthology.parallel:result is None
2026-02-12T21:57:20.802 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T21:57:20.802 DEBUG:teuthology.orchestra.run.trial194:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T21:57:20.955 INFO:teuthology.provision.fog.trial194:Node is ready
2026-02-12T21:57:20.955 DEBUG:teuthology.orchestra.run.trial194:> hostname
2026-02-12T21:57:21.011 INFO:teuthology.orchestra.run.trial194.stdout:trial194.front.sepia.ceph.com
2026-02-12T21:57:21.011 DEBUG:teuthology.orchestra.run.trial194:> grep trial194.front.sepia.ceph.com /etc/hosts
2026-02-12T21:57:21.067 INFO:teuthology.orchestra.run.trial194.stdout:10.20.193.194 trial194.front.sepia.ceph.com trial194
2026-02-12T21:57:21.068 DEBUG:teuthology.orchestra.run.trial194:> sudo hostname trial194
2026-02-12T21:57:21.136 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/trial194.front.sepia.ceph.com/trial194/g' /etc/hosts
2026-02-12T21:57:21.200 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/10.20.193.194/10.20.193.194/g' /etc/hosts
2026-02-12T21:57:21.265 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i -e 's/trial194.front.sepia.ceph.com/trial194/g' /etc/hostname
2026-02-12T21:57:21.329 DEBUG:teuthology.orchestra.run.trial194:> sudo hostname trial194
2026-02-12T21:57:21.393 DEBUG:teuthology.orchestra.run.trial194:> cat /etc/os-release
2026-02-12T21:57:21.449 INFO:teuthology.orchestra.run.trial194.stdout:NAME="CentOS Stream"
2026-02-12T21:57:21.449 INFO:teuthology.orchestra.run.trial194.stdout:VERSION="9"
2026-02-12T21:57:21.449 INFO:teuthology.orchestra.run.trial194.stdout:ID="centos"
2026-02-12T21:57:21.449 INFO:teuthology.orchestra.run.trial194.stdout:ID_LIKE="rhel fedora"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:VERSION_ID="9"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:PLATFORM_ID="platform:el9"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:ANSI_COLOR="0;31"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:HOME_URL="https://centos.org/"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T21:57:21.450 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T21:57:21.451 INFO:teuthology.provision.fog.trial194:Deploy complete!
2026-02-12T21:57:21.452 DEBUG:teuthology.parallel:result is None
2026-02-12T21:57:24.899 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T21:57:24.899 DEBUG:teuthology.orchestra.run.trial096:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T21:57:25.117 INFO:teuthology.provision.fog.trial096:Node is ready
2026-02-12T21:57:25.118 DEBUG:teuthology.orchestra.run.trial096:> hostname
2026-02-12T21:57:25.174 INFO:teuthology.orchestra.run.trial096.stdout:trial096.front.sepia.ceph.com
2026-02-12T21:57:25.174 DEBUG:teuthology.orchestra.run.trial096:> grep trial096.front.sepia.ceph.com /etc/hosts
2026-02-12T21:57:25.232 INFO:teuthology.orchestra.run.trial096.stdout:10.20.193.96 trial096.front.sepia.ceph.com trial096
2026-02-12T21:57:25.233 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname trial096
2026-02-12T21:57:25.302 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/trial096.front.sepia.ceph.com/trial096/g' /etc/hosts
2026-02-12T21:57:25.369 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/10.20.193.96/10.20.193.96/g' /etc/hosts
2026-02-12T21:57:25.434 DEBUG:teuthology.orchestra.run.trial096:> sudo sed -i -e 's/trial096.front.sepia.ceph.com/trial096/g' /etc/hostname
2026-02-12T21:57:25.499 DEBUG:teuthology.orchestra.run.trial096:> sudo hostname trial096
2026-02-12T21:57:25.563 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release
2026-02-12T21:57:25.619 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream"
2026-02-12T21:57:25.619 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T21:57:25.620 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T21:57:25.621 INFO:teuthology.provision.fog.trial096:Deploy complete!
2026-02-12T21:57:25.622 DEBUG:teuthology.parallel:result is None
2026-02-12T21:57:26.149 INFO:teuthology.lock.ops:Checking trial093.front.sepia.ceph.com
2026-02-12T21:57:26.149 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T21:57:26.254 INFO:teuthology.lock.ops:Checking trial096.front.sepia.ceph.com
2026-02-12T21:57:26.254 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T21:57:26.316 INFO:teuthology.lock.ops:Checking trial194.front.sepia.ceph.com
2026-02-12T21:57:26.316 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T21:57:26.373 INFO:teuthology.lock.ops:Updating [trial093.front.sepia.ceph.com]: set os type and version on server
2026-02-12T21:57:26.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com'
2026-02-12T21:57:26.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:57:26.434 DEBUG:teuthology.orchestra.run.trial093:> true
2026-02-12T21:57:26.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com'
2026-02-12T21:57:26.576 DEBUG:teuthology.orchestra.run.trial093:> uname -m
2026-02-12T21:57:26.633 INFO:teuthology.orchestra.run.trial093.stdout:x86_64
2026-02-12T21:57:26.633 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:NAME="CentOS Stream"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="9"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:ID="centos"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel fedora"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="9"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el9"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;31"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://centos.org/"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T21:57:26.689 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T21:57:26.690 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T21:57:26.690 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server
2026-02-12T21:57:26.773 INFO:teuthology.lock.ops:Updating [trial096.front.sepia.ceph.com]: set os type and version on server
2026-02-12T21:57:26.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial096.front.sepia.ceph.com'
2026-02-12T21:57:26.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:57:26.837 DEBUG:teuthology.orchestra.run.trial096:> true
2026-02-12T21:57:26.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial096.front.sepia.ceph.com'
2026-02-12T21:57:26.916 DEBUG:teuthology.orchestra.run.trial096:> uname -m
2026-02-12T21:57:26.972 INFO:teuthology.orchestra.run.trial096.stdout:x86_64
2026-02-12T21:57:26.973 DEBUG:teuthology.orchestra.run.trial096:> cat /etc/os-release
2026-02-12T21:57:27.028 INFO:teuthology.orchestra.run.trial096.stdout:NAME="CentOS Stream"
2026-02-12T21:57:27.028 INFO:teuthology.orchestra.run.trial096.stdout:VERSION="9"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:ID="centos"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:ID_LIKE="rhel fedora"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:VERSION_ID="9"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:PLATFORM_ID="platform:el9"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:ANSI_COLOR="0;31"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:HOME_URL="https://centos.org/"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T21:57:27.029 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T21:57:27.030 INFO:teuthology.orchestra.run.trial096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T21:57:27.030 INFO:teuthology.lock.ops:Updating trial096.front.sepia.ceph.com on lock server
2026-02-12T21:57:27.133 INFO:teuthology.lock.ops:Updating [trial194.front.sepia.ceph.com]: set os type and version on server
2026-02-12T21:57:27.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com'
2026-02-12T21:57:27.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T21:57:27.193 DEBUG:teuthology.orchestra.run.trial194:> true
2026-02-12T21:57:27.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial194.front.sepia.ceph.com'
2026-02-12T21:57:27.266 DEBUG:teuthology.orchestra.run.trial194:> uname -m
2026-02-12T21:57:27.322 INFO:teuthology.orchestra.run.trial194.stdout:x86_64
2026-02-12T21:57:27.322 DEBUG:teuthology.orchestra.run.trial194:> cat /etc/os-release
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:NAME="CentOS Stream"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:VERSION="9"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:ID="centos"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:ID_LIKE="rhel fedora"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:VERSION_ID="9"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:PLATFORM_ID="platform:el9"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:ANSI_COLOR="0;31"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:LOGO="fedora-logo-icon"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:HOME_URL="https://centos.org/"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T21:57:27.378 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T21:57:27.379 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T21:57:27.379 INFO:teuthology.lock.ops:Updating trial194.front.sepia.ceph.com on lock server
2026-02-12T21:57:27.460 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T21:57:27.553 INFO:teuthology.dispatcher.supervisor:Running job 47092
2026-02-12T21:57:27.553 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47092 --name pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47092/orig.config.yaml
2026-02-12T21:57:27.553 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47092
2026-02-12T21:57:27.553 INFO:teuthology.dispatcher.supervisor:Job PID: 816002
2026-02-12T21:57:27.553 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T21:59:27.654 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:01:27.800 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:03:27.926 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:05:28.128 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T22:05:28.217 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-12T22:05:28.384 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T22:05:29.044 INFO:teuthology.orchestra.console.trial093:Power off
2026-02-12T22:05:29.045 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:05:29.098 INFO:teuthology.orchestra.console.trial194:Power off
2026-02-12T22:05:29.098 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:05:29.105 DEBUG:teuthology.orchestra.console.trial093:power off output: Chassis Power Control: Down/Off
2026-02-12T22:05:29.116 INFO:teuthology.orchestra.console.trial096:Power off
2026-02-12T22:05:29.116 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T22:05:29.135 DEBUG:teuthology.orchestra.console.trial194:power off output: Chassis Power Control: Down/Off
2026-02-12T22:05:29.159 DEBUG:teuthology.orchestra.console.trial096:power off output: Chassis Power Control: Down/Off
2026-02-12T22:05:33.110 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:05:33.135 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:05:33.159 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:05:33.218 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is on
2026-02-12T22:05:33.244 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is on
2026-02-12T22:05:33.268 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is on
2026-02-12T22:05:37.223 DEBUG:teuthology.orchestra.console.trial093:pexpect command: ipmitool -H trial093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:05:37.245 DEBUG:teuthology.orchestra.console.trial194:pexpect command: ipmitool -H trial194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:05:37.269 DEBUG:teuthology.orchestra.console.trial096:pexpect command: ipmitool -H trial096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T22:05:37.333 DEBUG:teuthology.orchestra.console.trial093:check power output: Chassis Power is off
2026-02-12T22:05:37.333 INFO:teuthology.orchestra.console.trial093:Power off completed
2026-02-12T22:05:37.355 DEBUG:teuthology.orchestra.console.trial194:check power output: Chassis Power is off
2026-02-12T22:05:37.355 INFO:teuthology.orchestra.console.trial194:Power off completed
2026-02-12T22:05:37.379 DEBUG:teuthology.orchestra.console.trial096:check power output: Chassis Power is off
2026-02-12T22:05:37.379 INFO:teuthology.orchestra.console.trial096:Power off completed
2026-02-12T22:05:37.622 INFO:teuthology.lock.ops:unlocked: trial093.front.sepia.ceph.com
2026-02-12T22:05:37.630 INFO:teuthology.lock.ops:unlocked: trial194.front.sepia.ceph.com
2026-02-12T22:05:37.634 INFO:teuthology.lock.ops:unlocked: trial096.front.sepia.ceph.com