2026-02-23T18:35:34.451 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T18:35:34.451 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:35:34.525 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:35:34.861 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x70b5336abce0>, signals=[15]) 2026-02-23T18:35:34.861 INFO:teuthology.lock.ops:Start node 'trial012.front.sepia.ceph.com' reimaging 2026-02-23T18:35:34.861 INFO:teuthology.lock.ops:Updating [trial012.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T18:35:34.861 INFO:teuthology.lock.ops:Updating trial012.front.sepia.ceph.com on lock server 2026-02-23T18:35:34.923 INFO:teuthology.lock.ops:Start node 'trial048.front.sepia.ceph.com' reimaging 2026-02-23T18:35:34.923 INFO:teuthology.lock.ops:Updating [trial048.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T18:35:34.923 INFO:teuthology.lock.ops:Updating trial048.front.sepia.ceph.com on lock server 2026-02-23T18:35:34.983 INFO:teuthology.lock.ops:Start node 'trial111.front.sepia.ceph.com' reimaging 2026-02-23T18:35:34.983 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T18:35:34.983 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server 2026-02-23T18:35:35.081 INFO:teuthology.lock.ops:Start node 'trial142.front.sepia.ceph.com' reimaging 2026-02-23T18:35:35.081 INFO:teuthology.lock.ops:Updating [trial142.front.sepia.ceph.com]: reset os type and version on server 2026-02-23T18:35:35.081 INFO:teuthology.lock.ops:Updating trial142.front.sepia.ceph.com on lock server 2026-02-23T18:35:35.266 DEBUG:teuthology.provision.fog.trial048:Requesting image trial_rocky_10.1 (ID 4) 2026-02-23T18:35:35.266 DEBUG:teuthology.provision.fog.trial012:Requesting image trial_rocky_10.1 (ID 4) 2026-02-23T18:35:35.321 INFO:teuthology.provision.fog.trial048:Scheduling deploy of rocky 10.1 2026-02-23T18:35:35.360 DEBUG:teuthology.provision.fog.trial111:Requesting image trial_rocky_10.1 (ID 4) 2026-02-23T18:35:35.373 INFO:teuthology.provision.fog.trial012:Scheduling deploy of rocky 10.1 2026-02-23T18:35:35.375 DEBUG:teuthology.provision.fog.trial142:Requesting image trial_rocky_10.1 (ID 4) 2026-02-23T18:35:35.409 INFO:teuthology.provision.fog.trial111:Scheduling deploy of rocky 10.1 2026-02-23T18:35:35.427 INFO:teuthology.provision.fog.trial142:Scheduling deploy of rocky 10.1 2026-02-23T18:35:37.331 INFO:teuthology.orchestra.console.trial048:Power off 2026-02-23T18:35:37.331 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T18:35:37.396 INFO:teuthology.orchestra.console.trial012:Power off 2026-02-23T18:35:37.397 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T18:35:37.405 INFO:teuthology.orchestra.console.trial142:Power off 2026-02-23T18:35:37.405 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T18:35:37.412 DEBUG:teuthology.orchestra.console.trial048:power off output: Chassis Power Control: Down/Off 2026-02-23T18:35:37.429 INFO:teuthology.orchestra.console.trial111:Power off 2026-02-23T18:35:37.429 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T18:35:37.437 DEBUG:teuthology.orchestra.console.trial012:power off output: Chassis Power Control: Down/Off 2026-02-23T18:35:37.448 DEBUG:teuthology.orchestra.console.trial142:power off output: Chassis Power Control: Down/Off 2026-02-23T18:35:37.467 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off 2026-02-23T18:35:41.416 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:41.437 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:41.448 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:41.467 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:41.527 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is off 2026-02-23T18:35:41.527 INFO:teuthology.orchestra.console.trial048:Power off completed 2026-02-23T18:35:41.546 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is off 2026-02-23T18:35:41.546 INFO:teuthology.orchestra.console.trial012:Power off completed 2026-02-23T18:35:41.556 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is off 2026-02-23T18:35:41.556 INFO:teuthology.orchestra.console.trial142:Power off completed 2026-02-23T18:35:41.575 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off 2026-02-23T18:35:41.575 INFO:teuthology.orchestra.console.trial111:Power off completed 2026-02-23T18:35:41.629 INFO:teuthology.orchestra.console.trial048:Power on 2026-02-23T18:35:41.629 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T18:35:41.647 INFO:teuthology.orchestra.console.trial012:Power on 2026-02-23T18:35:41.648 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T18:35:41.656 INFO:teuthology.orchestra.console.trial142:Power on 2026-02-23T18:35:41.657 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T18:35:41.673 DEBUG:teuthology.orchestra.console.trial048:power on output: Chassis Power Control: Up/On 2026-02-23T18:35:41.676 INFO:teuthology.orchestra.console.trial111:Power on 2026-02-23T18:35:41.676 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-23T18:35:41.687 DEBUG:teuthology.orchestra.console.trial012:power on output: Chassis Power Control: Up/On 2026-02-23T18:35:41.696 DEBUG:teuthology.orchestra.console.trial142:power on output: Chassis Power Control: Up/On 2026-02-23T18:35:41.714 DEBUG:teuthology.orchestra.console.trial111:power on output: Chassis Power Control: Up/On 2026-02-23T18:35:45.677 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:45.688 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:45.697 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:45.714 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:45.786 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is on 2026-02-23T18:35:45.786 INFO:teuthology.orchestra.console.trial048:Power on completed 2026-02-23T18:35:45.798 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is on 2026-02-23T18:35:45.798 INFO:teuthology.orchestra.console.trial012:Power on completed 2026-02-23T18:35:45.804 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is off 2026-02-23T18:35:45.821 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on 2026-02-23T18:35:45.821 INFO:teuthology.orchestra.console.trial111:Power on completed 2026-02-23T18:35:45.887 INFO:teuthology.provision.fog.trial048:Waiting for deploy to finish 2026-02-23T18:35:45.899 INFO:teuthology.provision.fog.trial012:Waiting for deploy to finish 2026-02-23T18:35:45.921 INFO:teuthology.provision.fog.trial111:Waiting for deploy to finish 2026-02-23T18:35:49.809 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T18:35:49.916 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is on 2026-02-23T18:35:49.916 INFO:teuthology.orchestra.console.trial142:Power on completed 2026-02-23T18:35:50.017 INFO:teuthology.provision.fog.trial142:Waiting for deploy to finish 2026-02-23T18:37:33.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:34.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:34.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:37.344 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111 2026-02-23T18:37:37.344 WARNING:teuthology.provision.fog.trial048:[Errno None] Unable to connect to port 22 on 10.20.193.48 2026-02-23T18:37:38.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:41.120 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-23T18:37:43.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:43.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:46.432 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111 2026-02-23T18:37:46.432 WARNING:teuthology.provision.fog.trial048:[Errno None] Unable to connect to port 22 on 10.20.193.48 2026-02-23T18:37:47.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:48.224 WARNING:teuthology.provision.fog.trial012:[Errno None] Unable to connect to port 22 on 10.20.193.12 2026-02-23T18:37:50.207 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-23T18:37:52.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:52.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:54.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:55.519 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111 2026-02-23T18:37:55.520 WARNING:teuthology.provision.fog.trial048:[Errno None] Unable to connect to port 22 on 10.20.193.48 2026-02-23T18:37:56.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:37:57.311 WARNING:teuthology.provision.fog.trial012:[Errno None] Unable to connect to port 22 on 10.20.193.12 2026-02-23T18:37:59.296 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-23T18:38:01.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:01.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:03.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:04.608 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111 2026-02-23T18:38:04.608 WARNING:teuthology.provision.fog.trial048:[Errno None] Unable to connect to port 22 on 10.20.193.48 2026-02-23T18:38:05.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:06.400 WARNING:teuthology.provision.fog.trial012:[Errno None] Unable to connect to port 22 on 10.20.193.12 2026-02-23T18:38:08.384 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-23T18:38:10.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:10.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:12.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:13.696 WARNING:teuthology.provision.fog.trial111:[Errno None] Unable to connect to port 22 on 10.20.193.111 2026-02-23T18:38:13.696 WARNING:teuthology.provision.fog.trial048:[Errno None] Unable to connect to port 22 on 10.20.193.48 2026-02-23T18:38:14.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:15.488 WARNING:teuthology.provision.fog.trial012:[Errno None] Unable to connect to port 22 on 10.20.193.12 2026-02-23T18:38:17.472 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-23T18:38:19.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:19.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:21.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:23.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:26.559 WARNING:teuthology.provision.fog.trial142:[Errno None] Unable to connect to port 22 on 10.20.193.142 2026-02-23T18:38:32.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:38:55.458 ERROR:teuthology.orchestra.connection:Error authenticating with trial111.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2026-02-23T18:38:57.490 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T18:38:57.490 DEBUG:teuthology.orchestra.run.trial012:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T18:38:59.570 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T18:38:59.570 DEBUG:teuthology.orchestra.run.trial111:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T18:39:02.777 INFO:teuthology.provision.fog.trial012:Node is ready 2026-02-23T18:39:02.777 DEBUG:teuthology.orchestra.run.trial012:> hostname 2026-02-23T18:39:02.795 INFO:teuthology.orchestra.run.trial012.stdout:trial012.front.sepia.ceph.com 2026-02-23T18:39:02.796 DEBUG:teuthology.orchestra.run.trial012:> grep trial012.front.sepia.ceph.com /etc/hosts 2026-02-23T18:39:02.852 INFO:teuthology.orchestra.run.trial012.stdout:10.20.193.12 trial012.front.sepia.ceph.com trial012 2026-02-23T18:39:02.853 DEBUG:teuthology.orchestra.run.trial012:> sudo hostname trial012 2026-02-23T18:39:02.926 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/trial012.front.sepia.ceph.com/trial012/g' /etc/hosts 2026-02-23T18:39:02.993 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/10.20.193.12/10.20.193.12/g' /etc/hosts 2026-02-23T18:39:03.060 DEBUG:teuthology.orchestra.run.trial012:> sudo sed -i -e 's/trial012.front.sepia.ceph.com/trial012/g' /etc/hostname 2026-02-23T18:39:03.126 DEBUG:teuthology.orchestra.run.trial012:> sudo hostname trial012 2026-02-23T18:39:03.192 DEBUG:teuthology.orchestra.run.trial012:> cat /etc/os-release 2026-02-23T18:39:03.250 INFO:teuthology.orchestra.run.trial012.stdout:NAME="Rocky Linux" 2026-02-23T18:39:03.250 INFO:teuthology.orchestra.run.trial012.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:ID="rocky" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:VERSION_ID="10.1" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:PLATFORM_ID="platform:el10" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:ANSI_COLOR="0;32" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:LOGO="fedora-logo-icon" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:VENDOR_NAME="RESF" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:SUPPORT_END="2035-05-31" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T18:39:03.251 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:03.252 INFO:teuthology.provision.fog.trial012:Deploy complete! 2026-02-23T18:39:03.252 DEBUG:teuthology.parallel:result is None 2026-02-23T18:39:05.039 INFO:teuthology.provision.fog.trial111:Node is ready 2026-02-23T18:39:05.040 DEBUG:teuthology.orchestra.run.trial111:> hostname 2026-02-23T18:39:05.058 INFO:teuthology.orchestra.run.trial111.stdout:trial111.front.sepia.ceph.com 2026-02-23T18:39:05.058 DEBUG:teuthology.orchestra.run.trial111:> grep trial111.front.sepia.ceph.com /etc/hosts 2026-02-23T18:39:05.115 INFO:teuthology.orchestra.run.trial111.stdout:10.20.193.111 trial111.front.sepia.ceph.com trial111 2026-02-23T18:39:05.115 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111 2026-02-23T18:39:05.186 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hosts 2026-02-23T18:39:05.254 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/10.20.193.111/10.20.193.111/g' /etc/hosts 2026-02-23T18:39:05.322 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i -e 's/trial111.front.sepia.ceph.com/trial111/g' /etc/hostname 2026-02-23T18:39:05.389 DEBUG:teuthology.orchestra.run.trial111:> sudo hostname trial111 2026-02-23T18:39:05.456 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:NAME="Rocky Linux" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:ID="rocky" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="10.1" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el10" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;32" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T18:39:05.514 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_NAME="RESF" 2026-02-23T18:39:05.515 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T18:39:05.515 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T18:39:05.515 INFO:teuthology.orchestra.run.trial111.stdout:SUPPORT_END="2035-05-31" 2026-02-23T18:39:05.515 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T18:39:05.515 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:05.515 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T18:39:05.515 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:05.515 INFO:teuthology.provision.fog.trial111:Deploy complete! 2026-02-23T18:39:05.516 DEBUG:teuthology.parallel:result is None 2026-02-23T18:39:08.751 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T18:39:08.751 DEBUG:teuthology.orchestra.run.trial142:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T18:39:14.510 INFO:teuthology.provision.fog.trial142:Node is ready 2026-02-23T18:39:14.510 DEBUG:teuthology.orchestra.run.trial142:> hostname 2026-02-23T18:39:14.527 INFO:teuthology.orchestra.run.trial142.stdout:trial142.front.sepia.ceph.com 2026-02-23T18:39:14.527 DEBUG:teuthology.orchestra.run.trial142:> grep trial142.front.sepia.ceph.com /etc/hosts 2026-02-23T18:39:14.588 INFO:teuthology.orchestra.run.trial142.stdout:10.20.193.142 trial142.front.sepia.ceph.com trial142 2026-02-23T18:39:14.588 DEBUG:teuthology.orchestra.run.trial142:> sudo hostname trial142 2026-02-23T18:39:14.664 DEBUG:teuthology.orchestra.run.trial142:> sudo sed -i -e 's/trial142.front.sepia.ceph.com/trial142/g' /etc/hosts 2026-02-23T18:39:14.735 DEBUG:teuthology.orchestra.run.trial142:> sudo sed -i -e 's/10.20.193.142/10.20.193.142/g' /etc/hosts 2026-02-23T18:39:14.805 DEBUG:teuthology.orchestra.run.trial142:> sudo sed -i -e 's/trial142.front.sepia.ceph.com/trial142/g' /etc/hostname 2026-02-23T18:39:14.876 DEBUG:teuthology.orchestra.run.trial142:> sudo hostname trial142 2026-02-23T18:39:14.946 DEBUG:teuthology.orchestra.run.trial142:> cat /etc/os-release 2026-02-23T18:39:15.008 INFO:teuthology.orchestra.run.trial142.stdout:NAME="Rocky Linux" 2026-02-23T18:39:15.009 INFO:teuthology.orchestra.run.trial142.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T18:39:15.009 INFO:teuthology.orchestra.run.trial142.stdout:ID="rocky" 2026-02-23T18:39:15.009 INFO:teuthology.orchestra.run.trial142.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T18:39:15.009 INFO:teuthology.orchestra.run.trial142.stdout:VERSION_ID="10.1" 2026-02-23T18:39:15.009 INFO:teuthology.orchestra.run.trial142.stdout:PLATFORM_ID="platform:el10" 2026-02-23T18:39:15.010 INFO:teuthology.orchestra.run.trial142.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T18:39:15.010 INFO:teuthology.orchestra.run.trial142.stdout:ANSI_COLOR="0;32" 2026-02-23T18:39:15.010 INFO:teuthology.orchestra.run.trial142.stdout:LOGO="fedora-logo-icon" 2026-02-23T18:39:15.010 INFO:teuthology.orchestra.run.trial142.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T18:39:15.010 INFO:teuthology.orchestra.run.trial142.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T18:39:15.010 INFO:teuthology.orchestra.run.trial142.stdout:VENDOR_NAME="RESF" 2026-02-23T18:39:15.011 INFO:teuthology.orchestra.run.trial142.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T18:39:15.011 INFO:teuthology.orchestra.run.trial142.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T18:39:15.011 INFO:teuthology.orchestra.run.trial142.stdout:SUPPORT_END="2035-05-31" 2026-02-23T18:39:15.011 INFO:teuthology.orchestra.run.trial142.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T18:39:15.011 INFO:teuthology.orchestra.run.trial142.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:15.011 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T18:39:15.012 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:15.012 INFO:teuthology.provision.fog.trial142:Deploy complete! 2026-02-23T18:39:15.013 DEBUG:teuthology.parallel:result is None 2026-02-23T18:39:19.706 WARNING:teuthology.provision.fog.trial048:timed out 2026-02-23T18:39:25.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:39:25.797 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-23T18:39:25.797 DEBUG:teuthology.orchestra.run.trial048:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-23T18:39:25.971 INFO:teuthology.provision.fog.trial048:Node is ready 2026-02-23T18:39:25.972 DEBUG:teuthology.orchestra.run.trial048:> hostname 2026-02-23T18:39:26.029 INFO:teuthology.orchestra.run.trial048.stdout:trial048.front.sepia.ceph.com 2026-02-23T18:39:26.029 DEBUG:teuthology.orchestra.run.trial048:> grep trial048.front.sepia.ceph.com /etc/hosts 2026-02-23T18:39:26.086 INFO:teuthology.orchestra.run.trial048.stdout:10.20.193.48 trial048.front.sepia.ceph.com trial048 2026-02-23T18:39:26.086 DEBUG:teuthology.orchestra.run.trial048:> sudo hostname trial048 2026-02-23T18:39:26.158 DEBUG:teuthology.orchestra.run.trial048:> sudo sed -i -e 's/trial048.front.sepia.ceph.com/trial048/g' /etc/hosts 2026-02-23T18:39:26.227 DEBUG:teuthology.orchestra.run.trial048:> sudo sed -i -e 's/10.20.193.48/10.20.193.48/g' /etc/hosts 2026-02-23T18:39:26.293 DEBUG:teuthology.orchestra.run.trial048:> sudo sed -i -e 's/trial048.front.sepia.ceph.com/trial048/g' /etc/hostname 2026-02-23T18:39:26.359 DEBUG:teuthology.orchestra.run.trial048:> sudo hostname trial048 2026-02-23T18:39:26.425 DEBUG:teuthology.orchestra.run.trial048:> cat /etc/os-release 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:NAME="Rocky Linux" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:ID="rocky" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:VERSION_ID="10.1" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:PLATFORM_ID="platform:el10" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:ANSI_COLOR="0;32" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:LOGO="fedora-logo-icon" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_NAME="RESF" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:SUPPORT_END="2035-05-31" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T18:39:26.483 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:26.484 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T18:39:26.484 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:26.484 INFO:teuthology.provision.fog.trial048:Deploy complete! 2026-02-23T18:39:26.484 DEBUG:teuthology.parallel:result is None 2026-02-23T18:39:27.111 INFO:teuthology.lock.ops:Checking trial012.front.sepia.ceph.com 2026-02-23T18:39:27.112 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T18:39:27.221 INFO:teuthology.lock.ops:Checking trial048.front.sepia.ceph.com 2026-02-23T18:39:27.221 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T18:39:27.285 INFO:teuthology.lock.ops:Checking trial111.front.sepia.ceph.com 2026-02-23T18:39:27.285 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T18:39:27.343 INFO:teuthology.lock.ops:Checking trial142.front.sepia.ceph.com 2026-02-23T18:39:27.343 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-23T18:39:27.402 INFO:teuthology.lock.ops:Updating [trial012.front.sepia.ceph.com]: set os type and version on server 2026-02-23T18:39:27.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-23T18:39:27.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:39:27.464 DEBUG:teuthology.orchestra.run.trial012:> true 2026-02-23T18:39:27.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial012.front.sepia.ceph.com' 2026-02-23T18:39:27.634 DEBUG:teuthology.orchestra.run.trial012:> uname -m 2026-02-23T18:39:27.693 INFO:teuthology.orchestra.run.trial012.stdout:x86_64 2026-02-23T18:39:27.693 DEBUG:teuthology.orchestra.run.trial012:> cat /etc/os-release 2026-02-23T18:39:27.750 INFO:teuthology.orchestra.run.trial012.stdout:NAME="Rocky Linux" 2026-02-23T18:39:27.750 INFO:teuthology.orchestra.run.trial012.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:ID="rocky" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:VERSION_ID="10.1" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:PLATFORM_ID="platform:el10" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:ANSI_COLOR="0;32" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:LOGO="fedora-logo-icon" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:VENDOR_NAME="RESF" 2026-02-23T18:39:27.751 INFO:teuthology.orchestra.run.trial012.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T18:39:27.752 INFO:teuthology.orchestra.run.trial012.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T18:39:27.752 INFO:teuthology.orchestra.run.trial012.stdout:SUPPORT_END="2035-05-31" 2026-02-23T18:39:27.752 INFO:teuthology.orchestra.run.trial012.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T18:39:27.752 INFO:teuthology.orchestra.run.trial012.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:27.752 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T18:39:27.752 INFO:teuthology.orchestra.run.trial012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:27.753 INFO:teuthology.lock.ops:Updating trial012.front.sepia.ceph.com on lock server 2026-02-23T18:39:27.851 INFO:teuthology.lock.ops:Updating [trial048.front.sepia.ceph.com]: set os type and version on server 2026-02-23T18:39:27.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-23T18:39:27.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:39:27.916 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-23T18:39:27.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-23T18:39:27.990 DEBUG:teuthology.orchestra.run.trial048:> uname -m 2026-02-23T18:39:28.048 INFO:teuthology.orchestra.run.trial048.stdout:x86_64 2026-02-23T18:39:28.049 DEBUG:teuthology.orchestra.run.trial048:> cat /etc/os-release 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:NAME="Rocky Linux" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:ID="rocky" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:VERSION_ID="10.1" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:PLATFORM_ID="platform:el10" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:ANSI_COLOR="0;32" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:LOGO="fedora-logo-icon" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_NAME="RESF" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:SUPPORT_END="2035-05-31" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:28.106 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T18:39:28.107 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:28.107 INFO:teuthology.lock.ops:Updating trial048.front.sepia.ceph.com on lock server 2026-02-23T18:39:28.184 INFO:teuthology.lock.ops:Updating [trial111.front.sepia.ceph.com]: set os type and version on server 2026-02-23T18:39:28.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-23T18:39:28.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:39:28.244 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-23T18:39:28.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-23T18:39:28.428 DEBUG:teuthology.orchestra.run.trial111:> uname -m 2026-02-23T18:39:28.485 INFO:teuthology.orchestra.run.trial111.stdout:x86_64 2026-02-23T18:39:28.486 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release 2026-02-23T18:39:28.543 INFO:teuthology.orchestra.run.trial111.stdout:NAME="Rocky Linux" 2026-02-23T18:39:28.543 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T18:39:28.543 INFO:teuthology.orchestra.run.trial111.stdout:ID="rocky" 2026-02-23T18:39:28.543 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T18:39:28.543 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="10.1" 2026-02-23T18:39:28.543 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el10" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;32" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_NAME="RESF" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T18:39:28.544 INFO:teuthology.orchestra.run.trial111.stdout:SUPPORT_END="2035-05-31" 2026-02-23T18:39:28.545 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T18:39:28.545 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:28.545 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T18:39:28.545 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:28.545 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server 2026-02-23T18:39:28.657 INFO:teuthology.lock.ops:Updating [trial142.front.sepia.ceph.com]: set os type and version on server 2026-02-23T18:39:28.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-23T18:39:28.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T18:39:28.719 DEBUG:teuthology.orchestra.run.trial142:> true 2026-02-23T18:39:28.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial142.front.sepia.ceph.com' 2026-02-23T18:39:28.890 DEBUG:teuthology.orchestra.run.trial142:> uname -m 2026-02-23T18:39:28.948 INFO:teuthology.orchestra.run.trial142.stdout:x86_64 2026-02-23T18:39:28.949 DEBUG:teuthology.orchestra.run.trial142:> cat /etc/os-release 2026-02-23T18:39:29.006 INFO:teuthology.orchestra.run.trial142.stdout:NAME="Rocky Linux" 2026-02-23T18:39:29.006 INFO:teuthology.orchestra.run.trial142.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T18:39:29.006 INFO:teuthology.orchestra.run.trial142.stdout:ID="rocky" 2026-02-23T18:39:29.006 INFO:teuthology.orchestra.run.trial142.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T18:39:29.006 INFO:teuthology.orchestra.run.trial142.stdout:VERSION_ID="10.1" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:PLATFORM_ID="platform:el10" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:ANSI_COLOR="0;32" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:LOGO="fedora-logo-icon" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:VENDOR_NAME="RESF" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:SUPPORT_END="2035-05-31" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T18:39:29.007 INFO:teuthology.orchestra.run.trial142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T18:39:29.007 INFO:teuthology.lock.ops:Updating trial142.front.sepia.ceph.com on lock server 2026-02-23T18:39:29.082 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:39:29.173 INFO:teuthology.dispatcher.supervisor:Running job 66732 2026-02-23T18:39:29.173 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66732 --name nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-4} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore/{alloc$/{hybrid} base mem$/{normal-2} onode-segment$/{512K} write$/{v2/{compr$/{yes$/{zstd}} v2}}}} rados supported-random-distro$/{rpm_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66732/orig.config.yaml 2026-02-23T18:39:29.174 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-23_13:43:25-rados-wip-rocky10-branch-of-the-day-2026-02-23-1771833711-distro-default-trial/66732 2026-02-23T18:39:29.174 INFO:teuthology.dispatcher.supervisor:Job PID: 1488967 2026-02-23T18:39:29.174 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-23T18:41:29.274 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:43:29.450 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:45:29.620 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:47:29.801 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:49:29.994 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:51:30.208 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:53:30.375 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:55:30.537 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:57:30.723 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T18:59:30.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T19:01:31.097 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T19:03:31.220 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T19:05:31.417 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T19:07:31.583 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T19:09:31.765 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T19:09:31.850 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-23T19:09:32.093 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-23T19:09:33.005 INFO:teuthology.orchestra.console.trial048:Power off 2026-02-23T19:09:33.005 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T19:09:33.064 INFO:teuthology.orchestra.console.trial111:Power off 2026-02-23T19:09:33.064 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T19:09:33.076 INFO:teuthology.orchestra.console.trial012:Power off 2026-02-23T19:09:33.076 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T19:09:33.082 DEBUG:teuthology.orchestra.console.trial048:power off output: Chassis Power Control: Down/Off 2026-02-23T19:09:33.087 INFO:teuthology.orchestra.console.trial142:Power off 2026-02-23T19:09:33.088 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-23T19:09:33.103 DEBUG:teuthology.orchestra.console.trial111:power off output: Chassis Power Control: Down/Off 2026-02-23T19:09:33.115 DEBUG:teuthology.orchestra.console.trial012:power off output: Chassis Power Control: Down/Off 2026-02-23T19:09:33.125 DEBUG:teuthology.orchestra.console.trial142:power off output: Chassis Power Control: Down/Off 2026-02-23T19:09:37.086 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T19:09:37.104 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T19:09:37.117 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T19:09:37.126 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T19:09:37.195 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is on 2026-02-23T19:09:37.213 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is on 2026-02-23T19:09:37.227 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is on 2026-02-23T19:09:37.234 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is on 2026-02-23T19:09:41.199 DEBUG:teuthology.orchestra.console.trial048:pexpect command: ipmitool -H trial048.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T19:09:41.213 DEBUG:teuthology.orchestra.console.trial111:pexpect command: ipmitool -H trial111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T19:09:41.228 DEBUG:teuthology.orchestra.console.trial012:pexpect command: ipmitool -H trial012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T19:09:41.235 DEBUG:teuthology.orchestra.console.trial142:pexpect command: ipmitool -H trial142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-23T19:09:41.310 DEBUG:teuthology.orchestra.console.trial048:check power output: Chassis Power is off 2026-02-23T19:09:41.310 INFO:teuthology.orchestra.console.trial048:Power off completed 2026-02-23T19:09:41.324 DEBUG:teuthology.orchestra.console.trial111:check power output: Chassis Power is off 2026-02-23T19:09:41.324 INFO:teuthology.orchestra.console.trial111:Power off completed 2026-02-23T19:09:41.337 DEBUG:teuthology.orchestra.console.trial012:check power output: Chassis Power is off 2026-02-23T19:09:41.337 INFO:teuthology.orchestra.console.trial012:Power off completed 2026-02-23T19:09:41.346 DEBUG:teuthology.orchestra.console.trial142:check power output: Chassis Power is off 2026-02-23T19:09:41.346 INFO:teuthology.orchestra.console.trial142:Power off completed 2026-02-23T19:09:41.648 INFO:teuthology.lock.ops:unlocked: trial048.front.sepia.ceph.com 2026-02-23T19:09:41.657 INFO:teuthology.lock.ops:unlocked: trial012.front.sepia.ceph.com 2026-02-23T19:09:41.661 INFO:teuthology.lock.ops:unlocked: trial111.front.sepia.ceph.com 2026-02-23T19:09:41.665 INFO:teuthology.lock.ops:unlocked: trial142.front.sepia.ceph.com