2026-02-22T20:10:08.302 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T20:10:08.302 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:10:08.373 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:10:08.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x73f928271620>, signals=[15]) 2026-02-22T20:10:08.507 INFO:teuthology.lock.ops:Start node 'trial028.front.sepia.ceph.com' reimaging 2026-02-22T20:10:08.507 INFO:teuthology.lock.ops:Updating [trial028.front.sepia.ceph.com]: reset os type and version on server 2026-02-22T20:10:08.507 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-22T20:10:08.716 DEBUG:teuthology.provision.fog.trial028:Requesting image trial_rocky_10.1 (ID 4) 2026-02-22T20:10:08.764 INFO:teuthology.provision.fog.trial028:Scheduling deploy of rocky 10.1 2026-02-22T20:10:10.404 INFO:teuthology.orchestra.console.trial028:Power off 2026-02-22T20:10:10.404 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-22T20:10:10.443 DEBUG:teuthology.orchestra.console.trial028:power off output: Chassis Power Control: Down/Off 2026-02-22T20:10:14.449 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T20:10:14.557 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is off 2026-02-22T20:10:14.557 INFO:teuthology.orchestra.console.trial028:Power off completed 2026-02-22T20:10:14.658 INFO:teuthology.orchestra.console.trial028:Power on 2026-02-22T20:10:14.658 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-22T20:10:14.699 DEBUG:teuthology.orchestra.console.trial028:power on output: Chassis Power Control: Up/On 2026-02-22T20:10:18.704 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T20:10:18.815 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is off 2026-02-22T20:10:22.820 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T20:10:22.928 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is on 2026-02-22T20:10:22.929 INFO:teuthology.orchestra.console.trial028:Power on completed 2026-02-22T20:10:23.029 INFO:teuthology.provision.fog.trial028:Waiting for deploy to finish 2026-02-22T20:12:10.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:12:13.632 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-22T20:12:19.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:12:22.720 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-22T20:12:28.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:12:31.808 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-22T20:12:37.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:12:40.896 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-22T20:12:46.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:12:49.984 WARNING:teuthology.provision.fog.trial028:[Errno None] Unable to connect to port 22 on 10.20.193.28 2026-02-22T20:12:55.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:13:32.221 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-22T20:13:32.222 DEBUG:teuthology.orchestra.run.trial028:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-22T20:13:37.515 INFO:teuthology.provision.fog.trial028:Node is ready 2026-02-22T20:13:37.515 DEBUG:teuthology.orchestra.run.trial028:> hostname 2026-02-22T20:13:37.573 INFO:teuthology.orchestra.run.trial028.stdout:trial028.front.sepia.ceph.com 2026-02-22T20:13:37.573 DEBUG:teuthology.orchestra.run.trial028:> grep trial028.front.sepia.ceph.com /etc/hosts 2026-02-22T20:13:37.630 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28 trial028.front.sepia.ceph.com trial028 2026-02-22T20:13:37.631 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname trial028 2026-02-22T20:13:37.704 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/trial028.front.sepia.ceph.com/trial028/g' /etc/hosts 2026-02-22T20:13:37.771 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/10.20.193.28/10.20.193.28/g' /etc/hosts 2026-02-22T20:13:37.838 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i -e 's/trial028.front.sepia.ceph.com/trial028/g' /etc/hostname 2026-02-22T20:13:37.905 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname trial028 2026-02-22T20:13:37.971 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-22T20:13:38.028 INFO:teuthology.orchestra.run.trial028.stdout:NAME="Rocky Linux" 2026-02-22T20:13:38.028 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="10.1 (Red Quartz)" 2026-02-22T20:13:38.028 INFO:teuthology.orchestra.run.trial028.stdout:ID="rocky" 2026-02-22T20:13:38.028 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel centos fedora" 2026-02-22T20:13:38.028 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="10.1" 2026-02-22T20:13:38.028 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el10" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;32" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://rockylinux.org/" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:VENDOR_NAME="RESF" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:VENDOR_URL="https://resf.org/" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:SUPPORT_END="2035-05-31" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-22T20:13:38.029 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-22T20:13:38.030 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-22T20:13:38.030 INFO:teuthology.provision.fog.trial028:Deploy complete! 2026-02-22T20:13:38.031 DEBUG:teuthology.parallel:result is None 2026-02-22T20:13:38.296 INFO:teuthology.lock.ops:Checking trial028.front.sepia.ceph.com 2026-02-22T20:13:38.296 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-22T20:13:38.382 INFO:teuthology.lock.ops:Updating [trial028.front.sepia.ceph.com]: set os type and version on server 2026-02-22T20:13:38.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-22T20:13:38.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T20:13:38.446 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-22T20:13:38.529 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-22T20:13:38.529 DEBUG:teuthology.orchestra.run.trial028:> uname -m 2026-02-22T20:13:38.587 INFO:teuthology.orchestra.run.trial028.stdout:x86_64 2026-02-22T20:13:38.587 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:NAME="Rocky Linux" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="10.1 (Red Quartz)" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:ID="rocky" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel centos fedora" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="10.1" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el10" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;32" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-22T20:13:38.644 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://rockylinux.org/" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:VENDOR_NAME="RESF" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:VENDOR_URL="https://resf.org/" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:SUPPORT_END="2035-05-31" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-22T20:13:38.645 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-22T20:13:38.645 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-22T20:13:38.760 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:13:38.858 INFO:teuthology.dispatcher.supervisor:Running job 64464 2026-02-22T20:13:38.858 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64464 --name nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial --description rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{avl} base mem$/{normal-1} onode-segment$/{512K-onoff} write$/{v2/{compr$/{yes$/{lz4}} v2}}}} rados supported-random-distro$/{rpm_latest}} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64464/orig.config.yaml 2026-02-22T20:13:38.859 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-22_19:44:01-rados-wip-rocky10-branch-of-the-day-2026-02-22-1771776513-tentacle-distro-default-trial/64464 2026-02-22T20:13:38.859 INFO:teuthology.dispatcher.supervisor:Job PID: 3717759 2026-02-22T20:13:38.859 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-22T20:15:38.959 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:17:39.114 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:19:39.273 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:21:39.471 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:23:39.704 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T20:23:39.824 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-22T20:23:39.891 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-22T20:23:40.188 INFO:teuthology.orchestra.console.trial028:Power off 2026-02-22T20:23:40.189 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-22T20:23:40.228 DEBUG:teuthology.orchestra.console.trial028:power off output: Chassis Power Control: Down/Off 2026-02-22T20:23:44.232 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T20:23:44.341 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is on 2026-02-22T20:23:48.345 DEBUG:teuthology.orchestra.console.trial028:pexpect command: ipmitool -H trial028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-22T20:23:48.454 DEBUG:teuthology.orchestra.console.trial028:check power output: Chassis Power is off 2026-02-22T20:23:48.455 INFO:teuthology.orchestra.console.trial028:Power off completed 2026-02-22T20:23:51.032 INFO:teuthology.lock.ops:unlocked: trial028.front.sepia.ceph.com