2026-02-20T23:35:15.442 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-20T23:35:15.443 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:35:15.530 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:35:15.819 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7e5d7bc98aa0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7e5d7b479c60>, signals=[15])
2026-02-20T23:35:15.819 INFO:teuthology.lock.ops:Start node 'trial124.front.sepia.ceph.com' reimaging
2026-02-20T23:35:15.819 INFO:teuthology.lock.ops:Updating [trial124.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T23:35:15.819 INFO:teuthology.lock.ops:Updating trial124.front.sepia.ceph.com on lock server
2026-02-20T23:35:16.017 DEBUG:teuthology.provision.fog.trial124:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T23:35:16.044 INFO:teuthology.provision.fog.trial124:Scheduling deploy of centos 9.stream
2026-02-20T23:35:17.810 INFO:teuthology.orchestra.console.trial124:Power off
2026-02-20T23:35:17.811 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T23:35:17.850 DEBUG:teuthology.orchestra.console.trial124:power off output: Chassis Power Control: Down/Off
2026-02-20T23:35:21.853 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T23:35:21.962 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is off
2026-02-20T23:35:21.963 INFO:teuthology.orchestra.console.trial124:Power off completed
2026-02-20T23:35:22.063 INFO:teuthology.orchestra.console.trial124:Power on
2026-02-20T23:35:22.064 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T23:35:22.103 DEBUG:teuthology.orchestra.console.trial124:power on output: Chassis Power Control: Up/On
2026-02-20T23:35:26.107 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T23:35:26.220 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is on
2026-02-20T23:35:26.220 INFO:teuthology.orchestra.console.trial124:Power on completed
2026-02-20T23:35:26.321 INFO:teuthology.provision.fog.trial124:Waiting for deploy to finish
2026-02-20T23:37:29.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T23:37:32.416 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-20T23:37:38.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T23:37:41.505 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-20T23:37:47.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T23:37:50.592 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-20T23:37:56.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T23:37:59.680 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124
2026-02-20T23:38:05.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T23:38:41.531 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T23:38:41.531 DEBUG:teuthology.orchestra.run.trial124:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T23:38:41.780 INFO:teuthology.provision.fog.trial124:Node is ready
2026-02-20T23:38:41.780 DEBUG:teuthology.orchestra.run.trial124:> hostname
2026-02-20T23:38:41.838 INFO:teuthology.orchestra.run.trial124.stdout:trial124.front.sepia.ceph.com
2026-02-20T23:38:41.838 DEBUG:teuthology.orchestra.run.trial124:> grep trial124.front.sepia.ceph.com /etc/hosts
2026-02-20T23:38:41.896 INFO:teuthology.orchestra.run.trial124.stdout:10.20.193.124 trial124.front.sepia.ceph.com trial124
2026-02-20T23:38:41.897 DEBUG:teuthology.orchestra.run.trial124:> sudo hostname trial124
2026-02-20T23:38:41.970 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/trial124.front.sepia.ceph.com/trial124/g' /etc/hosts
2026-02-20T23:38:42.084 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/10.20.193.124/10.20.193.124/g' /etc/hosts
2026-02-20T23:38:42.166 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/trial124.front.sepia.ceph.com/trial124/g' /etc/hostname
2026-02-20T23:38:42.278 DEBUG:teuthology.orchestra.run.trial124:> sudo hostname trial124
2026-02-20T23:38:42.311 DEBUG:teuthology.orchestra.run.trial124:> cat /etc/os-release
2026-02-20T23:38:42.369 INFO:teuthology.orchestra.run.trial124.stdout:NAME="CentOS Stream"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:VERSION="9"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:ID="centos"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:ID_LIKE="rhel fedora"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_ID="9"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:PLATFORM_ID="platform:el9"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:ANSI_COLOR="0;31"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:LOGO="fedora-logo-icon"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:HOME_URL="https://centos.org/"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T23:38:42.370 INFO:teuthology.orchestra.run.trial124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T23:38:42.370 INFO:teuthology.provision.fog.trial124:Deploy complete!
2026-02-20T23:38:42.370 DEBUG:teuthology.parallel:result is None
2026-02-20T23:38:42.588 INFO:teuthology.lock.ops:Checking trial124.front.sepia.ceph.com
2026-02-20T23:38:42.589 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T23:38:42.655 INFO:teuthology.lock.ops:Updating [trial124.front.sepia.ceph.com]: set os type and version on server
2026-02-20T23:38:42.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial124.front.sepia.ceph.com'
2026-02-20T23:38:42.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T23:38:42.720 DEBUG:teuthology.orchestra.run.trial124:> true
2026-02-20T23:38:42.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial124.front.sepia.ceph.com'
2026-02-20T23:38:42.795 DEBUG:teuthology.orchestra.run.trial124:> uname -m
2026-02-20T23:38:42.856 INFO:teuthology.orchestra.run.trial124.stdout:x86_64
2026-02-20T23:38:42.856 DEBUG:teuthology.orchestra.run.trial124:> cat /etc/os-release
2026-02-20T23:38:42.915 INFO:teuthology.orchestra.run.trial124.stdout:NAME="CentOS Stream"
2026-02-20T23:38:42.915 INFO:teuthology.orchestra.run.trial124.stdout:VERSION="9"
2026-02-20T23:38:42.915 INFO:teuthology.orchestra.run.trial124.stdout:ID="centos"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:ID_LIKE="rhel fedora"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_ID="9"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:PLATFORM_ID="platform:el9"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:ANSI_COLOR="0;31"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:LOGO="fedora-logo-icon"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:HOME_URL="https://centos.org/"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T23:38:42.916 INFO:teuthology.orchestra.run.trial124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T23:38:42.916 INFO:teuthology.lock.ops:Updating trial124.front.sepia.ceph.com on lock server
2026-02-20T23:38:42.976 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:38:43.060 INFO:teuthology.dispatcher.supervisor:Running job 61887
2026-02-20T23:38:43.060 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_liucm@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/liucm-2026-02-20_22:16:48-crimson-rados-wip-liucm-osd-shard-redesign-crimson-only-distro-debug-trial/61887 --name liucm-2026-02-20_22:16:48-crimson-rados-wip-liucm-osd-shard-redesign-crimson-only-distro-debug-trial --description crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} tasks/rbd_api_tests} -- /home/teuthworker/mnt/teuthology/liucm-2026-02-20_22:16:48-crimson-rados-wip-liucm-osd-shard-redesign-crimson-only-distro-debug-trial/61887/orig.config.yaml
2026-02-20T23:38:43.060 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/liucm-2026-02-20_22:16:48-crimson-rados-wip-liucm-osd-shard-redesign-crimson-only-distro-debug-trial/61887
2026-02-20T23:38:43.060 INFO:teuthology.dispatcher.supervisor:Job PID: 1809741
2026-02-20T23:38:43.060 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-20T23:40:43.149 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:42:43.329 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:44:43.509 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:46:43.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:48:43.784 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:50:43.971 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:52:44.111 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:54:44.321 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:56:44.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T23:58:44.662 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:00:46.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:02:46.614 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:04:46.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:06:46.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:08:47.152 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:10:47.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:12:47.511 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:14:47.686 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:16:47.886 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:18:48.092 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:20:48.256 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:22:48.438 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:24:48.645 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:26:48.845 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:28:49.033 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:30:49.225 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:32:51.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:34:52.191 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:36:52.353 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:38:52.533 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:40:52.706 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:42:52.888 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:44:53.075 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:46:53.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:48:53.435 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:50:53.614 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:52:53.786 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:54:53.948 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:56:54.148 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T00:58:54.324 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T01:00:54.506 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T01:02:54.688 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T01:04:54.832 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T01:06:55.024 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T01:08:55.192 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T01:08:55.307 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-21T01:08:55.370 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-21T01:08:55.667 INFO:teuthology.orchestra.console.trial124:Power off
2026-02-21T01:08:55.668 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-21T01:08:55.707 DEBUG:teuthology.orchestra.console.trial124:power off output: Chassis Power Control: Down/Off
2026-02-21T01:08:59.710 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-21T01:08:59.819 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is on
2026-02-21T01:09:03.823 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-21T01:09:03.931 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is off
2026-02-21T01:09:03.931 INFO:teuthology.orchestra.console.trial124:Power off completed
2026-02-21T01:09:04.103 INFO:teuthology.lock.ops:unlocked: trial124.front.sepia.ceph.com