2026-02-26T03:11:44.593 INFO:root:teuthology version: 1.2.4.dev11+g6e3d0419c
2026-02-26T03:11:44.593 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:11:44.678 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:11:44.824 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x71921df2d940>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x71921d7d1f80>, signals=[15])
2026-02-26T03:11:44.824 INFO:teuthology.lock.ops:Start node 'trial132.front.sepia.ceph.com' reimaging
2026-02-26T03:11:44.824 INFO:teuthology.lock.ops:Updating [trial132.front.sepia.ceph.com]: reset os type and version on server
2026-02-26T03:11:44.824 INFO:teuthology.lock.ops:Updating trial132.front.sepia.ceph.com on lock server
2026-02-26T03:11:45.035 DEBUG:teuthology.provision.fog.trial132:Requesting image trial_centos_9.stream (ID 3)
2026-02-26T03:11:45.086 INFO:teuthology.provision.fog.trial132:Scheduling deploy of centos 9.stream
2026-02-26T03:11:46.294 INFO:teuthology.orchestra.console.trial132:Power off
2026-02-26T03:11:46.294 DEBUG:teuthology.orchestra.console.trial132:pexpect command: ipmitool -H trial132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-26T03:11:46.333 DEBUG:teuthology.orchestra.console.trial132:power off output: Chassis Power Control: Down/Off
2026-02-26T03:11:50.338 DEBUG:teuthology.orchestra.console.trial132:pexpect command: ipmitool -H trial132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-26T03:11:50.446 DEBUG:teuthology.orchestra.console.trial132:check power output: Chassis Power is off
2026-02-26T03:11:50.447 INFO:teuthology.orchestra.console.trial132:Power off completed
2026-02-26T03:11:50.547 INFO:teuthology.orchestra.console.trial132:Power on
2026-02-26T03:11:50.547 DEBUG:teuthology.orchestra.console.trial132:pexpect command: ipmitool -H trial132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-26T03:11:50.587 DEBUG:teuthology.orchestra.console.trial132:power on output: Chassis Power Control: Up/On
2026-02-26T03:11:54.591 DEBUG:teuthology.orchestra.console.trial132:pexpect command: ipmitool -H trial132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-26T03:11:54.701 DEBUG:teuthology.orchestra.console.trial132:check power output: Chassis Power is on
2026-02-26T03:11:54.701 INFO:teuthology.orchestra.console.trial132:Power on completed
2026-02-26T03:11:54.801 INFO:teuthology.provision.fog.trial132:Waiting for deploy to finish
2026-02-26T03:13:57.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-26T03:14:00.960 WARNING:teuthology.provision.fog.trial132:[Errno None] Unable to connect to port 22 on 10.20.193.132
2026-02-26T03:14:06.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-26T03:14:10.048 WARNING:teuthology.provision.fog.trial132:[Errno None] Unable to connect to port 22 on 10.20.193.132
2026-02-26T03:14:16.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-26T03:14:19.136 WARNING:teuthology.provision.fog.trial132:[Errno None] Unable to connect to port 22 on 10.20.193.132
2026-02-26T03:14:25.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-26T03:14:28.224 WARNING:teuthology.provision.fog.trial132:[Errno None] Unable to connect to port 22 on 10.20.193.132
2026-02-26T03:14:34.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-26T03:15:10.435 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-26T03:15:10.435 DEBUG:teuthology.orchestra.run.trial132:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-26T03:15:10.577 INFO:teuthology.provision.fog.trial132:Node is ready
2026-02-26T03:15:10.578 DEBUG:teuthology.orchestra.run.trial132:> hostname
2026-02-26T03:15:10.635 INFO:teuthology.orchestra.run.trial132.stdout:trial132.front.sepia.ceph.com
2026-02-26T03:15:10.635 DEBUG:teuthology.orchestra.run.trial132:> grep trial132.front.sepia.ceph.com /etc/hosts
2026-02-26T03:15:10.691 INFO:teuthology.orchestra.run.trial132.stdout:10.20.193.132 trial132.front.sepia.ceph.com trial132
2026-02-26T03:15:10.691 DEBUG:teuthology.orchestra.run.trial132:> sudo hostname trial132
2026-02-26T03:15:10.760 DEBUG:teuthology.orchestra.run.trial132:> sudo sed -i -e 's/trial132.front.sepia.ceph.com/trial132/g' /etc/hosts
2026-02-26T03:15:10.825 DEBUG:teuthology.orchestra.run.trial132:> sudo sed -i -e 's/10.20.193.132/10.20.193.132/g' /etc/hosts
2026-02-26T03:15:10.888 DEBUG:teuthology.orchestra.run.trial132:> sudo sed -i -e 's/trial132.front.sepia.ceph.com/trial132/g' /etc/hostname
2026-02-26T03:15:10.953 DEBUG:teuthology.orchestra.run.trial132:> sudo hostname trial132
2026-02-26T03:15:11.018 DEBUG:teuthology.orchestra.run.trial132:> cat /etc/os-release
2026-02-26T03:15:11.073 INFO:teuthology.orchestra.run.trial132.stdout:NAME="CentOS Stream"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:VERSION="9"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:ID="centos"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:ID_LIKE="rhel fedora"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:VERSION_ID="9"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:PLATFORM_ID="platform:el9"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:ANSI_COLOR="0;31"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:LOGO="fedora-logo-icon"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:HOME_URL="https://centos.org/"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-26T03:15:11.074 INFO:teuthology.orchestra.run.trial132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-26T03:15:11.075 INFO:teuthology.provision.fog.trial132:Deploy complete!
2026-02-26T03:15:11.075 DEBUG:teuthology.parallel:result is None
2026-02-26T03:15:11.328 INFO:teuthology.lock.ops:Checking trial132.front.sepia.ceph.com
2026-02-26T03:15:11.329 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-26T03:15:11.392 INFO:teuthology.lock.ops:Updating [trial132.front.sepia.ceph.com]: set os type and version on server
2026-02-26T03:15:11.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com'
2026-02-26T03:15:11.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-26T03:15:11.452 DEBUG:teuthology.orchestra.run.trial132:> true
2026-02-26T03:15:11.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com'
2026-02-26T03:15:11.528 DEBUG:teuthology.orchestra.run.trial132:> uname -m
2026-02-26T03:15:11.583 INFO:teuthology.orchestra.run.trial132.stdout:x86_64
2026-02-26T03:15:11.583 DEBUG:teuthology.orchestra.run.trial132:> cat /etc/os-release
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:NAME="CentOS Stream"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:VERSION="9"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:ID="centos"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:ID_LIKE="rhel fedora"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:VERSION_ID="9"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:PLATFORM_ID="platform:el9"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:ANSI_COLOR="0;31"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:LOGO="fedora-logo-icon"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:HOME_URL="https://centos.org/"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-26T03:15:11.640 INFO:teuthology.orchestra.run.trial132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-26T03:15:11.640 INFO:teuthology.lock.ops:Updating trial132.front.sepia.ceph.com on lock server
2026-02-26T03:15:11.707 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:15:11.793 INFO:teuthology.dispatcher.supervisor:Running job 71215
2026-02-26T03:15:11.793 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/virtualenv/bin/teuthology -v --owner scheduled_shraddhaag@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71215 --name shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial --description crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rbd_lock_and_fence} -- /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71215/orig.config.yaml
2026-02-26T03:15:11.793 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-26_02:22:56-crimson-rados-main-distro-debug-trial/71215
2026-02-26T03:15:11.793 INFO:teuthology.dispatcher.supervisor:Job PID: 992871
2026-02-26T03:15:11.793 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-26T03:17:11.894 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:19:13.788 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:21:13.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:23:14.177 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:25:14.537 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:27:14.755 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:29:14.885 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:31:15.112 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:33:15.322 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:35:15.497 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:37:15.689 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:39:15.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:41:16.068 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:43:16.223 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:45:16.364 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:47:16.479 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-26T03:47:16.554 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-26T03:47:16.615 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-26T03:47:16.931 INFO:teuthology.orchestra.console.trial132:Power off
2026-02-26T03:47:16.932 DEBUG:teuthology.orchestra.console.trial132:pexpect command: ipmitool -H trial132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-26T03:47:16.974 DEBUG:teuthology.orchestra.console.trial132:power off output: Chassis Power Control: Down/Off
2026-02-26T03:47:20.979 DEBUG:teuthology.orchestra.console.trial132:pexpect command: ipmitool -H trial132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-26T03:47:21.087 DEBUG:teuthology.orchestra.console.trial132:check power output: Chassis Power is on
2026-02-26T03:47:25.092 DEBUG:teuthology.orchestra.console.trial132:pexpect command: ipmitool -H trial132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-26T03:47:25.201 DEBUG:teuthology.orchestra.console.trial132:check power output: Chassis Power is off
2026-02-26T03:47:25.201 INFO:teuthology.orchestra.console.trial132:Power off completed
2026-02-26T03:47:25.402 INFO:teuthology.lock.ops:unlocked: trial132.front.sepia.ceph.com