2026-02-13T02:13:03.500 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T02:13:03.500 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:13:03.572 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:13:03.704 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x722e6be087d0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x722e6b649a80>, signals=[15])
2026-02-13T02:13:03.704 INFO:teuthology.lock.ops:Start node 'trial041.front.sepia.ceph.com' reimaging
2026-02-13T02:13:03.704 INFO:teuthology.lock.ops:Updating [trial041.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T02:13:03.704 INFO:teuthology.lock.ops:Updating trial041.front.sepia.ceph.com on lock server
2026-02-13T02:13:03.876 DEBUG:teuthology.provision.fog.trial041:Requesting image trial_rocky_10.1 (ID 4)
2026-02-13T02:13:03.921 INFO:teuthology.provision.fog.trial041:Scheduling deploy of rocky 10.1
2026-02-13T02:13:04.947 INFO:teuthology.orchestra.console.trial041:Power off
2026-02-13T02:13:04.947 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:13:04.985 DEBUG:teuthology.orchestra.console.trial041:power off output: Chassis Power Control: Down/Off
2026-02-13T02:13:08.990 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:13:09.096 DEBUG:teuthology.orchestra.console.trial041:check power output: Chassis Power is off
2026-02-13T02:13:09.097 INFO:teuthology.orchestra.console.trial041:Power off completed
2026-02-13T02:13:09.197 INFO:teuthology.orchestra.console.trial041:Power on
2026-02-13T02:13:09.198 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T02:13:09.238 DEBUG:teuthology.orchestra.console.trial041:power on output: Chassis Power Control: Up/On
2026-02-13T02:13:13.243 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:13:13.353 DEBUG:teuthology.orchestra.console.trial041:check power output: Chassis Power is on
2026-02-13T02:13:13.354 INFO:teuthology.orchestra.console.trial041:Power on completed
2026-02-13T02:13:13.454 INFO:teuthology.provision.fog.trial041:Waiting for deploy to finish
2026-02-13T02:15:00.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:15:15.037 WARNING:teuthology.provision.fog.trial041:[Errno None] Unable to connect to port 22 on 10.20.193.41
2026-02-13T02:15:21.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:15:24.125 WARNING:teuthology.provision.fog.trial041:[Errno None] Unable to connect to port 22 on 10.20.193.41
2026-02-13T02:15:30.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:15:33.213 WARNING:teuthology.provision.fog.trial041:[Errno None] Unable to connect to port 22 on 10.20.193.41
2026-02-13T02:15:39.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:16:15.355 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T02:16:15.355 DEBUG:teuthology.orchestra.run.trial041:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T02:16:20.541 INFO:teuthology.provision.fog.trial041:Node is ready
2026-02-13T02:16:20.542 DEBUG:teuthology.orchestra.run.trial041:> hostname
2026-02-13T02:16:20.599 INFO:teuthology.orchestra.run.trial041.stdout:trial041.front.sepia.ceph.com
2026-02-13T02:16:20.600 DEBUG:teuthology.orchestra.run.trial041:> grep trial041.front.sepia.ceph.com /etc/hosts
2026-02-13T02:16:20.657 INFO:teuthology.orchestra.run.trial041.stdout:10.20.193.41 trial041.front.sepia.ceph.com trial041
2026-02-13T02:16:20.658 DEBUG:teuthology.orchestra.run.trial041:> sudo hostname trial041
2026-02-13T02:16:20.731 DEBUG:teuthology.orchestra.run.trial041:> sudo sed -i -e 's/trial041.front.sepia.ceph.com/trial041/g' /etc/hosts
2026-02-13T02:16:20.800 DEBUG:teuthology.orchestra.run.trial041:> sudo sed -i -e 's/10.20.193.41/10.20.193.41/g' /etc/hosts
2026-02-13T02:16:20.868 DEBUG:teuthology.orchestra.run.trial041:> sudo sed -i -e 's/trial041.front.sepia.ceph.com/trial041/g' /etc/hostname
2026-02-13T02:16:20.936 DEBUG:teuthology.orchestra.run.trial041:> sudo hostname trial041
2026-02-13T02:16:21.002 DEBUG:teuthology.orchestra.run.trial041:> cat /etc/os-release
2026-02-13T02:16:21.059 INFO:teuthology.orchestra.run.trial041.stdout:NAME="Rocky Linux"
2026-02-13T02:16:21.059 INFO:teuthology.orchestra.run.trial041.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:16:21.059 INFO:teuthology.orchestra.run.trial041.stdout:ID="rocky"
2026-02-13T02:16:21.059 INFO:teuthology.orchestra.run.trial041.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:16:21.059 INFO:teuthology.orchestra.run.trial041.stdout:VERSION_ID="10.1"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:ANSI_COLOR="0;32"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:VENDOR_NAME="RESF"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:16:21.060 INFO:teuthology.orchestra.run.trial041.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:16:21.061 INFO:teuthology.orchestra.run.trial041.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:16:21.061 INFO:teuthology.orchestra.run.trial041.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:16:21.061 INFO:teuthology.orchestra.run.trial041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:16:21.062 INFO:teuthology.provision.fog.trial041:Deploy complete!
2026-02-13T02:16:21.062 DEBUG:teuthology.parallel:result is None
2026-02-13T02:16:21.339 INFO:teuthology.lock.ops:Checking trial041.front.sepia.ceph.com
2026-02-13T02:16:21.340 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T02:16:21.428 INFO:teuthology.lock.ops:Updating [trial041.front.sepia.ceph.com]: set os type and version on server
2026-02-13T02:16:21.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial041.front.sepia.ceph.com'
2026-02-13T02:16:21.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T02:16:21.494 DEBUG:teuthology.orchestra.run.trial041:> true
2026-02-13T02:16:21.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial041.front.sepia.ceph.com'
2026-02-13T02:16:21.581 DEBUG:teuthology.orchestra.run.trial041:> uname -m
2026-02-13T02:16:21.639 INFO:teuthology.orchestra.run.trial041.stdout:x86_64
2026-02-13T02:16:21.640 DEBUG:teuthology.orchestra.run.trial041:> cat /etc/os-release
2026-02-13T02:16:21.697 INFO:teuthology.orchestra.run.trial041.stdout:NAME="Rocky Linux"
2026-02-13T02:16:21.697 INFO:teuthology.orchestra.run.trial041.stdout:VERSION="10.1 (Red Quartz)"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:ID="rocky"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:ID_LIKE="rhel centos fedora"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:VERSION_ID="10.1"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:PLATFORM_ID="platform:el10"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:ANSI_COLOR="0;32"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:LOGO="fedora-logo-icon"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:HOME_URL="https://rockylinux.org/"
2026-02-13T02:16:21.698 INFO:teuthology.orchestra.run.trial041.stdout:VENDOR_NAME="RESF"
2026-02-13T02:16:21.699 INFO:teuthology.orchestra.run.trial041.stdout:VENDOR_URL="https://resf.org/"
2026-02-13T02:16:21.699 INFO:teuthology.orchestra.run.trial041.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/"
2026-02-13T02:16:21.699 INFO:teuthology.orchestra.run.trial041.stdout:SUPPORT_END="2035-05-31"
2026-02-13T02:16:21.699 INFO:teuthology.orchestra.run.trial041.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10"
2026-02-13T02:16:21.699 INFO:teuthology.orchestra.run.trial041.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:16:21.699 INFO:teuthology.orchestra.run.trial041.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux"
2026-02-13T02:16:21.699 INFO:teuthology.orchestra.run.trial041.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1"
2026-02-13T02:16:21.700 INFO:teuthology.lock.ops:Updating trial041.front.sepia.ceph.com on lock server
2026-02-13T02:16:21.806 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:16:21.904 INFO:teuthology.dispatcher.supervisor:Running job 47983
2026-02-13T02:16:21.904 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47983 --name pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/full/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1-node-4-mds-1-osd conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mgr-osd-full} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47983/orig.config.yaml
2026-02-13T02:16:21.905 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47983
2026-02-13T02:16:21.905 INFO:teuthology.dispatcher.supervisor:Job PID: 1255277
2026-02-13T02:16:21.905 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T02:18:22.005 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:20:22.207 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:22:22.440 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:24:22.610 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:26:22.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:28:22.957 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:30:23.158 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T02:30:23.248 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-13T02:30:23.309 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T02:30:23.607 INFO:teuthology.orchestra.console.trial041:Power off
2026-02-13T02:30:23.607 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T02:30:23.646 DEBUG:teuthology.orchestra.console.trial041:power off output: Chassis Power Control: Down/Off
2026-02-13T02:30:27.650 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:30:27.758 DEBUG:teuthology.orchestra.console.trial041:check power output: Chassis Power is on
2026-02-13T02:30:31.762 DEBUG:teuthology.orchestra.console.trial041:pexpect command: ipmitool -H trial041.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T02:30:31.871 DEBUG:teuthology.orchestra.console.trial041:check power output: Chassis Power is off
2026-02-13T02:30:31.871 INFO:teuthology.orchestra.console.trial041:Power off completed
2026-02-13T02:30:32.082 INFO:teuthology.lock.ops:unlocked: trial041.front.sepia.ceph.com