2026-02-12T14:19:20.391 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T14:19:20.392 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:19:20.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:19:20.599 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x71c4cba168e0>, signals=[15]) 2026-02-12T14:19:20.599 INFO:teuthology.lock.ops:Start node 'trial181.front.sepia.ceph.com' reimaging 2026-02-12T14:19:20.599 INFO:teuthology.lock.ops:Updating [trial181.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T14:19:20.599 INFO:teuthology.lock.ops:Updating trial181.front.sepia.ceph.com on lock server 2026-02-12T14:19:20.807 DEBUG:teuthology.provision.fog.trial181:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T14:19:20.850 INFO:teuthology.provision.fog.trial181:Scheduling deploy of centos 9.stream 2026-02-12T14:19:21.681 INFO:teuthology.orchestra.console.trial181:Power off 2026-02-12T14:19:21.681 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T14:19:21.719 DEBUG:teuthology.orchestra.console.trial181:power off output: Chassis Power Control: Down/Off 2026-02-12T14:19:25.723 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T14:19:25.831 DEBUG:teuthology.orchestra.console.trial181:check power output: Chassis Power is off 2026-02-12T14:19:25.831 INFO:teuthology.orchestra.console.trial181:Power off completed 2026-02-12T14:19:25.932 INFO:teuthology.orchestra.console.trial181:Power on 2026-02-12T14:19:25.932 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T14:19:25.971 DEBUG:teuthology.orchestra.console.trial181:power on output: Chassis Power Control: Up/On 2026-02-12T14:19:29.975 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T14:19:30.084 DEBUG:teuthology.orchestra.console.trial181:check power output: Chassis Power is on 2026-02-12T14:19:30.084 INFO:teuthology.orchestra.console.trial181:Power on completed 2026-02-12T14:19:30.184 INFO:teuthology.provision.fog.trial181:Waiting for deploy to finish 2026-02-12T14:21:17.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T14:21:20.157 WARNING:teuthology.provision.fog.trial181:[Errno None] Unable to connect to port 22 on 10.20.193.181 2026-02-12T14:21:26.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T14:21:29.245 WARNING:teuthology.provision.fog.trial181:[Errno None] Unable to connect to port 22 on 10.20.193.181 2026-02-12T14:21:35.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T14:21:38.333 WARNING:teuthology.provision.fog.trial181:[Errno None] Unable to connect to port 22 on 10.20.193.181 2026-02-12T14:21:44.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T14:21:47.421 WARNING:teuthology.provision.fog.trial181:[Errno None] Unable to connect to port 22 on 10.20.193.181 2026-02-12T14:21:53.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T14:22:29.665 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T14:22:29.665 DEBUG:teuthology.orchestra.run.trial181:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T14:22:35.174 INFO:teuthology.provision.fog.trial181:Node is ready 2026-02-12T14:22:35.175 DEBUG:teuthology.orchestra.run.trial181:> hostname 2026-02-12T14:22:35.193 INFO:teuthology.orchestra.run.trial181.stdout:trial181.front.sepia.ceph.com 2026-02-12T14:22:35.193 DEBUG:teuthology.orchestra.run.trial181:> grep trial181.front.sepia.ceph.com /etc/hosts 2026-02-12T14:22:35.249 INFO:teuthology.orchestra.run.trial181.stdout:10.20.193.181 trial181.front.sepia.ceph.com trial181 2026-02-12T14:22:35.249 DEBUG:teuthology.orchestra.run.trial181:> sudo hostname trial181 2026-02-12T14:22:35.317 DEBUG:teuthology.orchestra.run.trial181:> sudo sed -i -e 's/trial181.front.sepia.ceph.com/trial181/g' /etc/hosts 2026-02-12T14:22:35.382 DEBUG:teuthology.orchestra.run.trial181:> sudo sed -i -e 's/10.20.193.181/10.20.193.181/g' /etc/hosts 2026-02-12T14:22:35.446 DEBUG:teuthology.orchestra.run.trial181:> sudo sed -i -e 's/trial181.front.sepia.ceph.com/trial181/g' /etc/hostname 2026-02-12T14:22:35.511 DEBUG:teuthology.orchestra.run.trial181:> sudo hostname trial181 2026-02-12T14:22:35.575 DEBUG:teuthology.orchestra.run.trial181:> cat /etc/os-release 2026-02-12T14:22:35.631 INFO:teuthology.orchestra.run.trial181.stdout:NAME="CentOS Stream" 2026-02-12T14:22:35.631 INFO:teuthology.orchestra.run.trial181.stdout:VERSION="9" 2026-02-12T14:22:35.631 INFO:teuthology.orchestra.run.trial181.stdout:ID="centos" 2026-02-12T14:22:35.631 INFO:teuthology.orchestra.run.trial181.stdout:ID_LIKE="rhel fedora" 2026-02-12T14:22:35.631 INFO:teuthology.orchestra.run.trial181.stdout:VERSION_ID="9" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:PLATFORM_ID="platform:el9" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:ANSI_COLOR="0;31" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:LOGO="fedora-logo-icon" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:HOME_URL="https://centos.org/" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T14:22:35.632 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T14:22:35.633 INFO:teuthology.provision.fog.trial181:Deploy complete! 2026-02-12T14:22:35.634 DEBUG:teuthology.parallel:result is None 2026-02-12T14:22:35.914 INFO:teuthology.lock.ops:Checking trial181.front.sepia.ceph.com 2026-02-12T14:22:35.914 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T14:22:36.005 INFO:teuthology.lock.ops:Updating [trial181.front.sepia.ceph.com]: set os type and version on server 2026-02-12T14:22:36.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-12T14:22:36.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T14:22:36.073 DEBUG:teuthology.orchestra.run.trial181:> true 2026-02-12T14:22:36.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial181.front.sepia.ceph.com' 2026-02-12T14:22:36.148 DEBUG:teuthology.orchestra.run.trial181:> uname -m 2026-02-12T14:22:36.205 INFO:teuthology.orchestra.run.trial181.stdout:x86_64 2026-02-12T14:22:36.205 DEBUG:teuthology.orchestra.run.trial181:> cat /etc/os-release 2026-02-12T14:22:36.261 INFO:teuthology.orchestra.run.trial181.stdout:NAME="CentOS Stream" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:VERSION="9" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:ID="centos" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:ID_LIKE="rhel fedora" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:VERSION_ID="9" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:PLATFORM_ID="platform:el9" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:ANSI_COLOR="0;31" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:LOGO="fedora-logo-icon" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:HOME_URL="https://centos.org/" 2026-02-12T14:22:36.262 INFO:teuthology.orchestra.run.trial181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T14:22:36.263 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T14:22:36.263 INFO:teuthology.orchestra.run.trial181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T14:22:36.263 INFO:teuthology.lock.ops:Updating trial181.front.sepia.ceph.com on lock server 2026-02-12T14:22:36.365 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:22:36.465 INFO:teuthology.dispatcher.supervisor:Running job 46180 2026-02-12T14:22:36.465 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_khiremat@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/khiremat-2026-02-12_14:18:34-fs-main-distro-default-trial/46180 --name khiremat-2026-02-12_14:18:34-fs-main-distro-default-trial --description fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-kernel} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{centos_latest} workloads/cephfs-mirror-ha-workunit} -- /home/teuthworker/mnt/teuthology/khiremat-2026-02-12_14:18:34-fs-main-distro-default-trial/46180/orig.config.yaml 2026-02-12T14:22:36.465 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/khiremat-2026-02-12_14:18:34-fs-main-distro-default-trial/46180 2026-02-12T14:22:36.465 INFO:teuthology.dispatcher.supervisor:Job PID: 3971580 2026-02-12T14:22:36.465 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T14:24:36.566 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:26:36.685 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:28:36.799 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:30:36.966 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:32:37.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:34:37.287 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:36:37.372 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:38:37.511 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T14:38:37.599 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-12T14:38:37.658 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-12T14:38:37.948 INFO:teuthology.orchestra.console.trial181:Power off 2026-02-12T14:38:37.948 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T14:38:37.987 DEBUG:teuthology.orchestra.console.trial181:power off output: Chassis Power Control: Down/Off 2026-02-12T14:38:41.992 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T14:38:42.099 DEBUG:teuthology.orchestra.console.trial181:check power output: Chassis Power is on 2026-02-12T14:38:46.103 DEBUG:teuthology.orchestra.console.trial181:pexpect command: ipmitool -H trial181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T14:38:46.212 DEBUG:teuthology.orchestra.console.trial181:check power output: Chassis Power is off 2026-02-12T14:38:46.213 INFO:teuthology.orchestra.console.trial181:Power off completed 2026-02-12T14:38:46.424 INFO:teuthology.lock.ops:unlocked: trial181.front.sepia.ceph.com