2026-02-12T18:16:18.788 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71
2026-02-12T18:16:18.789 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T18:16:18.859 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T18:16:19.124 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7e2820934bc0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7e282014e020>, signals=[15])
2026-02-12T18:16:19.124 INFO:teuthology.lock.ops:Start node 'trial049.front.sepia.ceph.com' reimaging
2026-02-12T18:16:19.125 INFO:teuthology.lock.ops:Updating [trial049.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T18:16:19.125 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server
2026-02-12T18:16:19.187 INFO:teuthology.lock.ops:Start node 'trial098.front.sepia.ceph.com' reimaging
2026-02-12T18:16:19.188 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T18:16:19.188 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server
2026-02-12T18:16:19.249 INFO:teuthology.lock.ops:Start node 'trial123.front.sepia.ceph.com' reimaging
2026-02-12T18:16:19.249 INFO:teuthology.lock.ops:Updating [trial123.front.sepia.ceph.com]: reset os type and version on server
2026-02-12T18:16:19.249 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server
2026-02-12T18:16:19.476 DEBUG:teuthology.provision.fog.trial049:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T18:16:19.477 DEBUG:teuthology.provision.fog.trial098:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T18:16:19.529 INFO:teuthology.provision.fog.trial049:Scheduling deploy of centos 9.stream
2026-02-12T18:16:19.531 DEBUG:teuthology.provision.fog.trial123:Requesting image trial_centos_9.stream (ID 3)
2026-02-12T18:16:19.532 INFO:teuthology.provision.fog.trial098:Scheduling deploy of centos 9.stream
2026-02-12T18:16:19.552 INFO:teuthology.provision.fog.trial123:Scheduling deploy of centos 9.stream
2026-02-12T18:16:20.925 INFO:teuthology.orchestra.console.trial098:Power off
2026-02-12T18:16:20.925 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T18:16:20.946 INFO:teuthology.orchestra.console.trial049:Power off
2026-02-12T18:16:20.946 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T18:16:20.957 INFO:teuthology.orchestra.console.trial123:Power off
2026-02-12T18:16:20.957 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T18:16:20.990 DEBUG:teuthology.orchestra.console.trial049:power off output: Chassis Power Control: Down/Off
2026-02-12T18:16:21.031 DEBUG:teuthology.orchestra.console.trial123:power off output: Chassis Power Control: Down/Off
2026-02-12T18:16:21.053 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off
2026-02-12T18:16:24.995 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:16:25.032 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:16:25.053 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:16:25.104 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is off
2026-02-12T18:16:25.105 INFO:teuthology.orchestra.console.trial049:Power off completed
2026-02-12T18:16:25.140 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is off
2026-02-12T18:16:25.140 INFO:teuthology.orchestra.console.trial123:Power off completed
2026-02-12T18:16:25.161 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T18:16:25.161 INFO:teuthology.orchestra.console.trial098:Power off completed
2026-02-12T18:16:25.205 INFO:teuthology.orchestra.console.trial049:Power on
2026-02-12T18:16:25.205 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T18:16:25.241 INFO:teuthology.orchestra.console.trial123:Power on
2026-02-12T18:16:25.242 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T18:16:25.248 DEBUG:teuthology.orchestra.console.trial049:power on output: Chassis Power Control: Up/On
2026-02-12T18:16:25.262 INFO:teuthology.orchestra.console.trial098:Power on
2026-02-12T18:16:25.262 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-12T18:16:25.279 DEBUG:teuthology.orchestra.console.trial123:power on output: Chassis Power Control: Up/On
2026-02-12T18:16:25.302 DEBUG:teuthology.orchestra.console.trial098:power on output: Chassis Power Control: Up/On
2026-02-12T18:16:29.254 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:16:29.280 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:16:29.303 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:16:29.365 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is on
2026-02-12T18:16:29.365 INFO:teuthology.orchestra.console.trial049:Power on completed
2026-02-12T18:16:29.390 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is on
2026-02-12T18:16:29.390 INFO:teuthology.orchestra.console.trial123:Power on completed
2026-02-12T18:16:29.411 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on
2026-02-12T18:16:29.411 INFO:teuthology.orchestra.console.trial098:Power on completed
2026-02-12T18:16:29.467 INFO:teuthology.provision.fog.trial049:Waiting for deploy to finish
2026-02-12T18:16:29.491 INFO:teuthology.provision.fog.trial123:Waiting for deploy to finish
2026-02-12T18:16:29.512 INFO:teuthology.provision.fog.trial098:Waiting for deploy to finish
2026-02-12T18:18:16.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:16.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:20.062 WARNING:teuthology.provision.fog.trial123:[Errno None] Unable to connect to port 22 on 10.20.193.123
2026-02-12T18:18:20.062 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T18:18:26.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:26.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:29.149 WARNING:teuthology.provision.fog.trial123:[Errno None] Unable to connect to port 22 on 10.20.193.123
2026-02-12T18:18:29.149 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T18:18:32.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:35.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:35.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:35.293 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T18:18:38.237 WARNING:teuthology.provision.fog.trial123:[Errno None] Unable to connect to port 22 on 10.20.193.123
2026-02-12T18:18:38.237 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T18:18:41.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:44.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:44.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:44.381 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T18:18:47.325 WARNING:teuthology.provision.fog.trial123:[Errno None] Unable to connect to port 22 on 10.20.193.123
2026-02-12T18:18:47.325 WARNING:teuthology.provision.fog.trial098:[Errno None] Unable to connect to port 22 on 10.20.193.98
2026-02-12T18:18:50.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:53.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:53.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:18:53.469 WARNING:teuthology.provision.fog.trial049:[Errno None] Unable to connect to port 22 on 10.20.193.49
2026-02-12T18:18:59.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:19:29.467 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T18:19:29.468 DEBUG:teuthology.orchestra.run.trial098:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T18:19:29.490 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T18:19:29.490 DEBUG:teuthology.orchestra.run.trial123:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T18:19:29.719 INFO:teuthology.provision.fog.trial123:Node is ready
2026-02-12T18:19:29.719 DEBUG:teuthology.orchestra.run.trial123:> hostname
2026-02-12T18:19:29.740 INFO:teuthology.provision.fog.trial098:Node is ready
2026-02-12T18:19:29.740 DEBUG:teuthology.orchestra.run.trial098:> hostname
2026-02-12T18:19:29.774 INFO:teuthology.orchestra.run.trial123.stdout:trial123.front.sepia.ceph.com
2026-02-12T18:19:29.774 DEBUG:teuthology.orchestra.run.trial123:> grep trial123.front.sepia.ceph.com /etc/hosts
2026-02-12T18:19:29.796 INFO:teuthology.orchestra.run.trial098.stdout:trial098.front.sepia.ceph.com
2026-02-12T18:19:29.796 DEBUG:teuthology.orchestra.run.trial098:> grep trial098.front.sepia.ceph.com /etc/hosts
2026-02-12T18:19:29.830 INFO:teuthology.orchestra.run.trial123.stdout:10.20.193.123 trial123.front.sepia.ceph.com trial123
2026-02-12T18:19:29.831 DEBUG:teuthology.orchestra.run.trial123:> sudo hostname trial123
2026-02-12T18:19:29.854 INFO:teuthology.orchestra.run.trial098.stdout:10.20.193.98 trial098.front.sepia.ceph.com trial098
2026-02-12T18:19:29.854 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098
2026-02-12T18:19:29.905 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/trial123.front.sepia.ceph.com/trial123/g' /etc/hosts
2026-02-12T18:19:29.923 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hosts
2026-02-12T18:19:29.971 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/10.20.193.123/10.20.193.123/g' /etc/hosts
2026-02-12T18:19:29.989 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/10.20.193.98/10.20.193.98/g' /etc/hosts
2026-02-12T18:19:30.037 DEBUG:teuthology.orchestra.run.trial123:> sudo sed -i -e 's/trial123.front.sepia.ceph.com/trial123/g' /etc/hostname
2026-02-12T18:19:30.055 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i -e 's/trial098.front.sepia.ceph.com/trial098/g' /etc/hostname
2026-02-12T18:19:30.102 DEBUG:teuthology.orchestra.run.trial123:> sudo hostname trial123
2026-02-12T18:19:30.121 DEBUG:teuthology.orchestra.run.trial098:> sudo hostname trial098
2026-02-12T18:19:30.168 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release
2026-02-12T18:19:30.187 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release
2026-02-12T18:19:30.225 INFO:teuthology.orchestra.run.trial123.stdout:NAME="CentOS Stream"
2026-02-12T18:19:30.225 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="9"
2026-02-12T18:19:30.225 INFO:teuthology.orchestra.run.trial123.stdout:ID="centos"
2026-02-12T18:19:30.225 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel fedora"
2026-02-12T18:19:30.225 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="9"
2026-02-12T18:19:30.225 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el9"
2026-02-12T18:19:30.225 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T18:19:30.225 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;31"
2026-02-12T18:19:30.226 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon"
2026-02-12T18:19:30.226 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T18:19:30.226 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://centos.org/"
2026-02-12T18:19:30.226 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T18:19:30.226 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T18:19:30.226 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T18:19:30.227 INFO:teuthology.provision.fog.trial123:Deploy complete!
2026-02-12T18:19:30.228 DEBUG:teuthology.parallel:result is None
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:NAME="CentOS Stream"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="9"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:ID="centos"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel fedora"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="9"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el9"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;31"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://centos.org/"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T18:19:30.245 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T18:19:30.246 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T18:19:30.246 INFO:teuthology.provision.fog.trial098:Deploy complete!
2026-02-12T18:19:30.247 DEBUG:teuthology.parallel:result is None
2026-02-12T18:19:35.588 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-12T18:19:35.588 DEBUG:teuthology.orchestra.run.trial049:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-12T18:19:40.594 INFO:teuthology.provision.fog.trial049:Node is ready
2026-02-12T18:19:40.594 DEBUG:teuthology.orchestra.run.trial049:> hostname
2026-02-12T18:19:40.612 INFO:teuthology.orchestra.run.trial049.stdout:trial049.front.sepia.ceph.com
2026-02-12T18:19:40.612 DEBUG:teuthology.orchestra.run.trial049:> grep trial049.front.sepia.ceph.com /etc/hosts
2026-02-12T18:19:40.668 INFO:teuthology.orchestra.run.trial049.stdout:10.20.193.49 trial049.front.sepia.ceph.com trial049
2026-02-12T18:19:40.668 DEBUG:teuthology.orchestra.run.trial049:> sudo hostname trial049
2026-02-12T18:19:40.738 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/trial049.front.sepia.ceph.com/trial049/g' /etc/hosts
2026-02-12T18:19:40.803 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/10.20.193.49/10.20.193.49/g' /etc/hosts
2026-02-12T18:19:40.868 DEBUG:teuthology.orchestra.run.trial049:> sudo sed -i -e 's/trial049.front.sepia.ceph.com/trial049/g' /etc/hostname
2026-02-12T18:19:40.933 DEBUG:teuthology.orchestra.run.trial049:> sudo hostname trial049
2026-02-12T18:19:40.996 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release
2026-02-12T18:19:41.052 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T18:19:41.053 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/"
2026-02-12T18:19:41.054 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T18:19:41.054 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T18:19:41.054 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T18:19:41.055 INFO:teuthology.provision.fog.trial049:Deploy complete!
2026-02-12T18:19:41.057 DEBUG:teuthology.parallel:result is None
2026-02-12T18:19:41.588 INFO:teuthology.lock.ops:Checking trial049.front.sepia.ceph.com
2026-02-12T18:19:41.588 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T18:19:41.765 INFO:teuthology.lock.ops:Checking trial098.front.sepia.ceph.com
2026-02-12T18:19:41.765 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T18:19:41.830 INFO:teuthology.lock.ops:Checking trial123.front.sepia.ceph.com
2026-02-12T18:19:41.830 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-12T18:19:41.889 INFO:teuthology.lock.ops:Updating [trial049.front.sepia.ceph.com]: set os type and version on server
2026-02-12T18:19:41.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com'
2026-02-12T18:19:41.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:19:41.951 DEBUG:teuthology.orchestra.run.trial049:> true
2026-02-12T18:19:42.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com'
2026-02-12T18:19:42.027 DEBUG:teuthology.orchestra.run.trial049:> uname -m
2026-02-12T18:19:42.083 INFO:teuthology.orchestra.run.trial049.stdout:x86_64
2026-02-12T18:19:42.084 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release
2026-02-12T18:19:42.139 INFO:teuthology.orchestra.run.trial049.stdout:NAME="CentOS Stream"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="9"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:ID="centos"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel fedora"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="9"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el9"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;31"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://centos.org/"
2026-02-12T18:19:42.140 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T18:19:42.141 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T18:19:42.141 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T18:19:42.141 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server
2026-02-12T18:19:42.247 INFO:teuthology.lock.ops:Updating [trial098.front.sepia.ceph.com]: set os type and version on server
2026-02-12T18:19:42.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com'
2026-02-12T18:19:42.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:19:42.320 DEBUG:teuthology.orchestra.run.trial098:> true
2026-02-12T18:19:42.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial098.front.sepia.ceph.com'
2026-02-12T18:19:42.452 DEBUG:teuthology.orchestra.run.trial098:> uname -m
2026-02-12T18:19:42.508 INFO:teuthology.orchestra.run.trial098.stdout:x86_64
2026-02-12T18:19:42.509 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release
2026-02-12T18:19:42.565 INFO:teuthology.orchestra.run.trial098.stdout:NAME="CentOS Stream"
2026-02-12T18:19:42.565 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="9"
2026-02-12T18:19:42.565 INFO:teuthology.orchestra.run.trial098.stdout:ID="centos"
2026-02-12T18:19:42.565 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel fedora"
2026-02-12T18:19:42.565 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="9"
2026-02-12T18:19:42.565 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el9"
2026-02-12T18:19:42.565 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T18:19:42.565 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;31"
2026-02-12T18:19:42.566 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon"
2026-02-12T18:19:42.566 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T18:19:42.566 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://centos.org/"
2026-02-12T18:19:42.566 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T18:19:42.566 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T18:19:42.566 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T18:19:42.567 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server
2026-02-12T18:19:42.673 INFO:teuthology.lock.ops:Updating [trial123.front.sepia.ceph.com]: set os type and version on server
2026-02-12T18:19:42.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com'
2026-02-12T18:19:42.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-12T18:19:42.737 DEBUG:teuthology.orchestra.run.trial123:> true
2026-02-12T18:19:42.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com'
2026-02-12T18:19:42.882 DEBUG:teuthology.orchestra.run.trial123:> uname -m
2026-02-12T18:19:42.937 INFO:teuthology.orchestra.run.trial123.stdout:x86_64
2026-02-12T18:19:42.938 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:NAME="CentOS Stream"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="9"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:ID="centos"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel fedora"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="9"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el9"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;31"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://centos.org/"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-12T18:19:42.993 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-12T18:19:42.994 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server
2026-02-12T18:19:43.076 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T18:19:43.167 INFO:teuthology.dispatcher.supervisor:Running job 46555
2026-02-12T18:19:43.167 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46555 --name yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial --description rados/multimon/{ceph clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/{bluestore/{alloc$/{bitmap} base mem$/{normal-1} onode-segment$/{none} write$/{v2/{compr$/{yes$/{lz4}} v2}}}} rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} -- /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46555/orig.config.yaml
2026-02-12T18:19:43.168 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46555
2026-02-12T18:19:43.168 INFO:teuthology.dispatcher.supervisor:Job PID: 296158
2026-02-12T18:19:43.168 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-12T18:21:43.268 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T18:23:43.450 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T18:25:43.603 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T18:27:43.821 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-12T18:27:43.910 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-12T18:27:44.084 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-12T18:27:44.810 INFO:teuthology.orchestra.console.trial049:Power off
2026-02-12T18:27:44.810 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T18:27:44.829 INFO:teuthology.orchestra.console.trial123:Power off
2026-02-12T18:27:44.829 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T18:27:44.839 INFO:teuthology.orchestra.console.trial098:Power off
2026-02-12T18:27:44.839 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-12T18:27:44.850 DEBUG:teuthology.orchestra.console.trial049:power off output: Chassis Power Control: Down/Off
2026-02-12T18:27:44.868 DEBUG:teuthology.orchestra.console.trial123:power off output: Chassis Power Control: Down/Off
2026-02-12T18:27:44.877 DEBUG:teuthology.orchestra.console.trial098:power off output: Chassis Power Control: Down/Off
2026-02-12T18:27:48.855 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:27:48.869 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:27:48.878 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:27:48.962 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is on
2026-02-12T18:27:48.976 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is on
2026-02-12T18:27:48.988 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is on
2026-02-12T18:27:52.967 DEBUG:teuthology.orchestra.console.trial049:pexpect command: ipmitool -H trial049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:27:52.978 DEBUG:teuthology.orchestra.console.trial123:pexpect command: ipmitool -H trial123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:27:52.989 DEBUG:teuthology.orchestra.console.trial098:pexpect command: ipmitool -H trial098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-12T18:27:53.078 DEBUG:teuthology.orchestra.console.trial049:check power output: Chassis Power is off
2026-02-12T18:27:53.079 INFO:teuthology.orchestra.console.trial049:Power off completed
2026-02-12T18:27:53.087 DEBUG:teuthology.orchestra.console.trial123:check power output: Chassis Power is off
2026-02-12T18:27:53.087 INFO:teuthology.orchestra.console.trial123:Power off completed
2026-02-12T18:27:53.099 DEBUG:teuthology.orchestra.console.trial098:check power output: Chassis Power is off
2026-02-12T18:27:53.099 INFO:teuthology.orchestra.console.trial098:Power off completed
2026-02-12T18:27:53.372 INFO:teuthology.lock.ops:unlocked: trial049.front.sepia.ceph.com
2026-02-12T18:27:53.382 INFO:teuthology.lock.ops:unlocked: trial123.front.sepia.ceph.com
2026-02-12T18:27:53.386 INFO:teuthology.lock.ops:unlocked: trial098.front.sepia.ceph.com