2026-02-17T21:39:26.251 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-17T21:39:26.251 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:39:26.322 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:39:26.572 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7cce799f1e50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7cce79248cc0>, signals=[15])
2026-02-17T21:39:26.572 INFO:teuthology.lock.ops:Start node 'trial014.front.sepia.ceph.com' reimaging
2026-02-17T21:39:26.572 INFO:teuthology.lock.ops:Updating [trial014.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T21:39:26.572 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server
2026-02-17T21:39:27.416 INFO:teuthology.lock.ops:Start node 'trial043.front.sepia.ceph.com' reimaging
2026-02-17T21:39:27.416 INFO:teuthology.lock.ops:Updating [trial043.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T21:39:27.416 INFO:teuthology.lock.ops:Updating trial043.front.sepia.ceph.com on lock server
2026-02-17T21:39:27.475 INFO:teuthology.lock.ops:Start node 'trial102.front.sepia.ceph.com' reimaging
2026-02-17T21:39:27.475 INFO:teuthology.lock.ops:Updating [trial102.front.sepia.ceph.com]: reset os type and version on server
2026-02-17T21:39:27.475 INFO:teuthology.lock.ops:Updating trial102.front.sepia.ceph.com on lock server
2026-02-17T21:39:27.706 DEBUG:teuthology.provision.fog.trial014:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T21:39:27.757 DEBUG:teuthology.provision.fog.trial043:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T21:39:27.759 INFO:teuthology.provision.fog.trial014:Scheduling deploy of centos 9.stream
2026-02-17T21:39:27.767 DEBUG:teuthology.provision.fog.trial102:Requesting image trial_centos_9.stream (ID 3)
2026-02-17T21:39:27.811 INFO:teuthology.provision.fog.trial043:Scheduling deploy of centos 9.stream
2026-02-17T21:39:27.818 INFO:teuthology.provision.fog.trial102:Scheduling deploy of centos 9.stream
2026-02-17T21:39:29.265 INFO:teuthology.orchestra.console.trial014:Power off
2026-02-17T21:39:29.265 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T21:39:29.367 DEBUG:teuthology.orchestra.console.trial014:power off output: Chassis Power Control: Down/Off
2026-02-17T21:39:29.371 INFO:teuthology.orchestra.console.trial043:Power off
2026-02-17T21:39:29.371 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T21:39:29.388 INFO:teuthology.orchestra.console.trial102:Power off
2026-02-17T21:39:29.388 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T21:39:29.408 DEBUG:teuthology.orchestra.console.trial043:power off output: Chassis Power Control: Down/Off
2026-02-17T21:39:29.425 DEBUG:teuthology.orchestra.console.trial102:power off output: Chassis Power Control: Down/Off
2026-02-17T21:39:33.371 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T21:39:33.409 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T21:39:33.425 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T21:39:33.481 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is off
2026-02-17T21:39:33.481 INFO:teuthology.orchestra.console.trial014:Power off completed
2026-02-17T21:39:33.517 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is off
2026-02-17T21:39:33.517 INFO:teuthology.orchestra.console.trial043:Power off completed
2026-02-17T21:39:33.533 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is off
2026-02-17T21:39:33.533 INFO:teuthology.orchestra.console.trial102:Power off completed
2026-02-17T21:39:33.582 INFO:teuthology.orchestra.console.trial014:Power on
2026-02-17T21:39:33.583 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T21:39:33.618 INFO:teuthology.orchestra.console.trial043:Power on
2026-02-17T21:39:33.619 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T21:39:33.628 DEBUG:teuthology.orchestra.console.trial014:power on output: Chassis Power Control: Up/On
2026-02-17T21:39:33.634 INFO:teuthology.orchestra.console.trial102:Power on
2026-02-17T21:39:33.634 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-17T21:39:33.659 DEBUG:teuthology.orchestra.console.trial043:power on output: Chassis Power Control: Up/On
2026-02-17T21:39:33.671 DEBUG:teuthology.orchestra.console.trial102:power on output: Chassis Power Control: Up/On
2026-02-17T21:39:37.633 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T21:39:37.660 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T21:39:37.672 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T21:39:37.744 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is on
2026-02-17T21:39:37.744 INFO:teuthology.orchestra.console.trial014:Power on completed
2026-02-17T21:39:37.769 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is on
2026-02-17T21:39:37.769 INFO:teuthology.orchestra.console.trial043:Power on completed
2026-02-17T21:39:37.781 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is on
2026-02-17T21:39:37.781 INFO:teuthology.orchestra.console.trial102:Power on completed
2026-02-17T21:39:37.846 INFO:teuthology.provision.fog.trial014:Waiting for deploy to finish
2026-02-17T21:39:37.870 INFO:teuthology.provision.fog.trial043:Waiting for deploy to finish
2026-02-17T21:39:37.882 INFO:teuthology.provision.fog.trial102:Waiting for deploy to finish
2026-02-17T21:41:25.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:41:25.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:41:25.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:41:25.600 ERROR:teuthology.orchestra.connection:Error authenticating with trial102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-17T21:41:28.512 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14
2026-02-17T21:41:34.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:41:37.600 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14
2026-02-17T21:41:39.841 WARNING:teuthology.provision.fog.trial043:[Errno None] Unable to connect to port 22 on 10.20.193.43
2026-02-17T21:41:43.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:41:45.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:41:46.688 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14
2026-02-17T21:41:48.928 WARNING:teuthology.provision.fog.trial043:[Errno None] Unable to connect to port 22 on 10.20.193.43
2026-02-17T21:41:52.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:41:54.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:41:55.776 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14
2026-02-17T21:41:58.016 WARNING:teuthology.provision.fog.trial043:[Errno None] Unable to connect to port 22 on 10.20.193.43
2026-02-17T21:42:01.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:42:04.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:42:04.864 WARNING:teuthology.provision.fog.trial014:[Errno None] Unable to connect to port 22 on 10.20.193.14
2026-02-17T21:42:07.104 WARNING:teuthology.provision.fog.trial043:[Errno None] Unable to connect to port 22 on 10.20.193.43
2026-02-17T21:42:10.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:42:13.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:42:29.603 WARNING:teuthology.provision.fog.trial102:timed out
2026-02-17T21:42:35.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:42:37.767 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T21:42:37.767 DEBUG:teuthology.orchestra.run.trial102:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T21:42:47.031 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T21:42:47.032 DEBUG:teuthology.orchestra.run.trial014:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T21:42:47.262 INFO:teuthology.provision.fog.trial014:Node is ready
2026-02-17T21:42:47.262 DEBUG:teuthology.orchestra.run.trial014:> hostname
2026-02-17T21:42:47.319 INFO:teuthology.orchestra.run.trial014.stdout:trial014.front.sepia.ceph.com
2026-02-17T21:42:47.319 DEBUG:teuthology.orchestra.run.trial014:> grep trial014.front.sepia.ceph.com /etc/hosts
2026-02-17T21:42:47.375 INFO:teuthology.orchestra.run.trial014.stdout:10.20.193.14 trial014.front.sepia.ceph.com trial014
2026-02-17T21:42:47.375 DEBUG:teuthology.orchestra.run.trial014:> sudo hostname trial014
2026-02-17T21:42:47.446 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/trial014.front.sepia.ceph.com/trial014/g' /etc/hosts
2026-02-17T21:42:47.512 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/10.20.193.14/10.20.193.14/g' /etc/hosts
2026-02-17T21:42:47.577 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i -e 's/trial014.front.sepia.ceph.com/trial014/g' /etc/hostname
2026-02-17T21:42:47.643 DEBUG:teuthology.orchestra.run.trial014:> sudo hostname trial014
2026-02-17T21:42:47.708 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release
2026-02-17T21:42:47.766 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream"
2026-02-17T21:42:47.766 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9"
2026-02-17T21:42:47.766 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T21:42:47.767 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T21:42:47.768 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T21:42:47.769 INFO:teuthology.provision.fog.trial014:Deploy complete!
2026-02-17T21:42:47.770 DEBUG:teuthology.parallel:result is None
2026-02-17T21:42:48.386 INFO:teuthology.provision.fog.trial102:Node is ready
2026-02-17T21:42:48.386 DEBUG:teuthology.orchestra.run.trial102:> hostname
2026-02-17T21:42:48.441 INFO:teuthology.orchestra.run.trial102.stdout:trial102.front.sepia.ceph.com
2026-02-17T21:42:48.442 DEBUG:teuthology.orchestra.run.trial102:> grep trial102.front.sepia.ceph.com /etc/hosts
2026-02-17T21:42:48.515 INFO:teuthology.orchestra.run.trial102.stdout:10.20.193.102 trial102.front.sepia.ceph.com trial102
2026-02-17T21:42:48.515 DEBUG:teuthology.orchestra.run.trial102:> sudo hostname trial102
2026-02-17T21:42:48.569 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/trial102.front.sepia.ceph.com/trial102/g' /etc/hosts
2026-02-17T21:42:48.593 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/10.20.193.102/10.20.193.102/g' /etc/hosts
2026-02-17T21:42:48.659 DEBUG:teuthology.orchestra.run.trial102:> sudo sed -i -e 's/trial102.front.sepia.ceph.com/trial102/g' /etc/hostname
2026-02-17T21:42:48.724 DEBUG:teuthology.orchestra.run.trial102:> sudo hostname trial102
2026-02-17T21:42:48.789 DEBUG:teuthology.orchestra.run.trial102:> cat /etc/os-release
2026-02-17T21:42:48.846 INFO:teuthology.orchestra.run.trial102.stdout:NAME="CentOS Stream"
2026-02-17T21:42:48.847 INFO:teuthology.orchestra.run.trial102.stdout:VERSION="9"
2026-02-17T21:42:48.847 INFO:teuthology.orchestra.run.trial102.stdout:ID="centos"
2026-02-17T21:42:48.847 INFO:teuthology.orchestra.run.trial102.stdout:ID_LIKE="rhel fedora"
2026-02-17T21:42:48.847 INFO:teuthology.orchestra.run.trial102.stdout:VERSION_ID="9"
2026-02-17T21:42:48.847 INFO:teuthology.orchestra.run.trial102.stdout:PLATFORM_ID="platform:el9"
2026-02-17T21:42:48.847 INFO:teuthology.orchestra.run.trial102.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T21:42:48.847 INFO:teuthology.orchestra.run.trial102.stdout:ANSI_COLOR="0;31"
2026-02-17T21:42:48.847 INFO:teuthology.orchestra.run.trial102.stdout:LOGO="fedora-logo-icon"
2026-02-17T21:42:48.848 INFO:teuthology.orchestra.run.trial102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T21:42:48.848 INFO:teuthology.orchestra.run.trial102.stdout:HOME_URL="https://centos.org/"
2026-02-17T21:42:48.848 INFO:teuthology.orchestra.run.trial102.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T21:42:48.848 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T21:42:48.848 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T21:42:48.848 INFO:teuthology.provision.fog.trial102:Deploy complete!
2026-02-17T21:42:48.849 DEBUG:teuthology.parallel:result is None
2026-02-17T21:42:49.080 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-17T21:42:49.080 DEBUG:teuthology.orchestra.run.trial043:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-17T21:42:49.234 INFO:teuthology.provision.fog.trial043:Node is ready
2026-02-17T21:42:49.234 DEBUG:teuthology.orchestra.run.trial043:> hostname
2026-02-17T21:42:49.292 INFO:teuthology.orchestra.run.trial043.stdout:trial043.front.sepia.ceph.com
2026-02-17T21:42:49.293 DEBUG:teuthology.orchestra.run.trial043:> grep trial043.front.sepia.ceph.com /etc/hosts
2026-02-17T21:42:49.348 INFO:teuthology.orchestra.run.trial043.stdout:10.20.193.43 trial043.front.sepia.ceph.com trial043
2026-02-17T21:42:49.349 DEBUG:teuthology.orchestra.run.trial043:> sudo hostname trial043
2026-02-17T21:42:49.417 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/trial043.front.sepia.ceph.com/trial043/g' /etc/hosts
2026-02-17T21:42:49.482 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/10.20.193.43/10.20.193.43/g' /etc/hosts
2026-02-17T21:42:49.546 DEBUG:teuthology.orchestra.run.trial043:> sudo sed -i -e 's/trial043.front.sepia.ceph.com/trial043/g' /etc/hostname
2026-02-17T21:42:49.610 DEBUG:teuthology.orchestra.run.trial043:> sudo hostname trial043
2026-02-17T21:42:49.676 DEBUG:teuthology.orchestra.run.trial043:> cat /etc/os-release
2026-02-17T21:42:49.732 INFO:teuthology.orchestra.run.trial043.stdout:NAME="CentOS Stream"
2026-02-17T21:42:49.732 INFO:teuthology.orchestra.run.trial043.stdout:VERSION="9"
2026-02-17T21:42:49.732 INFO:teuthology.orchestra.run.trial043.stdout:ID="centos"
2026-02-17T21:42:49.732 INFO:teuthology.orchestra.run.trial043.stdout:ID_LIKE="rhel fedora"
2026-02-17T21:42:49.732 INFO:teuthology.orchestra.run.trial043.stdout:VERSION_ID="9"
2026-02-17T21:42:49.732 INFO:teuthology.orchestra.run.trial043.stdout:PLATFORM_ID="platform:el9"
2026-02-17T21:42:49.733 INFO:teuthology.orchestra.run.trial043.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T21:42:49.733 INFO:teuthology.orchestra.run.trial043.stdout:ANSI_COLOR="0;31"
2026-02-17T21:42:49.733 INFO:teuthology.orchestra.run.trial043.stdout:LOGO="fedora-logo-icon"
2026-02-17T21:42:49.733 INFO:teuthology.orchestra.run.trial043.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T21:42:49.733 INFO:teuthology.orchestra.run.trial043.stdout:HOME_URL="https://centos.org/"
2026-02-17T21:42:49.733 INFO:teuthology.orchestra.run.trial043.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T21:42:49.733 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T21:42:49.733 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T21:42:49.734 INFO:teuthology.provision.fog.trial043:Deploy complete!
2026-02-17T21:42:49.734 DEBUG:teuthology.parallel:result is None
2026-02-17T21:42:50.264 INFO:teuthology.lock.ops:Checking trial014.front.sepia.ceph.com
2026-02-17T21:42:50.264 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T21:42:50.373 INFO:teuthology.lock.ops:Checking trial043.front.sepia.ceph.com
2026-02-17T21:42:50.374 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T21:42:50.440 INFO:teuthology.lock.ops:Checking trial102.front.sepia.ceph.com
2026-02-17T21:42:50.440 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-17T21:42:50.497 INFO:teuthology.lock.ops:Updating [trial014.front.sepia.ceph.com]: set os type and version on server
2026-02-17T21:42:50.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com'
2026-02-17T21:42:50.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:42:50.560 DEBUG:teuthology.orchestra.run.trial014:> true
2026-02-17T21:42:50.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial014.front.sepia.ceph.com'
2026-02-17T21:42:50.638 DEBUG:teuthology.orchestra.run.trial014:> uname -m
2026-02-17T21:42:50.693 INFO:teuthology.orchestra.run.trial014.stdout:x86_64
2026-02-17T21:42:50.694 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release
2026-02-17T21:42:50.749 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream"
2026-02-17T21:42:50.749 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9"
2026-02-17T21:42:50.749 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T21:42:50.750 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T21:42:50.751 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server
2026-02-17T21:42:50.852 INFO:teuthology.lock.ops:Updating [trial043.front.sepia.ceph.com]: set os type and version on server
2026-02-17T21:42:50.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial043.front.sepia.ceph.com'
2026-02-17T21:42:50.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:42:50.922 DEBUG:teuthology.orchestra.run.trial043:> true
2026-02-17T21:42:50.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial043.front.sepia.ceph.com'
2026-02-17T21:42:50.994 DEBUG:teuthology.orchestra.run.trial043:> uname -m
2026-02-17T21:42:51.050 INFO:teuthology.orchestra.run.trial043.stdout:x86_64
2026-02-17T21:42:51.050 DEBUG:teuthology.orchestra.run.trial043:> cat /etc/os-release
2026-02-17T21:42:51.106 INFO:teuthology.orchestra.run.trial043.stdout:NAME="CentOS Stream"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:VERSION="9"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:ID="centos"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:ID_LIKE="rhel fedora"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:VERSION_ID="9"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:PLATFORM_ID="platform:el9"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:ANSI_COLOR="0;31"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:LOGO="fedora-logo-icon"
2026-02-17T21:42:51.107 INFO:teuthology.orchestra.run.trial043.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T21:42:51.108 INFO:teuthology.orchestra.run.trial043.stdout:HOME_URL="https://centos.org/"
2026-02-17T21:42:51.108 INFO:teuthology.orchestra.run.trial043.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T21:42:51.108 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T21:42:51.108 INFO:teuthology.orchestra.run.trial043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T21:42:51.109 INFO:teuthology.lock.ops:Updating trial043.front.sepia.ceph.com on lock server
2026-02-17T21:42:51.211 INFO:teuthology.lock.ops:Updating [trial102.front.sepia.ceph.com]: set os type and version on server
2026-02-17T21:42:51.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial102.front.sepia.ceph.com'
2026-02-17T21:42:51.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-17T21:42:51.282 DEBUG:teuthology.orchestra.run.trial102:> true
2026-02-17T21:42:51.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial102.front.sepia.ceph.com'
2026-02-17T21:42:51.357 DEBUG:teuthology.orchestra.run.trial102:> uname -m
2026-02-17T21:42:51.414 INFO:teuthology.orchestra.run.trial102.stdout:x86_64
2026-02-17T21:42:51.414 DEBUG:teuthology.orchestra.run.trial102:> cat /etc/os-release
2026-02-17T21:42:51.469 INFO:teuthology.orchestra.run.trial102.stdout:NAME="CentOS Stream"
2026-02-17T21:42:51.469 INFO:teuthology.orchestra.run.trial102.stdout:VERSION="9"
2026-02-17T21:42:51.469 INFO:teuthology.orchestra.run.trial102.stdout:ID="centos"
2026-02-17T21:42:51.469 INFO:teuthology.orchestra.run.trial102.stdout:ID_LIKE="rhel fedora"
2026-02-17T21:42:51.470 INFO:teuthology.orchestra.run.trial102.stdout:VERSION_ID="9"
2026-02-17T21:42:51.470 INFO:teuthology.orchestra.run.trial102.stdout:PLATFORM_ID="platform:el9"
2026-02-17T21:42:51.470 INFO:teuthology.orchestra.run.trial102.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-17T21:42:51.470 INFO:teuthology.orchestra.run.trial102.stdout:ANSI_COLOR="0;31"
2026-02-17T21:42:51.470 INFO:teuthology.orchestra.run.trial102.stdout:LOGO="fedora-logo-icon"
2026-02-17T21:42:51.470 INFO:teuthology.orchestra.run.trial102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-17T21:42:51.470 INFO:teuthology.orchestra.run.trial102.stdout:HOME_URL="https://centos.org/"
2026-02-17T21:42:51.471 INFO:teuthology.orchestra.run.trial102.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-17T21:42:51.471 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-17T21:42:51.471 INFO:teuthology.orchestra.run.trial102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-17T21:42:51.472 INFO:teuthology.lock.ops:Updating trial102.front.sepia.ceph.com on lock server
2026-02-17T21:42:51.574 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:42:51.673 INFO:teuthology.dispatcher.supervisor:Running job 53941
2026-02-17T21:42:51.673 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_yuriw@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:13:22-upgrade-20.2.1_2.17.26-baseline_2-distro-default-trial/53941 --name yuriw-2026-02-17_21:13:22-upgrade-20.2.1_2.17.26-baseline_2-distro-default-trial --description upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} kernel overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/yes}} -- /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:13:22-upgrade-20.2.1_2.17.26-baseline_2-distro-default-trial/53941/orig.config.yaml
2026-02-17T21:42:51.674 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_21:13:22-upgrade-20.2.1_2.17.26-baseline_2-distro-default-trial/53941
2026-02-17T21:42:51.674 INFO:teuthology.dispatcher.supervisor:Job PID: 1620754
2026-02-17T21:42:51.674 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-17T21:44:51.675 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:46:51.797 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:48:54.111 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:50:54.190 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:52:54.311 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:54:54.428 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:56:59.026 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T21:58:59.145 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:00:59.272 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:02:59.391 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:04:59.513 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:06:59.626 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:08:59.750 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:10:59.869 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:12:59.996 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:15:00.121 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:17:00.246 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:19:00.332 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:21:00.457 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:23:00.577 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:25:00.698 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:27:00.845 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:29:00.990 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:31:01.102 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:33:01.224 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:35:01.346 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:37:01.470 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:39:01.593 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:41:01.743 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:43:03.637 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:45:03.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:47:03.841 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:49:03.918 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:51:04.043 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:53:04.168 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:55:04.295 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:57:04.416 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T22:59:04.537 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:01:04.667 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:03:04.789 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:05:06.370 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:07:06.508 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:09:06.633 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:11:06.756 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:13:06.836 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:15:06.959 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-17T23:15:07.078 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-17T23:15:07.254 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-17T23:15:07.971 INFO:teuthology.orchestra.console.trial043:Power off
2026-02-17T23:15:07.971 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T23:15:07.980 INFO:teuthology.orchestra.console.trial014:Power off
2026-02-17T23:15:07.980 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T23:15:07.998 INFO:teuthology.orchestra.console.trial102:Power off
2026-02-17T23:15:07.999 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-17T23:15:08.010 DEBUG:teuthology.orchestra.console.trial043:power off output: Chassis Power Control: Down/Off
2026-02-17T23:15:08.018 DEBUG:teuthology.orchestra.console.trial014:power off output: Chassis Power Control: Down/Off
2026-02-17T23:15:08.037 DEBUG:teuthology.orchestra.console.trial102:power off output: Chassis Power Control: Down/Off
2026-02-17T23:15:12.011 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T23:15:12.019 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T23:15:12.037 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T23:15:12.122 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is on
2026-02-17T23:15:12.129 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is on
2026-02-17T23:15:12.148 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is on
2026-02-17T23:15:16.123 DEBUG:teuthology.orchestra.console.trial043:pexpect command: ipmitool -H trial043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T23:15:16.132 DEBUG:teuthology.orchestra.console.trial014:pexpect command: ipmitool -H trial014.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T23:15:16.149 DEBUG:teuthology.orchestra.console.trial102:pexpect command: ipmitool -H trial102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-17T23:15:16.234 DEBUG:teuthology.orchestra.console.trial043:check power output: Chassis Power is off
2026-02-17T23:15:16.234 INFO:teuthology.orchestra.console.trial043:Power off completed
2026-02-17T23:15:16.241 DEBUG:teuthology.orchestra.console.trial014:check power output: Chassis Power is off
2026-02-17T23:15:16.242 INFO:teuthology.orchestra.console.trial014:Power off completed
2026-02-17T23:15:16.258 DEBUG:teuthology.orchestra.console.trial102:check power output: Chassis Power is off
2026-02-17T23:15:16.258 INFO:teuthology.orchestra.console.trial102:Power off completed
2026-02-17T23:15:16.553 INFO:teuthology.lock.ops:unlocked: trial014.front.sepia.ceph.com
2026-02-17T23:15:16.561 INFO:teuthology.lock.ops:unlocked: trial102.front.sepia.ceph.com
2026-02-17T23:15:17.659 INFO:teuthology.lock.ops:unlocked: trial043.front.sepia.ceph.com