2026-02-13T01:10:34.286 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae
2026-02-13T01:10:34.287 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:10:34.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:10:34.601 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7576c6bce5d0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7576c6455080>, signals=[15])
2026-02-13T01:10:34.602 INFO:teuthology.lock.ops:Start node 'trial085.front.sepia.ceph.com' reimaging
2026-02-13T01:10:34.602 INFO:teuthology.lock.ops:Updating [trial085.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T01:10:34.602 INFO:teuthology.lock.ops:Updating trial085.front.sepia.ceph.com on lock server
2026-02-13T01:10:34.658 INFO:teuthology.lock.ops:Start node 'trial088.front.sepia.ceph.com' reimaging
2026-02-13T01:10:34.658 INFO:teuthology.lock.ops:Updating [trial088.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T01:10:34.658 INFO:teuthology.lock.ops:Updating trial088.front.sepia.ceph.com on lock server
2026-02-13T01:10:34.715 INFO:teuthology.lock.ops:Start node 'trial167.front.sepia.ceph.com' reimaging
2026-02-13T01:10:34.715 INFO:teuthology.lock.ops:Updating [trial167.front.sepia.ceph.com]: reset os type and version on server
2026-02-13T01:10:34.715 INFO:teuthology.lock.ops:Updating trial167.front.sepia.ceph.com on lock server
2026-02-13T01:10:34.881 DEBUG:teuthology.provision.fog.trial085:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T01:10:34.936 INFO:teuthology.provision.fog.trial085:Scheduling deploy of centos 9.stream
2026-02-13T01:10:34.937 DEBUG:teuthology.provision.fog.trial088:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T01:10:34.969 DEBUG:teuthology.provision.fog.trial167:Requesting image trial_centos_9.stream (ID 3)
2026-02-13T01:10:34.971 INFO:teuthology.provision.fog.trial088:Scheduling deploy of centos 9.stream
2026-02-13T01:10:35.006 INFO:teuthology.provision.fog.trial167:Scheduling deploy of centos 9.stream
2026-02-13T01:10:37.306 INFO:teuthology.orchestra.console.trial088:Power off
2026-02-13T01:10:37.306 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:10:37.325 INFO:teuthology.orchestra.console.trial085:Power off
2026-02-13T01:10:37.325 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:10:37.335 INFO:teuthology.orchestra.console.trial167:Power off
2026-02-13T01:10:37.335 DEBUG:teuthology.orchestra.console.trial167:pexpect command: ipmitool -H trial167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:10:37.343 DEBUG:teuthology.orchestra.console.trial088:power off output: Chassis Power Control: Down/Off
2026-02-13T01:10:37.361 DEBUG:teuthology.orchestra.console.trial085:power off output: Chassis Power Control: Down/Off
2026-02-13T01:10:37.373 DEBUG:teuthology.orchestra.console.trial167:power off output: Chassis Power Control: Down/Off
2026-02-13T01:10:41.347 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:41.361 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:41.374 DEBUG:teuthology.orchestra.console.trial167:pexpect command: ipmitool -H trial167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:41.455 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off
2026-02-13T01:10:41.455 INFO:teuthology.orchestra.console.trial088:Power off completed
2026-02-13T01:10:41.468 DEBUG:teuthology.orchestra.console.trial085:check power output: Chassis Power is off
2026-02-13T01:10:41.468 INFO:teuthology.orchestra.console.trial085:Power off completed
2026-02-13T01:10:41.482 DEBUG:teuthology.orchestra.console.trial167:check power output: Chassis Power is off
2026-02-13T01:10:41.482 INFO:teuthology.orchestra.console.trial167:Power off completed
2026-02-13T01:10:41.556 INFO:teuthology.orchestra.console.trial088:Power on
2026-02-13T01:10:41.556 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T01:10:41.569 INFO:teuthology.orchestra.console.trial085:Power on
2026-02-13T01:10:41.569 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T01:10:41.583 INFO:teuthology.orchestra.console.trial167:Power on
2026-02-13T01:10:41.584 DEBUG:teuthology.orchestra.console.trial167:pexpect command: ipmitool -H trial167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-13T01:10:41.597 DEBUG:teuthology.orchestra.console.trial088:power on output: Chassis Power Control: Up/On
2026-02-13T01:10:41.608 DEBUG:teuthology.orchestra.console.trial085:power on output: Chassis Power Control: Up/On
2026-02-13T01:10:41.621 DEBUG:teuthology.orchestra.console.trial167:power on output: Chassis Power Control: Up/On
2026-02-13T01:10:45.601 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:45.609 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:45.622 DEBUG:teuthology.orchestra.console.trial167:pexpect command: ipmitool -H trial167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:10:45.712 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is on
2026-02-13T01:10:45.712 INFO:teuthology.orchestra.console.trial088:Power on completed
2026-02-13T01:10:45.718 DEBUG:teuthology.orchestra.console.trial085:check power output: Chassis Power is on
2026-02-13T01:10:45.718 INFO:teuthology.orchestra.console.trial085:Power on completed
2026-02-13T01:10:45.731 DEBUG:teuthology.orchestra.console.trial167:check power output: Chassis Power is on
2026-02-13T01:10:45.731 INFO:teuthology.orchestra.console.trial167:Power on completed
2026-02-13T01:10:45.813 INFO:teuthology.provision.fog.trial088:Waiting for deploy to finish
2026-02-13T01:10:45.819 INFO:teuthology.provision.fog.trial085:Waiting for deploy to finish
2026-02-13T01:10:45.832 INFO:teuthology.provision.fog.trial167:Waiting for deploy to finish
2026-02-13T01:13:56.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:00.030 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-13T01:14:06.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:09.117 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-13T01:14:12.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:15.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:15.581 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T01:14:18.205 WARNING:teuthology.provision.fog.trial088:[Errno None] Unable to connect to port 22 on 10.20.193.88
2026-02-13T01:14:21.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:24.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:24.669 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T01:14:27.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:30.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:30.877 WARNING:teuthology.provision.fog.trial167:[Errno None] Unable to connect to port 22 on 10.20.193.167
2026-02-13T01:14:33.757 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T01:14:36.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:39.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:39.965 WARNING:teuthology.provision.fog.trial167:[Errno None] Unable to connect to port 22 on 10.20.193.167
2026-02-13T01:14:42.846 WARNING:teuthology.provision.fog.trial085:[Errno None] Unable to connect to port 22 on 10.20.193.85
2026-02-13T01:14:45.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:48.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:49.053 WARNING:teuthology.provision.fog.trial167:[Errno None] Unable to connect to port 22 on 10.20.193.167
2026-02-13T01:14:55.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:14:58.141 WARNING:teuthology.provision.fog.trial167:[Errno None] Unable to connect to port 22 on 10.20.193.167
2026-02-13T01:15:00.260 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T01:15:00.260 DEBUG:teuthology.orchestra.run.trial088:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T01:15:00.538 INFO:teuthology.provision.fog.trial088:Node is ready
2026-02-13T01:15:00.538 DEBUG:teuthology.orchestra.run.trial088:> hostname
2026-02-13T01:15:00.597 INFO:teuthology.orchestra.run.trial088.stdout:trial088.front.sepia.ceph.com
2026-02-13T01:15:00.598 DEBUG:teuthology.orchestra.run.trial088:> grep trial088.front.sepia.ceph.com /etc/hosts
2026-02-13T01:15:00.658 INFO:teuthology.orchestra.run.trial088.stdout:10.20.193.88 trial088.front.sepia.ceph.com trial088
2026-02-13T01:15:00.658 DEBUG:teuthology.orchestra.run.trial088:> sudo hostname trial088
2026-02-13T01:15:00.731 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/trial088.front.sepia.ceph.com/trial088/g' /etc/hosts
2026-02-13T01:15:00.799 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/10.20.193.88/10.20.193.88/g' /etc/hosts
2026-02-13T01:15:00.867 DEBUG:teuthology.orchestra.run.trial088:> sudo sed -i -e 's/trial088.front.sepia.ceph.com/trial088/g' /etc/hostname
2026-02-13T01:15:00.936 DEBUG:teuthology.orchestra.run.trial088:> sudo hostname trial088
2026-02-13T01:15:01.018 DEBUG:teuthology.orchestra.run.trial088:> cat /etc/os-release
2026-02-13T01:15:01.077 INFO:teuthology.orchestra.run.trial088.stdout:NAME="CentOS Stream"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:VERSION="9"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:ID="centos"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:VERSION_ID="9"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:ANSI_COLOR="0;31"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:15:01.078 INFO:teuthology.orchestra.run.trial088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:15:01.079 INFO:teuthology.orchestra.run.trial088.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:15:01.079 INFO:teuthology.orchestra.run.trial088.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:15:01.079 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:15:01.079 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:15:01.080 INFO:teuthology.provision.fog.trial088:Deploy complete!
2026-02-13T01:15:01.081 DEBUG:teuthology.parallel:result is None
2026-02-13T01:15:04.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:15:24.827 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T01:15:24.828 DEBUG:teuthology.orchestra.run.trial085:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T01:15:25.097 INFO:teuthology.provision.fog.trial085:Node is ready
2026-02-13T01:15:25.097 DEBUG:teuthology.orchestra.run.trial085:> hostname
2026-02-13T01:15:25.154 INFO:teuthology.orchestra.run.trial085.stdout:trial085.front.sepia.ceph.com
2026-02-13T01:15:25.154 DEBUG:teuthology.orchestra.run.trial085:> grep trial085.front.sepia.ceph.com /etc/hosts
2026-02-13T01:15:25.212 INFO:teuthology.orchestra.run.trial085.stdout:10.20.193.85 trial085.front.sepia.ceph.com trial085
2026-02-13T01:15:25.212 DEBUG:teuthology.orchestra.run.trial085:> sudo hostname trial085
2026-02-13T01:15:25.282 DEBUG:teuthology.orchestra.run.trial085:> sudo sed -i -e 's/trial085.front.sepia.ceph.com/trial085/g' /etc/hosts
2026-02-13T01:15:25.348 DEBUG:teuthology.orchestra.run.trial085:> sudo sed -i -e 's/10.20.193.85/10.20.193.85/g' /etc/hosts
2026-02-13T01:15:25.415 DEBUG:teuthology.orchestra.run.trial085:> sudo sed -i -e 's/trial085.front.sepia.ceph.com/trial085/g' /etc/hostname
2026-02-13T01:15:25.481 DEBUG:teuthology.orchestra.run.trial085:> sudo hostname trial085
2026-02-13T01:15:25.547 DEBUG:teuthology.orchestra.run.trial085:> cat /etc/os-release
2026-02-13T01:15:25.602 INFO:teuthology.orchestra.run.trial085.stdout:NAME="CentOS Stream"
2026-02-13T01:15:25.603 INFO:teuthology.orchestra.run.trial085.stdout:VERSION="9"
2026-02-13T01:15:25.603 INFO:teuthology.orchestra.run.trial085.stdout:ID="centos"
2026-02-13T01:15:25.603 INFO:teuthology.orchestra.run.trial085.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:15:25.603 INFO:teuthology.orchestra.run.trial085.stdout:VERSION_ID="9"
2026-02-13T01:15:25.603 INFO:teuthology.orchestra.run.trial085.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:15:25.603 INFO:teuthology.orchestra.run.trial085.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:15:25.603 INFO:teuthology.orchestra.run.trial085.stdout:ANSI_COLOR="0;31"
2026-02-13T01:15:25.603 INFO:teuthology.orchestra.run.trial085.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:15:25.604 INFO:teuthology.orchestra.run.trial085.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:15:25.604 INFO:teuthology.orchestra.run.trial085.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:15:25.604 INFO:teuthology.orchestra.run.trial085.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:15:25.604 INFO:teuthology.orchestra.run.trial085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:15:25.604 INFO:teuthology.orchestra.run.trial085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:15:25.604 INFO:teuthology.provision.fog.trial085:Deploy complete!
2026-02-13T01:15:25.605 DEBUG:teuthology.parallel:result is None
2026-02-13T01:15:40.174 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-13T01:15:40.174 DEBUG:teuthology.orchestra.run.trial167:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-13T01:15:40.333 INFO:teuthology.provision.fog.trial167:Node is ready
2026-02-13T01:15:40.333 DEBUG:teuthology.orchestra.run.trial167:> hostname
2026-02-13T01:15:40.390 INFO:teuthology.orchestra.run.trial167.stdout:trial167.front.sepia.ceph.com
2026-02-13T01:15:40.391 DEBUG:teuthology.orchestra.run.trial167:> grep trial167.front.sepia.ceph.com /etc/hosts
2026-02-13T01:15:40.447 INFO:teuthology.orchestra.run.trial167.stdout:10.20.193.167 trial167.front.sepia.ceph.com trial167
2026-02-13T01:15:40.448 DEBUG:teuthology.orchestra.run.trial167:> sudo hostname trial167
2026-02-13T01:15:40.515 DEBUG:teuthology.orchestra.run.trial167:> sudo sed -i -e 's/trial167.front.sepia.ceph.com/trial167/g' /etc/hosts
2026-02-13T01:15:40.579 DEBUG:teuthology.orchestra.run.trial167:> sudo sed -i -e 's/10.20.193.167/10.20.193.167/g' /etc/hosts
2026-02-13T01:15:40.642 DEBUG:teuthology.orchestra.run.trial167:> sudo sed -i -e 's/trial167.front.sepia.ceph.com/trial167/g' /etc/hostname
2026-02-13T01:15:40.706 DEBUG:teuthology.orchestra.run.trial167:> sudo hostname trial167
2026-02-13T01:15:40.770 DEBUG:teuthology.orchestra.run.trial167:> cat /etc/os-release
2026-02-13T01:15:40.827 INFO:teuthology.orchestra.run.trial167.stdout:NAME="CentOS Stream"
2026-02-13T01:15:40.827 INFO:teuthology.orchestra.run.trial167.stdout:VERSION="9"
2026-02-13T01:15:40.827 INFO:teuthology.orchestra.run.trial167.stdout:ID="centos"
2026-02-13T01:15:40.827 INFO:teuthology.orchestra.run.trial167.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:15:40.827 INFO:teuthology.orchestra.run.trial167.stdout:VERSION_ID="9"
2026-02-13T01:15:40.827 INFO:teuthology.orchestra.run.trial167.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:15:40.827 INFO:teuthology.orchestra.run.trial167.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:15:40.827 INFO:teuthology.orchestra.run.trial167.stdout:ANSI_COLOR="0;31"
2026-02-13T01:15:40.828 INFO:teuthology.orchestra.run.trial167.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:15:40.828 INFO:teuthology.orchestra.run.trial167.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:15:40.828 INFO:teuthology.orchestra.run.trial167.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:15:40.828 INFO:teuthology.orchestra.run.trial167.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:15:40.828 INFO:teuthology.orchestra.run.trial167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:15:40.828 INFO:teuthology.orchestra.run.trial167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:15:40.828 INFO:teuthology.provision.fog.trial167:Deploy complete!
2026-02-13T01:15:40.829 DEBUG:teuthology.parallel:result is None
2026-02-13T01:15:41.334 INFO:teuthology.lock.ops:Checking trial085.front.sepia.ceph.com
2026-02-13T01:15:41.334 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T01:15:41.391 INFO:teuthology.lock.ops:Checking trial088.front.sepia.ceph.com
2026-02-13T01:15:41.391 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T01:15:41.448 INFO:teuthology.lock.ops:Checking trial167.front.sepia.ceph.com
2026-02-13T01:15:41.449 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-13T01:15:41.506 INFO:teuthology.lock.ops:Updating [trial085.front.sepia.ceph.com]: set os type and version on server
2026-02-13T01:15:41.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial085.front.sepia.ceph.com'
2026-02-13T01:15:41.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:15:41.566 DEBUG:teuthology.orchestra.run.trial085:> true
2026-02-13T01:15:41.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial085.front.sepia.ceph.com'
2026-02-13T01:15:41.717 DEBUG:teuthology.orchestra.run.trial085:> uname -m
2026-02-13T01:15:41.773 INFO:teuthology.orchestra.run.trial085.stdout:x86_64
2026-02-13T01:15:41.773 DEBUG:teuthology.orchestra.run.trial085:> cat /etc/os-release
2026-02-13T01:15:41.829 INFO:teuthology.orchestra.run.trial085.stdout:NAME="CentOS Stream"
2026-02-13T01:15:41.829 INFO:teuthology.orchestra.run.trial085.stdout:VERSION="9"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:ID="centos"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:VERSION_ID="9"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:ANSI_COLOR="0;31"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:15:41.830 INFO:teuthology.orchestra.run.trial085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:15:41.831 INFO:teuthology.orchestra.run.trial085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:15:41.831 INFO:teuthology.lock.ops:Updating trial085.front.sepia.ceph.com on lock server
2026-02-13T01:15:41.937 INFO:teuthology.lock.ops:Updating [trial088.front.sepia.ceph.com]: set os type and version on server
2026-02-13T01:15:41.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial088.front.sepia.ceph.com'
2026-02-13T01:15:41.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:15:42.003 DEBUG:teuthology.orchestra.run.trial088:> true
2026-02-13T01:15:42.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial088.front.sepia.ceph.com'
2026-02-13T01:15:42.143 DEBUG:teuthology.orchestra.run.trial088:> uname -m
2026-02-13T01:15:42.199 INFO:teuthology.orchestra.run.trial088.stdout:x86_64
2026-02-13T01:15:42.199 DEBUG:teuthology.orchestra.run.trial088:> cat /etc/os-release
2026-02-13T01:15:42.257 INFO:teuthology.orchestra.run.trial088.stdout:NAME="CentOS Stream"
2026-02-13T01:15:42.257 INFO:teuthology.orchestra.run.trial088.stdout:VERSION="9"
2026-02-13T01:15:42.257 INFO:teuthology.orchestra.run.trial088.stdout:ID="centos"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:VERSION_ID="9"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:ANSI_COLOR="0;31"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:15:42.258 INFO:teuthology.orchestra.run.trial088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:15:42.259 INFO:teuthology.lock.ops:Updating trial088.front.sepia.ceph.com on lock server
2026-02-13T01:15:42.365 INFO:teuthology.lock.ops:Updating [trial167.front.sepia.ceph.com]: set os type and version on server
2026-02-13T01:15:42.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial167.front.sepia.ceph.com'
2026-02-13T01:15:42.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-13T01:15:42.427 DEBUG:teuthology.orchestra.run.trial167:> true
2026-02-13T01:15:42.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial167.front.sepia.ceph.com'
2026-02-13T01:15:42.503 DEBUG:teuthology.orchestra.run.trial167:> uname -m
2026-02-13T01:15:42.558 INFO:teuthology.orchestra.run.trial167.stdout:x86_64
2026-02-13T01:15:42.558 DEBUG:teuthology.orchestra.run.trial167:> cat /etc/os-release
2026-02-13T01:15:42.615 INFO:teuthology.orchestra.run.trial167.stdout:NAME="CentOS Stream"
2026-02-13T01:15:42.615 INFO:teuthology.orchestra.run.trial167.stdout:VERSION="9"
2026-02-13T01:15:42.615 INFO:teuthology.orchestra.run.trial167.stdout:ID="centos"
2026-02-13T01:15:42.615 INFO:teuthology.orchestra.run.trial167.stdout:ID_LIKE="rhel fedora"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:VERSION_ID="9"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:PLATFORM_ID="platform:el9"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:ANSI_COLOR="0;31"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:LOGO="fedora-logo-icon"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:HOME_URL="https://centos.org/"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-13T01:15:42.616 INFO:teuthology.orchestra.run.trial167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-13T01:15:42.617 INFO:teuthology.lock.ops:Updating trial167.front.sepia.ceph.com on lock server
2026-02-13T01:15:42.720 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:15:42.850 INFO:teuthology.dispatcher.supervisor:Running job 47462
2026-02-13T01:15:42.850 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47462 --name pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial --description fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsync-tester}} -- /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47462/orig.config.yaml
2026-02-13T01:15:42.851 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47462
2026-02-13T01:15:42.851 INFO:teuthology.dispatcher.supervisor:Job PID: 1004887
2026-02-13T01:15:42.851 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-13T01:17:42.951 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:19:43.121 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:21:43.308 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:23:43.501 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:25:43.688 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:27:43.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:29:44.073 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:31:44.280 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:33:44.487 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:35:44.706 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:37:44.888 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:39:45.080 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:41:45.286 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:43:45.472 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:45:45.670 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-13T01:45:45.739 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-13T01:45:45.909 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-13T01:45:46.629 INFO:teuthology.orchestra.console.trial088:Power off
2026-02-13T01:45:46.629 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:45:46.641 INFO:teuthology.orchestra.console.trial167:Power off
2026-02-13T01:45:46.642 DEBUG:teuthology.orchestra.console.trial167:pexpect command: ipmitool -H trial167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:45:46.651 INFO:teuthology.orchestra.console.trial085:Power off
2026-02-13T01:45:46.651 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-13T01:45:46.670 DEBUG:teuthology.orchestra.console.trial088:power off output: Chassis Power Control: Down/Off
2026-02-13T01:45:46.680 DEBUG:teuthology.orchestra.console.trial167:power off output: Chassis Power Control: Down/Off
2026-02-13T01:45:46.687 DEBUG:teuthology.orchestra.console.trial085:power off output: Chassis Power Control: Down/Off
2026-02-13T01:45:50.675 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:45:50.682 DEBUG:teuthology.orchestra.console.trial167:pexpect command: ipmitool -H trial167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:45:50.688 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:45:50.784 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is on
2026-02-13T01:45:50.789 DEBUG:teuthology.orchestra.console.trial167:check power output: Chassis Power is on
2026-02-13T01:45:50.796 DEBUG:teuthology.orchestra.console.trial085:check power output: Chassis Power is on
2026-02-13T01:45:54.789 DEBUG:teuthology.orchestra.console.trial088:pexpect command: ipmitool -H trial088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:45:54.797 DEBUG:teuthology.orchestra.console.trial167:pexpect command: ipmitool -H trial167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:45:54.805 DEBUG:teuthology.orchestra.console.trial085:pexpect command: ipmitool -H trial085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-13T01:45:54.899 DEBUG:teuthology.orchestra.console.trial088:check power output: Chassis Power is off
2026-02-13T01:45:54.900 INFO:teuthology.orchestra.console.trial088:Power off completed
2026-02-13T01:45:54.906 DEBUG:teuthology.orchestra.console.trial167:check power output: Chassis Power is off
2026-02-13T01:45:54.907 INFO:teuthology.orchestra.console.trial167:Power off completed
2026-02-13T01:45:54.913 DEBUG:teuthology.orchestra.console.trial085:check power output: Chassis Power is off
2026-02-13T01:45:54.913 INFO:teuthology.orchestra.console.trial085:Power off completed
2026-02-13T01:45:55.189 INFO:teuthology.lock.ops:unlocked: trial088.front.sepia.ceph.com
2026-02-13T01:45:55.199 INFO:teuthology.lock.ops:unlocked: trial167.front.sepia.ceph.com
2026-02-13T01:45:55.203 INFO:teuthology.lock.ops:unlocked: trial085.front.sepia.ceph.com