2026-02-12T00:23:06.374 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T00:23:06.374 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:23:06.448 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:23:06.702 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x780aeb5805e0>, signals=[15]) 2026-02-12T00:23:06.702 INFO:teuthology.lock.ops:Start node 'trial107.front.sepia.ceph.com' reimaging 2026-02-12T00:23:06.702 INFO:teuthology.lock.ops:Updating [trial107.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T00:23:06.702 INFO:teuthology.lock.ops:Updating trial107.front.sepia.ceph.com on lock server 2026-02-12T00:23:06.761 INFO:teuthology.lock.ops:Start node 'trial108.front.sepia.ceph.com' reimaging 2026-02-12T00:23:06.761 INFO:teuthology.lock.ops:Updating [trial108.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T00:23:06.761 INFO:teuthology.lock.ops:Updating trial108.front.sepia.ceph.com on lock server 2026-02-12T00:23:06.819 INFO:teuthology.lock.ops:Start node 'trial112.front.sepia.ceph.com' reimaging 2026-02-12T00:23:06.819 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: reset os type and version on server 2026-02-12T00:23:06.819 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server 2026-02-12T00:23:07.036 DEBUG:teuthology.provision.fog.trial107:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T00:23:07.036 DEBUG:teuthology.provision.fog.trial108:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T00:23:07.067 DEBUG:teuthology.provision.fog.trial112:Requesting image trial_centos_9.stream (ID 3) 2026-02-12T00:23:07.086 INFO:teuthology.provision.fog.trial107:Scheduling deploy of centos 9.stream 2026-02-12T00:23:07.088 INFO:teuthology.provision.fog.trial108:Scheduling deploy of centos 9.stream 2026-02-12T00:23:07.126 INFO:teuthology.provision.fog.trial112:Scheduling deploy of centos 9.stream 2026-02-12T00:23:08.215 INFO:teuthology.orchestra.console.trial108:Power off 2026-02-12T00:23:08.215 DEBUG:teuthology.orchestra.console.trial108:pexpect command: ipmitool -H trial108.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T00:23:08.227 INFO:teuthology.orchestra.console.trial112:Power off 2026-02-12T00:23:08.228 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T00:23:08.238 INFO:teuthology.orchestra.console.trial107:Power off 2026-02-12T00:23:08.238 DEBUG:teuthology.orchestra.console.trial107:pexpect command: ipmitool -H trial107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T00:23:08.258 DEBUG:teuthology.orchestra.console.trial108:power off output: Chassis Power Control: Down/Off 2026-02-12T00:23:08.265 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off 2026-02-12T00:23:08.275 DEBUG:teuthology.orchestra.console.trial107:power off output: Chassis Power Control: Down/Off 2026-02-12T00:23:12.263 DEBUG:teuthology.orchestra.console.trial108:pexpect command: ipmitool -H trial108.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T00:23:12.270 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T00:23:12.276 DEBUG:teuthology.orchestra.console.trial107:pexpect command: ipmitool -H trial107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T00:23:12.372 DEBUG:teuthology.orchestra.console.trial108:check power output: Chassis Power is off 2026-02-12T00:23:12.373 INFO:teuthology.orchestra.console.trial108:Power off completed 2026-02-12T00:23:12.378 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off 2026-02-12T00:23:12.378 INFO:teuthology.orchestra.console.trial112:Power off completed 2026-02-12T00:23:12.384 DEBUG:teuthology.orchestra.console.trial107:check power output: Chassis Power is off 2026-02-12T00:23:12.384 INFO:teuthology.orchestra.console.trial107:Power off completed 2026-02-12T00:23:12.474 INFO:teuthology.orchestra.console.trial108:Power on 2026-02-12T00:23:12.474 DEBUG:teuthology.orchestra.console.trial108:pexpect command: ipmitool -H trial108.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T00:23:12.483 INFO:teuthology.orchestra.console.trial112:Power on 2026-02-12T00:23:12.484 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T00:23:12.492 INFO:teuthology.orchestra.console.trial107:Power on 2026-02-12T00:23:12.492 DEBUG:teuthology.orchestra.console.trial107:pexpect command: ipmitool -H trial107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-12T00:23:12.513 DEBUG:teuthology.orchestra.console.trial108:power on output: Chassis Power Control: Up/On 2026-02-12T00:23:12.522 DEBUG:teuthology.orchestra.console.trial112:power on output: Chassis Power Control: Up/On 2026-02-12T00:23:12.534 DEBUG:teuthology.orchestra.console.trial107:power on output: Chassis Power Control: Up/On 2026-02-12T00:23:16.518 DEBUG:teuthology.orchestra.console.trial108:pexpect command: ipmitool -H trial108.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T00:23:16.523 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T00:23:16.535 DEBUG:teuthology.orchestra.console.trial107:pexpect command: ipmitool -H trial107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T00:23:16.625 DEBUG:teuthology.orchestra.console.trial108:check power output: Chassis Power is on 2026-02-12T00:23:16.625 INFO:teuthology.orchestra.console.trial108:Power on completed 2026-02-12T00:23:16.630 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off 2026-02-12T00:23:16.641 DEBUG:teuthology.orchestra.console.trial107:check power output: Chassis Power is on 2026-02-12T00:23:16.641 INFO:teuthology.orchestra.console.trial107:Power on completed 2026-02-12T00:23:16.726 INFO:teuthology.provision.fog.trial108:Waiting for deploy to finish 2026-02-12T00:23:16.742 INFO:teuthology.provision.fog.trial107:Waiting for deploy to finish 2026-02-12T00:23:20.635 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T00:23:20.742 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on 2026-02-12T00:23:20.743 INFO:teuthology.orchestra.console.trial112:Power on completed 2026-02-12T00:23:20.843 INFO:teuthology.provision.fog.trial112:Waiting for deploy to finish 2026-02-12T00:25:03.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:03.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial108.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:06.909 WARNING:teuthology.provision.fog.trial107:[Errno None] Unable to connect to port 22 on 10.20.193.107 2026-02-12T00:25:06.973 WARNING:teuthology.provision.fog.trial108:[Errno None] Unable to connect to port 22 on 10.20.193.108 2026-02-12T00:25:07.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:11.069 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112 2026-02-12T00:25:12.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:12.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial108.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:15.997 WARNING:teuthology.provision.fog.trial107:[Errno None] Unable to connect to port 22 on 10.20.193.107 2026-02-12T00:25:16.061 WARNING:teuthology.provision.fog.trial108:[Errno None] Unable to connect to port 22 on 10.20.193.108 2026-02-12T00:25:17.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:20.157 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112 2026-02-12T00:25:21.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:22.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial108.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:25.085 WARNING:teuthology.provision.fog.trial107:[Errno None] Unable to connect to port 22 on 10.20.193.107 2026-02-12T00:25:25.149 WARNING:teuthology.provision.fog.trial108:[Errno None] Unable to connect to port 22 on 10.20.193.108 2026-02-12T00:25:26.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:29.245 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112 2026-02-12T00:25:31.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:31.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial108.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:34.173 WARNING:teuthology.provision.fog.trial107:[Errno None] Unable to connect to port 22 on 10.20.193.107 2026-02-12T00:25:34.237 WARNING:teuthology.provision.fog.trial108:[Errno None] Unable to connect to port 22 on 10.20.193.108 2026-02-12T00:25:35.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:38.333 WARNING:teuthology.provision.fog.trial112:[Errno None] Unable to connect to port 22 on 10.20.193.112 2026-02-12T00:25:40.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:40.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial108.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:25:44.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:26:16.261 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T00:26:16.261 DEBUG:teuthology.orchestra.run.trial108:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T00:26:16.264 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T00:26:16.264 DEBUG:teuthology.orchestra.run.trial107:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T00:26:16.496 INFO:teuthology.provision.fog.trial108:Node is ready 2026-02-12T00:26:16.496 DEBUG:teuthology.orchestra.run.trial108:> hostname 2026-02-12T00:26:16.550 INFO:teuthology.orchestra.run.trial108.stdout:trial108.front.sepia.ceph.com 2026-02-12T00:26:16.550 DEBUG:teuthology.orchestra.run.trial108:> grep trial108.front.sepia.ceph.com /etc/hosts 2026-02-12T00:26:16.590 INFO:teuthology.provision.fog.trial107:Node is ready 2026-02-12T00:26:16.590 DEBUG:teuthology.orchestra.run.trial107:> hostname 2026-02-12T00:26:16.603 INFO:teuthology.orchestra.run.trial108.stdout:10.20.193.108 trial108.front.sepia.ceph.com trial108 2026-02-12T00:26:16.604 DEBUG:teuthology.orchestra.run.trial108:> sudo hostname trial108 2026-02-12T00:26:16.647 INFO:teuthology.orchestra.run.trial107.stdout:trial107.front.sepia.ceph.com 2026-02-12T00:26:16.647 DEBUG:teuthology.orchestra.run.trial107:> grep trial107.front.sepia.ceph.com /etc/hosts 2026-02-12T00:26:16.669 DEBUG:teuthology.orchestra.run.trial108:> sudo sed -i -e 's/trial108.front.sepia.ceph.com/trial108/g' /etc/hosts 2026-02-12T00:26:16.703 INFO:teuthology.orchestra.run.trial107.stdout:10.20.193.107 trial107.front.sepia.ceph.com trial107 2026-02-12T00:26:16.704 DEBUG:teuthology.orchestra.run.trial107:> sudo hostname trial107 2026-02-12T00:26:16.730 DEBUG:teuthology.orchestra.run.trial108:> sudo sed -i -e 's/10.20.193.108/10.20.193.108/g' /etc/hosts 2026-02-12T00:26:16.772 DEBUG:teuthology.orchestra.run.trial107:> sudo sed -i -e 's/trial107.front.sepia.ceph.com/trial107/g' /etc/hosts 2026-02-12T00:26:16.793 DEBUG:teuthology.orchestra.run.trial108:> sudo sed -i -e 's/trial108.front.sepia.ceph.com/trial108/g' /etc/hostname 2026-02-12T00:26:16.839 DEBUG:teuthology.orchestra.run.trial107:> sudo sed -i -e 's/10.20.193.107/10.20.193.107/g' /etc/hosts 2026-02-12T00:26:16.855 DEBUG:teuthology.orchestra.run.trial108:> sudo hostname trial108 2026-02-12T00:26:16.905 DEBUG:teuthology.orchestra.run.trial107:> sudo sed -i -e 's/trial107.front.sepia.ceph.com/trial107/g' /etc/hostname 2026-02-12T00:26:16.917 DEBUG:teuthology.orchestra.run.trial108:> cat /etc/os-release 2026-02-12T00:26:16.970 DEBUG:teuthology.orchestra.run.trial107:> sudo hostname trial107 2026-02-12T00:26:16.971 INFO:teuthology.orchestra.run.trial108.stdout:NAME="CentOS Stream" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:VERSION="9" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:ID="centos" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:ID_LIKE="rhel fedora" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:VERSION_ID="9" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:PLATFORM_ID="platform:el9" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:ANSI_COLOR="0;31" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:LOGO="fedora-logo-icon" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T00:26:16.972 INFO:teuthology.orchestra.run.trial108.stdout:HOME_URL="https://centos.org/" 2026-02-12T00:26:16.973 INFO:teuthology.orchestra.run.trial108.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T00:26:16.973 INFO:teuthology.orchestra.run.trial108.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T00:26:16.973 INFO:teuthology.orchestra.run.trial108.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T00:26:16.974 INFO:teuthology.provision.fog.trial108:Deploy complete! 2026-02-12T00:26:16.975 DEBUG:teuthology.parallel:result is None 2026-02-12T00:26:17.035 DEBUG:teuthology.orchestra.run.trial107:> cat /etc/os-release 2026-02-12T00:26:17.092 INFO:teuthology.orchestra.run.trial107.stdout:NAME="CentOS Stream" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:VERSION="9" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:ID="centos" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:ID_LIKE="rhel fedora" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:VERSION_ID="9" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:PLATFORM_ID="platform:el9" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:ANSI_COLOR="0;31" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:LOGO="fedora-logo-icon" 2026-02-12T00:26:17.093 INFO:teuthology.orchestra.run.trial107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T00:26:17.094 INFO:teuthology.orchestra.run.trial107.stdout:HOME_URL="https://centos.org/" 2026-02-12T00:26:17.094 INFO:teuthology.orchestra.run.trial107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T00:26:17.094 INFO:teuthology.orchestra.run.trial107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T00:26:17.094 INFO:teuthology.orchestra.run.trial107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T00:26:17.094 INFO:teuthology.provision.fog.trial107:Deploy complete! 2026-02-12T00:26:17.095 DEBUG:teuthology.parallel:result is None 2026-02-12T00:26:20.323 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-12T00:26:20.323 DEBUG:teuthology.orchestra.run.trial112:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-12T00:26:20.531 INFO:teuthology.provision.fog.trial112:Node is ready 2026-02-12T00:26:20.532 DEBUG:teuthology.orchestra.run.trial112:> hostname 2026-02-12T00:26:20.593 INFO:teuthology.orchestra.run.trial112.stdout:trial112.front.sepia.ceph.com 2026-02-12T00:26:20.593 DEBUG:teuthology.orchestra.run.trial112:> grep trial112.front.sepia.ceph.com /etc/hosts 2026-02-12T00:26:20.653 INFO:teuthology.orchestra.run.trial112.stdout:10.20.193.112 trial112.front.sepia.ceph.com trial112 2026-02-12T00:26:20.654 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112 2026-02-12T00:26:20.725 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hosts 2026-02-12T00:26:20.790 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/10.20.193.112/10.20.193.112/g' /etc/hosts 2026-02-12T00:26:20.854 DEBUG:teuthology.orchestra.run.trial112:> sudo sed -i -e 's/trial112.front.sepia.ceph.com/trial112/g' /etc/hostname 2026-02-12T00:26:20.917 DEBUG:teuthology.orchestra.run.trial112:> sudo hostname trial112 2026-02-12T00:26:20.982 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release 2026-02-12T00:26:21.038 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream" 2026-02-12T00:26:21.038 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9" 2026-02-12T00:26:21.038 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos" 2026-02-12T00:26:21.038 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora" 2026-02-12T00:26:21.038 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9" 2026-02-12T00:26:21.038 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9" 2026-02-12T00:26:21.038 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T00:26:21.038 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31" 2026-02-12T00:26:21.039 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon" 2026-02-12T00:26:21.039 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T00:26:21.039 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/" 2026-02-12T00:26:21.039 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T00:26:21.039 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T00:26:21.039 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T00:26:21.039 INFO:teuthology.provision.fog.trial112:Deploy complete! 2026-02-12T00:26:21.040 DEBUG:teuthology.parallel:result is None 2026-02-12T00:26:21.573 INFO:teuthology.lock.ops:Checking trial107.front.sepia.ceph.com 2026-02-12T00:26:21.573 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T00:26:21.680 INFO:teuthology.lock.ops:Checking trial108.front.sepia.ceph.com 2026-02-12T00:26:21.680 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T00:26:21.748 INFO:teuthology.lock.ops:Checking trial112.front.sepia.ceph.com 2026-02-12T00:26:21.748 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-12T00:26:21.806 INFO:teuthology.lock.ops:Updating [trial107.front.sepia.ceph.com]: set os type and version on server 2026-02-12T00:26:21.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial107.front.sepia.ceph.com' 2026-02-12T00:26:21.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:26:21.867 DEBUG:teuthology.orchestra.run.trial107:> true 2026-02-12T00:26:21.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial107.front.sepia.ceph.com' 2026-02-12T00:26:21.949 DEBUG:teuthology.orchestra.run.trial107:> uname -m 2026-02-12T00:26:22.004 INFO:teuthology.orchestra.run.trial107.stdout:x86_64 2026-02-12T00:26:22.004 DEBUG:teuthology.orchestra.run.trial107:> cat /etc/os-release 2026-02-12T00:26:22.061 INFO:teuthology.orchestra.run.trial107.stdout:NAME="CentOS Stream" 2026-02-12T00:26:22.061 INFO:teuthology.orchestra.run.trial107.stdout:VERSION="9" 2026-02-12T00:26:22.061 INFO:teuthology.orchestra.run.trial107.stdout:ID="centos" 2026-02-12T00:26:22.061 INFO:teuthology.orchestra.run.trial107.stdout:ID_LIKE="rhel fedora" 2026-02-12T00:26:22.061 INFO:teuthology.orchestra.run.trial107.stdout:VERSION_ID="9" 2026-02-12T00:26:22.061 INFO:teuthology.orchestra.run.trial107.stdout:PLATFORM_ID="platform:el9" 2026-02-12T00:26:22.061 INFO:teuthology.orchestra.run.trial107.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T00:26:22.061 INFO:teuthology.orchestra.run.trial107.stdout:ANSI_COLOR="0;31" 2026-02-12T00:26:22.062 INFO:teuthology.orchestra.run.trial107.stdout:LOGO="fedora-logo-icon" 2026-02-12T00:26:22.062 INFO:teuthology.orchestra.run.trial107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T00:26:22.062 INFO:teuthology.orchestra.run.trial107.stdout:HOME_URL="https://centos.org/" 2026-02-12T00:26:22.062 INFO:teuthology.orchestra.run.trial107.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T00:26:22.062 INFO:teuthology.orchestra.run.trial107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T00:26:22.062 INFO:teuthology.orchestra.run.trial107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T00:26:22.063 INFO:teuthology.lock.ops:Updating trial107.front.sepia.ceph.com on lock server 2026-02-12T00:26:22.165 INFO:teuthology.lock.ops:Updating [trial108.front.sepia.ceph.com]: set os type and version on server 2026-02-12T00:26:22.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial108.front.sepia.ceph.com' 2026-02-12T00:26:22.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial108.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:26:22.233 DEBUG:teuthology.orchestra.run.trial108:> true 2026-02-12T00:26:22.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial108.front.sepia.ceph.com' 2026-02-12T00:26:22.312 DEBUG:teuthology.orchestra.run.trial108:> uname -m 2026-02-12T00:26:22.368 INFO:teuthology.orchestra.run.trial108.stdout:x86_64 2026-02-12T00:26:22.368 DEBUG:teuthology.orchestra.run.trial108:> cat /etc/os-release 2026-02-12T00:26:22.425 INFO:teuthology.orchestra.run.trial108.stdout:NAME="CentOS Stream" 2026-02-12T00:26:22.425 INFO:teuthology.orchestra.run.trial108.stdout:VERSION="9" 2026-02-12T00:26:22.425 INFO:teuthology.orchestra.run.trial108.stdout:ID="centos" 2026-02-12T00:26:22.425 INFO:teuthology.orchestra.run.trial108.stdout:ID_LIKE="rhel fedora" 2026-02-12T00:26:22.425 INFO:teuthology.orchestra.run.trial108.stdout:VERSION_ID="9" 2026-02-12T00:26:22.425 INFO:teuthology.orchestra.run.trial108.stdout:PLATFORM_ID="platform:el9" 2026-02-12T00:26:22.426 INFO:teuthology.orchestra.run.trial108.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T00:26:22.426 INFO:teuthology.orchestra.run.trial108.stdout:ANSI_COLOR="0;31" 2026-02-12T00:26:22.426 INFO:teuthology.orchestra.run.trial108.stdout:LOGO="fedora-logo-icon" 2026-02-12T00:26:22.426 INFO:teuthology.orchestra.run.trial108.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T00:26:22.426 INFO:teuthology.orchestra.run.trial108.stdout:HOME_URL="https://centos.org/" 2026-02-12T00:26:22.426 INFO:teuthology.orchestra.run.trial108.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T00:26:22.426 INFO:teuthology.orchestra.run.trial108.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T00:26:22.426 INFO:teuthology.orchestra.run.trial108.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T00:26:22.427 INFO:teuthology.lock.ops:Updating trial108.front.sepia.ceph.com on lock server 2026-02-12T00:26:22.529 INFO:teuthology.lock.ops:Updating [trial112.front.sepia.ceph.com]: set os type and version on server 2026-02-12T00:26:22.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T00:26:22.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T00:26:22.598 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T00:26:22.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T00:26:22.673 DEBUG:teuthology.orchestra.run.trial112:> uname -m 2026-02-12T00:26:22.729 INFO:teuthology.orchestra.run.trial112.stdout:x86_64 2026-02-12T00:26:22.730 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release 2026-02-12T00:26:22.785 INFO:teuthology.orchestra.run.trial112.stdout:NAME="CentOS Stream" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="9" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:ID="centos" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel fedora" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="9" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el9" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;31" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon" 2026-02-12T00:26:22.786 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T00:26:22.787 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://centos.org/" 2026-02-12T00:26:22.787 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T00:26:22.787 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T00:26:22.787 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T00:26:22.788 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server 2026-02-12T00:26:22.890 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:26:22.986 INFO:teuthology.dispatcher.supervisor:Running job 45867 2026-02-12T00:26:22.986 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_bhubbard@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867 --name bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/fs/misc}} -- /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/orig.config.yaml 2026-02-12T00:26:22.986 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867 2026-02-12T00:26:22.986 INFO:teuthology.dispatcher.supervisor:Job PID: 2218269 2026-02-12T00:26:22.986 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-12T00:28:23.087 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:30:23.278 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:32:23.389 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:34:23.508 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:36:23.618 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:38:23.730 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:40:23.927 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:42:24.132 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:44:24.315 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:46:24.467 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:48:24.632 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:50:24.754 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:52:24.954 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:54:25.075 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:56:25.222 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T00:58:25.442 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:00:25.633 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:02:25.819 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:04:26.034 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:06:26.203 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:08:26.424 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:10:26.565 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:12:26.773 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:14:26.946 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:16:27.141 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:18:27.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:20:27.460 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:22:27.678 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:24:27.807 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:26:27.992 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:28:28.194 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:30:28.340 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:32:28.695 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:34:28.911 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:36:29.083 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:38:29.291 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:40:29.437 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:42:29.638 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:44:29.797 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:46:29.895 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:48:30.088 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:50:30.281 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:52:30.456 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:54:30.588 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:56:30.798 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T01:58:30.915 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:00:31.115 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:02:31.322 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:04:31.547 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:06:31.757 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:08:31.956 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:10:32.154 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:12:32.358 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:14:32.496 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:16:32.669 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:18:32.894 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:20:33.055 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:22:33.265 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:24:33.410 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:26:33.617 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:28:33.808 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:30:33.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:32:34.201 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:34:34.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:36:34.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:38:34.815 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:40:35.023 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:42:35.264 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:44:35.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:46:35.690 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:48:35.894 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:50:36.003 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:52:36.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:54:36.384 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:56:36.589 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T02:58:36.782 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:00:36.990 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:02:37.192 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:04:37.396 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:06:37.545 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:08:37.739 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:10:37.948 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:12:38.047 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:14:38.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:16:38.340 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:18:38.566 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:20:38.732 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:22:38.915 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:24:39.119 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:26:39.293 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:28:39.441 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:30:39.641 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:32:39.733 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:34:39.966 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:36:40.158 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:38:40.370 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:40:40.564 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:42:40.679 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:44:40.821 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:46:41.024 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:48:41.199 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:50:41.392 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:52:41.520 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:54:41.598 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:56:41.771 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:58:41.981 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:00:42.174 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:02:42.356 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:04:42.547 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:06:42.745 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:08:42.954 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:10:43.134 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:12:43.295 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:14:43.506 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:16:43.646 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:18:43.842 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:20:44.027 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:22:44.211 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:24:44.379 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:26:44.558 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:28:44.759 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:30:44.901 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:32:45.084 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:34:45.286 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:36:45.494 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:38:45.702 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:40:45.846 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:42:46.038 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:44:46.243 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:46:46.447 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:48:46.616 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:50:46.816 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:52:47.024 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:54:47.224 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:56:47.427 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:58:47.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:00:47.737 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:02:47.935 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:04:48.139 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:06:48.360 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:08:48.569 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:10:48.752 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:12:48.904 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:14:49.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:16:49.292 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:18:49.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:20:49.609 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:22:49.774 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:24:49.949 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:26:50.157 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:28:50.337 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:30:50.539 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:32:50.660 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:34:50.868 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:36:51.085 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:38:51.281 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:40:51.489 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:42:51.689 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:44:51.899 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:46:52.030 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:48:52.230 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:50:52.397 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:52:52.597 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:54:52.791 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:56:52.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T05:58:53.053 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:00:53.253 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:02:53.457 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:04:53.607 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:06:53.798 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:08:54.004 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:10:54.204 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:12:54.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:14:54.449 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:16:54.627 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:18:54.818 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:20:54.933 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:22:55.081 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:24:55.291 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:26:55.460 WARNING:teuthology.dispatcher.supervisor:Job bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867 ran longer than 21600s. Killing... 2026-02-12T06:26:55.552 INFO:teuthology.kill:Killing Pids: {2218269} 2026-02-12T06:26:55.554 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:26:55.661 INFO:teuthology.task.internal:roles: ubuntu@trial107.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-12T06:26:55.661 INFO:teuthology.task.internal:roles: ubuntu@trial108.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-12T06:26:55.661 INFO:teuthology.task.internal:roles: ubuntu@trial112.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-12T06:26:55.661 INFO:teuthology.misc:Compressing logs... 2026-02-12T06:26:55.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial107.front.sepia.ceph.com' 2026-02-12T06:26:55.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:26:55.725 DEBUG:teuthology.orchestra.run.trial107:> true 2026-02-12T06:26:55.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial107.front.sepia.ceph.com' 2026-02-12T06:26:55.799 DEBUG:teuthology.orchestra.run.trial107:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:55.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial108.front.sepia.ceph.com' 2026-02-12T06:26:55.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial108.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:26:55.943 DEBUG:teuthology.orchestra.run.trial108:> true 2026-02-12T06:26:56.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial108.front.sepia.ceph.com' 2026-02-12T06:26:56.016 DEBUG:teuthology.orchestra.run.trial108:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:56.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T06:26:56.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T06:26:56.163 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T06:26:56.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T06:26:56.247 DEBUG:teuthology.orchestra.run.trial112:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:56.337 DEBUG:teuthology.misc:Transferring archived files from trial107:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial107/crash 2026-02-12T06:26:56.345 DEBUG:teuthology.orchestra.run.trial107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T06:26:56.382 DEBUG:teuthology.misc:Transferring archived files from trial108:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial108/crash 2026-02-12T06:26:56.389 DEBUG:teuthology.orchestra.run.trial108:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T06:26:56.422 DEBUG:teuthology.misc:Transferring archived files from trial112:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial112/crash 2026-02-12T06:26:56.427 DEBUG:teuthology.orchestra.run.trial112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T06:26:56.453 INFO:teuthology.misc:Compressing logs... 2026-02-12T06:26:56.453 DEBUG:teuthology.orchestra.run.trial107:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:56.457 DEBUG:teuthology.orchestra.run.trial108:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:56.472 DEBUG:teuthology.orchestra.run.trial112:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:56.479 INFO:teuthology.orchestra.run.trial107.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:26:56.479 INFO:teuthology.orchestra.run.trial107.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:26:56.480 INFO:teuthology.orchestra.run.trial107.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T06:26:56.480 INFO:teuthology.orchestra.run.trial107.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T06:26:56.492 INFO:teuthology.orchestra.run.trial108.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:26:56.493 INFO:teuthology.orchestra.run.trial108.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:26:56.494 INFO:teuthology.orchestra.run.trial108.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T06:26:56.494 INFO:teuthology.orchestra.run.trial108.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T06:26:56.519 INFO:teuthology.orchestra.run.trial112.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T06:26:56.520 INFO:teuthology.orchestra.run.trial112.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T06:26:56.520 INFO:teuthology.orchestra.run.trial112.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T06:26:56.520 INFO:teuthology.orchestra.run.trial112.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T06:26:56.522 DEBUG:teuthology.misc:Transferring archived files from trial107:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial107/ 2026-02-12T06:26:56.522 DEBUG:teuthology.orchestra.run.trial107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T06:26:56.549 DEBUG:teuthology.misc:Transferring archived files from trial108:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial108/ 2026-02-12T06:26:56.550 DEBUG:teuthology.orchestra.run.trial108:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T06:26:56.578 DEBUG:teuthology.misc:Transferring archived files from trial112:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial112/ 2026-02-12T06:26:56.578 DEBUG:teuthology.orchestra.run.trial112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T06:26:56.605 INFO:teuthology.misc:Compressing logs... 2026-02-12T06:26:56.605 DEBUG:teuthology.orchestra.run.trial107:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:56.608 DEBUG:teuthology.orchestra.run.trial108:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:56.621 DEBUG:teuthology.orchestra.run.trial112:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T06:26:56.629 INFO:teuthology.orchestra.run.trial107.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-12T06:26:56.631 INFO:teuthology.orchestra.run.trial107.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.a.log 2026-02-12T06:26:56.631 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.d.log 2026-02-12T06:26:56.631 INFO:teuthology.orchestra.run.trial107.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.j.log 2026-02-12T06:26:56.631 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.a.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.0.log 2026-02-12T06:26:56.631 INFO:teuthology.orchestra.run.trial107.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.3.log 2026-02-12T06:26:56.632 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.j.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log 2026-02-12T06:26:56.632 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.a.log 2026-02-12T06:26:56.632 INFO:teuthology.orchestra.run.trial107.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.g.log 2026-02-12T06:26:56.634 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.a.log: 82.6%gzip -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log.gz -5 --verbose 2026-02-12T06:26:56.634 INFO:teuthology.orchestra.run.trial107.stderr: -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log 2026-02-12T06:26:56.634 INFO:teuthology.orchestra.run.trial107.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log 2026-02-12T06:26:56.634 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.g.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.6.log 2026-02-12T06:26:56.634 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.x.log 2026-02-12T06:26:56.634 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log 2026-02-12T06:26:56.634 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.9.log 2026-02-12T06:26:56.635 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2026-02-12T06:26:56.635 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.9.log: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-12T06:26:56.636 INFO:teuthology.orchestra.run.trial107.stderr:/var/log/ceph/ceph-client.0.log: 91.5% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log.gz 2026-02-12T06:26:56.643 INFO:teuthology.orchestra.run.trial108.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-12T06:26:56.643 INFO:teuthology.orchestra.run.trial107.stderr: 91.2% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log.gz 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.y.log 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.b.log 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.h.log 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.y.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.7.log 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:gzip/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.7.log: -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.10.log 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.4.log 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.10.log: 83.2% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log.gz 2026-02-12T06:26:56.647 INFO:teuthology.orchestra.run.trial108.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log 2026-02-12T06:26:56.648 INFO:teuthology.orchestra.run.trial108.stderr:gzip/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.4.log: -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.b.log 2026-02-12T06:26:56.648 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log 2026-02-12T06:26:56.648 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.1.log 2026-02-12T06:26:56.648 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log 2026-02-12T06:26:56.648 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.k.log 2026-02-12T06:26:56.648 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.e.log 2026-02-12T06:26:56.651 INFO:teuthology.orchestra.run.trial108.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.k.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.e.log: 91.6% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log.gz 2026-02-12T06:26:56.656 INFO:teuthology.orchestra.run.trial107.stderr: 94.9% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.d.log.gz 2026-02-12T06:26:56.657 INFO:teuthology.orchestra.run.trial108.stderr: 91.1% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log.gz 2026-02-12T06:26:56.658 INFO:teuthology.orchestra.run.trial107.stderr: 89.6% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log.gz 2026-02-12T06:26:56.659 INFO:teuthology.orchestra.run.trial107.stderr: 94.9% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.j.log.gz 2026-02-12T06:26:56.668 INFO:teuthology.orchestra.run.trial108.stderr: 89.6% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log.gz 2026-02-12T06:26:56.671 INFO:teuthology.orchestra.run.trial108.stderr: 94.8% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-12T06:26:56.671 INFO:teuthology.orchestra.run.trial112.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-12T06:26:56.674 INFO:teuthology.orchestra.run.trial112.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.2.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.i.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.c.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.2.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.f.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.5.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.c.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.11.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr: 83.2% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.cephadm.log.gz 2026-02-12T06:26:56.675 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.z.log 2026-02-12T06:26:56.676 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.l.log 2026-02-12T06:26:56.676 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.c.log 2026-02-12T06:26:56.677 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log 2026-02-12T06:26:56.677 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.8.log 2026-02-12T06:26:56.679 INFO:teuthology.orchestra.run.trial112.stderr:/var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.8.log: 91.6% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.audit.log.gz 2026-02-12T06:26:56.686 INFO:teuthology.orchestra.run.trial112.stderr: 91.1% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-volume.log.gz 2026-02-12T06:26:56.700 INFO:teuthology.orchestra.run.trial112.stderr: 89.6% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph.log.gz 2026-02-12T06:26:56.702 INFO:teuthology.orchestra.run.trial112.stderr: 94.8% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-12T06:26:58.053 INFO:teuthology.orchestra.run.trial107.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.x.log: file size changed while zipping 2026-02-12T06:26:58.054 INFO:teuthology.orchestra.run.trial107.stderr: 91.3% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-12T06:26:59.491 INFO:teuthology.orchestra.run.trial107.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.g.log: file size changed while zipping 2026-02-12T06:26:59.491 INFO:teuthology.orchestra.run.trial107.stderr: 94.7% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.g.log.gz 2026-02-12T06:26:59.791 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.b.log: file size changed while zipping 2026-02-12T06:26:59.791 INFO:teuthology.orchestra.run.trial108.stderr: 92.4% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.b.log.gz 2026-02-12T06:26:59.856 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.c.log: file size changed while zipping 2026-02-12T06:26:59.857 INFO:teuthology.orchestra.run.trial112.stderr: 92.2% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.c.log.gz 2026-02-12T06:27:00.182 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.l.log: file size changed while zipping 2026-02-12T06:27:00.182 INFO:teuthology.orchestra.run.trial112.stderr: 95.1% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.l.log.gz 2026-02-12T06:27:00.191 INFO:teuthology.orchestra.run.trial107.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.a.log: file size changed while zipping 2026-02-12T06:27:00.192 INFO:teuthology.orchestra.run.trial107.stderr: 94.5% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.a.log.gz 2026-02-12T06:27:04.262 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.h.log: file size changed while zipping 2026-02-12T06:27:04.262 INFO:teuthology.orchestra.run.trial108.stderr: 95.3% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.h.log.gz 2026-02-12T06:27:05.155 INFO:teuthology.orchestra.run.trial107.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.a.log: file size changed while zipping 2026-02-12T06:27:05.155 INFO:teuthology.orchestra.run.trial107.stderr: 90.5% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mon.a.log.gz 2026-02-12T06:27:10.677 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.f.log: file size changed while zipping 2026-02-12T06:27:10.677 INFO:teuthology.orchestra.run.trial112.stderr: 95.2% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.f.log.gz 2026-02-12T06:27:22.245 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.4.log: file size changed while zipping 2026-02-12T06:27:22.245 INFO:teuthology.orchestra.run.trial108.stderr: 95.0% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.4.log.gz 2026-02-12T06:27:46.090 INFO:teuthology.orchestra.run.trial107.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.9.log: file size changed while zipping 2026-02-12T06:27:46.090 INFO:teuthology.orchestra.run.trial107.stderr: 95.2% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.9.log.gz 2026-02-12T06:28:01.857 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.2.log: file size changed while zipping 2026-02-12T06:28:01.857 INFO:teuthology.orchestra.run.trial112.stderr: 95.3% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.2.log.gz 2026-02-12T06:28:02.145 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.k.log: file size changed while zipping 2026-02-12T06:28:02.145 INFO:teuthology.orchestra.run.trial108.stderr: 94.5% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.k.log.gz 2026-02-12T06:28:06.104 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.8.log: file size changed while zipping 2026-02-12T06:28:06.104 INFO:teuthology.orchestra.run.trial112.stderr: 95.2% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.8.log.gz 2026-02-12T06:28:07.133 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.10.log: file size changed while zipping 2026-02-12T06:28:07.133 INFO:teuthology.orchestra.run.trial108.stderr: 95.3% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.10.log.gz 2026-02-12T06:28:19.021 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.1.log: file size changed while zipping 2026-02-12T06:28:19.021 INFO:teuthology.orchestra.run.trial108.stderr: 95.5% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.1.log.gz 2026-02-12T06:28:22.802 INFO:teuthology.orchestra.run.trial107.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.6.log: file size changed while zipping 2026-02-12T06:28:22.802 INFO:teuthology.orchestra.run.trial107.stderr: 95.4% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.6.log.gz 2026-02-12T06:28:23.722 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.5.log: file size changed while zipping 2026-02-12T06:28:23.723 INFO:teuthology.orchestra.run.trial112.stderr: 95.3% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.5.log.gz 2026-02-12T06:28:30.718 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.11.log: file size changed while zipping 2026-02-12T06:28:30.718 INFO:teuthology.orchestra.run.trial112.stderr: 95.6% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.11.log.gz 2026-02-12T06:28:31.275 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.c.log: file size changed while zipping 2026-02-12T06:28:31.276 INFO:teuthology.orchestra.run.trial112.stderr: 94.6% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.c.log.gz 2026-02-12T06:28:33.910 INFO:teuthology.orchestra.run.trial107.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2026-02-12T06:28:34.414 INFO:teuthology.orchestra.run.trial107.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.0.log: file size changed while zipping 2026-02-12T06:28:34.414 INFO:teuthology.orchestra.run.trial107.stderr: 95.5% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.0.log.gz 2026-02-12T06:28:40.658 INFO:teuthology.orchestra.run.trial107.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.3.log: file size changed while zipping 2026-02-12T06:28:40.658 INFO:teuthology.orchestra.run.trial107.stderr: 95.5% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.3.log.gz 2026-02-12T06:28:50.192 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.7.log: file size changed while zipping 2026-02-12T06:28:50.193 INFO:teuthology.orchestra.run.trial108.stderr: 95.4% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-osd.7.log.gz 2026-02-12T06:29:01.080 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.e.log: file size changed while zipping 2026-02-12T06:29:01.081 INFO:teuthology.orchestra.run.trial108.stderr: 94.8% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.e.log.gz 2026-02-12T06:31:28.261 INFO:teuthology.orchestra.run.trial108.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.b.log: file size changed while zipping 2026-02-12T06:31:28.261 INFO:teuthology.orchestra.run.trial108.stderr: 94.8% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.b.log.gz 2026-02-12T06:38:41.241 INFO:teuthology.orchestra.run.trial112.stderr:gzip: /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.i.log: file size changed while zipping 2026-02-12T06:38:41.242 INFO:teuthology.orchestra.run.trial112.stderr: 94.8% -- replaced with /var/log/ceph/4abd3a60-07aa-11f1-b871-d404e6e7d460/ceph-mds.i.log.gz 2026-02-12T06:38:41.245 DEBUG:teuthology.misc:Transferring archived files from trial107:/var/log/ceph to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial107/log 2026-02-12T06:38:41.246 DEBUG:teuthology.orchestra.run.trial107:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T06:39:10.274 DEBUG:teuthology.misc:Transferring archived files from trial108:/var/log/ceph to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial108/log 2026-02-12T06:39:10.275 DEBUG:teuthology.orchestra.run.trial108:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T06:39:57.051 DEBUG:teuthology.misc:Transferring archived files from trial112:/var/log/ceph to /home/teuthworker/mnt/teuthology/bhubbard-2026-02-12_00:15:41-fs:workload-reef-release-distro-default-trial/45867/remote/trial112/log 2026-02-12T06:39:57.052 DEBUG:teuthology.orchestra.run.trial112:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T06:41:06.064 INFO:teuthology.kill:No teuthology processes running 2026-02-12T06:41:06.064 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:41:06.995 INFO:teuthology.orchestra.console.trial112:Power off 2026-02-12T06:41:06.995 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T06:41:07.004 INFO:teuthology.orchestra.console.trial108:Power off 2026-02-12T06:41:07.004 DEBUG:teuthology.orchestra.console.trial108:pexpect command: ipmitool -H trial108.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T06:41:07.024 INFO:teuthology.orchestra.console.trial107:Power off 2026-02-12T06:41:07.025 DEBUG:teuthology.orchestra.console.trial107:pexpect command: ipmitool -H trial107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-12T06:41:07.035 DEBUG:teuthology.orchestra.console.trial112:power off output: Chassis Power Control: Down/Off 2026-02-12T06:41:07.044 DEBUG:teuthology.orchestra.console.trial108:power off output: Chassis Power Control: Down/Off 2026-02-12T06:41:07.061 DEBUG:teuthology.orchestra.console.trial107:power off output: Chassis Power Control: Down/Off 2026-02-12T06:41:11.040 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T06:41:11.048 DEBUG:teuthology.orchestra.console.trial108:pexpect command: ipmitool -H trial108.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T06:41:11.062 DEBUG:teuthology.orchestra.console.trial107:pexpect command: ipmitool -H trial107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T06:41:11.151 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is on 2026-02-12T06:41:11.157 DEBUG:teuthology.orchestra.console.trial108:check power output: Chassis Power is on 2026-02-12T06:41:11.171 DEBUG:teuthology.orchestra.console.trial107:check power output: Chassis Power is on 2026-02-12T06:41:15.156 DEBUG:teuthology.orchestra.console.trial112:pexpect command: ipmitool -H trial112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T06:41:15.165 DEBUG:teuthology.orchestra.console.trial108:pexpect command: ipmitool -H trial108.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T06:41:15.172 DEBUG:teuthology.orchestra.console.trial107:pexpect command: ipmitool -H trial107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-12T06:41:15.267 DEBUG:teuthology.orchestra.console.trial112:check power output: Chassis Power is off 2026-02-12T06:41:15.267 INFO:teuthology.orchestra.console.trial112:Power off completed 2026-02-12T06:41:15.273 DEBUG:teuthology.orchestra.console.trial108:check power output: Chassis Power is off 2026-02-12T06:41:15.273 INFO:teuthology.orchestra.console.trial108:Power off completed 2026-02-12T06:41:15.281 DEBUG:teuthology.orchestra.console.trial107:check power output: Chassis Power is off 2026-02-12T06:41:15.281 INFO:teuthology.orchestra.console.trial107:Power off completed 2026-02-12T06:41:15.570 INFO:teuthology.lock.ops:unlocked: trial112.front.sepia.ceph.com 2026-02-12T06:41:15.586 INFO:teuthology.lock.ops:unlocked: trial108.front.sepia.ceph.com 2026-02-12T06:41:15.591 INFO:teuthology.lock.ops:unlocked: trial107.front.sepia.ceph.com 2026-02-12T06:41:15.592 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:43:15.755 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T06:43:15.824 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2026-02-12T06:43:16.014 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial107 but it was locked by another job: /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/46012 2026-02-12T06:43:16.014 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial108 but it was locked by another job: /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/46013 2026-02-12T06:43:16.014 WARNING:teuthology.dispatcher.supervisor:Was going to unlock trial112 but it was locked by another job: /home/teuthworker/mnt/teuthology/moagrawa-2026-02-12_06:23:35-crimson-rados-main-distro-debug-trial/46012