2024-01-28T11:10:01.592 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-28T11:10:01.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:10:01.770 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9ccca56c10>, signals=[15]) 2024-01-28T11:10:01.771 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2024-01-28T11:10:01.771 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2024-01-28T11:10:01.771 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-01-28T11:10:01.793 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-01-28T11:10:01.793 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-01-28T11:10:01.793 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-01-28T11:10:01.818 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2024-01-28T11:10:01.818 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2024-01-28T11:10:01.818 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-01-28T11:10:01.908 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-28T11:10:01.926 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-28T11:10:01.949 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.6 2024-01-28T11:10:01.964 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-28T11:10:01.967 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.6 2024-01-28T11:10:02.018 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2024-01-28T11:10:02.402 INFO:teuthology.orchestra.console.smithi084:Power off 2024-01-28T11:10:02.402 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-28T11:10:02.414 INFO:teuthology.orchestra.console.smithi073:Power off 2024-01-28T11:10:02.414 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-28T11:10:02.427 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-01-28T11:10:02.427 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:02.437 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-01-28T11:10:02.437 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:02.450 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-28T11:10:02.462 INFO:teuthology.orchestra.console.smithi190:Power off 2024-01-28T11:10:02.462 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-28T11:10:02.470 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-01-28T11:10:02.484 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-01-28T11:10:02.484 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:02.506 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-01-28T11:10:06.455 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:06.471 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:06.507 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:06.565 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-28T11:10:06.580 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-01-28T11:10:06.616 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-01-28T11:10:10.570 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:10.580 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:10.617 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:10.679 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-28T11:10:10.688 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-01-28T11:10:10.725 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-01-28T11:10:10.781 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-01-28T11:10:10.789 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-01-28T11:10:10.826 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-01-28T11:10:10.882 INFO:teuthology.orchestra.console.smithi084:Power on 2024-01-28T11:10:10.882 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-28T11:10:10.890 INFO:teuthology.orchestra.console.smithi073:Power on 2024-01-28T11:10:10.891 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-28T11:10:10.903 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-01-28T11:10:10.903 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:10.911 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2024-01-28T11:10:10.911 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:10.923 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-28T11:10:10.927 INFO:teuthology.orchestra.console.smithi190:Power on 2024-01-28T11:10:10.928 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-28T11:10:10.935 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-01-28T11:10:10.948 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2024-01-28T11:10:10.948 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:10.969 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-01-28T11:10:14.928 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:14.937 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:14.970 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:15.037 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-28T11:10:15.046 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-01-28T11:10:15.079 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-01-28T11:10:19.042 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:19.050 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:19.080 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-28T11:10:19.160 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-01-28T11:10:19.189 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-01-28T11:10:19.219 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-28T11:10:19.261 INFO:teuthology.orchestra.console.smithi073:Power on completed 2024-01-28T11:10:19.290 INFO:teuthology.orchestra.console.smithi190:Power on completed 2024-01-28T11:10:19.319 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-01-28T11:10:19.362 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2024-01-28T11:10:19.391 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2024-01-28T11:10:19.421 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-01-28T11:12:50.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:05.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:05.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:08.316 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-28T11:13:14.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:17.372 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-28T11:13:23.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:23.772 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-28T11:13:26.428 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-28T11:13:29.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:32.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:32.828 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-28T11:13:35.484 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-28T11:13:38.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:41.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:41.884 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-28T11:13:44.540 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-01-28T11:13:47.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:50.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:13:50.940 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-28T11:13:56.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:14:20.569 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-01-28T11:14:27.648 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-01-28T11:14:33.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:14:34.448 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-28T11:14:34.449 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-28T11:14:34.944 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-01-28T11:14:50.050 INFO:teuthology.provision.fog.smithi073:Node is ready 2024-01-28T11:14:50.050 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2024-01-28T11:14:50.072 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2024-01-28T11:14:50.072 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2024-01-28T11:14:50.132 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2024-01-28T11:14:50.133 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2024-01-28T11:14:50.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2024-01-28T11:14:50.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2024-01-28T11:14:50.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2024-01-28T11:14:50.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2024-01-28T11:14:50.526 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-01-28T11:14:50.543 WARNING:teuthology.provision.fog.smithi190:timed out 2024-01-28T11:14:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2024-01-28T11:14:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2024-01-28T11:14:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2024-01-28T11:14:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2024-01-28T11:14:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2024-01-28T11:14:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2024-01-28T11:14:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-28T11:14:50.587 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-28T11:14:50.588 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-28T11:14:50.589 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2024-01-28T11:14:50.590 DEBUG:teuthology.parallel:result is None 2024-01-28T11:14:56.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:14:56.752 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-28T11:14:56.753 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-28T11:14:56.944 WARNING:teuthology.provision.fog.smithi084:timed out 2024-01-28T11:14:57.033 INFO:teuthology.provision.fog.smithi190:Node is ready 2024-01-28T11:14:57.034 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2024-01-28T11:14:57.051 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2024-01-28T11:14:57.051 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2024-01-28T11:14:57.108 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2024-01-28T11:14:57.109 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-01-28T11:14:57.211 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2024-01-28T11:14:57.239 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2024-01-28T11:14:57.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2024-01-28T11:14:57.374 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-01-28T11:14:57.440 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-01-28T11:14:57.496 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2024-01-28T11:14:57.496 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2024-01-28T11:14:57.496 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2024-01-28T11:14:57.496 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-28T11:14:57.497 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-28T11:14:57.497 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2024-01-28T11:14:57.498 DEBUG:teuthology.parallel:result is None 2024-01-28T11:15:02.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:15:03.187 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-28T11:15:03.187 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-28T11:15:03.443 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-01-28T11:15:03.443 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-01-28T11:15:03.461 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-01-28T11:15:03.461 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-01-28T11:15:03.519 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-01-28T11:15:03.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-01-28T11:15:03.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-01-28T11:15:03.668 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-01-28T11:15:03.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-01-28T11:15:03.805 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-01-28T11:15:03.872 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2024-01-28T11:15:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-28T11:15:03.930 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-28T11:15:03.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-28T11:15:03.930 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-28T11:15:03.930 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-28T11:15:03.930 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-28T11:15:03.930 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-28T11:15:03.930 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-01-28T11:15:03.931 DEBUG:teuthology.parallel:result is None 2024-01-28T11:15:04.125 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2024-01-28T11:15:04.125 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-28T11:15:04.144 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-01-28T11:15:04.144 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-28T11:15:04.160 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2024-01-28T11:15:04.161 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-28T11:15:04.179 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2024-01-28T11:15:04.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-28T11:15:04.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:15:04.252 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-01-28T11:15:04.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-28T11:15:04.385 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-01-28T11:15:04.442 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-01-28T11:15:04.442 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-01-28T11:15:04.498 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-01-28T11:15:04.499 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-28T11:15:04.500 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-28T11:15:04.500 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-28T11:15:04.500 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-28T11:15:04.500 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-01-28T11:15:04.544 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-01-28T11:15:04.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-28T11:15:04.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:15:04.615 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-01-28T11:15:04.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-28T11:15:04.681 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-01-28T11:15:04.737 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-01-28T11:15:04.738 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-01-28T11:15:04.795 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2024-01-28T11:15:04.795 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)" 2024-01-28T11:15:04.795 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2024-01-28T11:15:04.795 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-28T11:15:04.796 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-28T11:15:04.797 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-01-28T11:15:04.828 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2024-01-28T11:15:04.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-01-28T11:15:04.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T11:15:04.900 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-01-28T11:15:04.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-01-28T11:15:04.971 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-01-28T11:15:05.033 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-01-28T11:15:05.033 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-28T11:15:05.095 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-01-28T11:15:05.096 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-28T11:15:05.096 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-28T11:15:05.096 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-28T11:15:05.096 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-28T11:15:05.096 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-01-28T11:15:05.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:15:05.210 INFO:teuthology.dispatcher.supervisor:Running job 7535742 2024-01-28T11:15:05.210 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742 --name khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/orig.config.yaml 2024-01-28T11:15:05.213 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742 2024-01-28T11:15:05.214 INFO:teuthology.dispatcher.supervisor:Job PID: 87865 2024-01-28T11:15:05.214 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-28T11:17:05.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:19:05.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:21:05.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:23:05.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:25:05.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:27:06.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:29:06.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:31:06.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:33:06.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:35:06.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:37:06.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:39:07.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:41:07.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:43:07.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:45:07.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:47:07.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:49:07.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:51:08.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:53:08.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:55:08.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:57:08.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T11:59:08.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:01:08.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:03:09.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:05:09.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:07:09.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:09:09.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:11:09.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:13:09.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:15:10.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:17:10.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:19:10.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:21:10.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:23:10.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:25:10.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:27:11.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:29:11.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:31:11.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:33:11.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:35:11.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:37:11.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:39:12.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:41:12.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:43:12.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:45:12.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:47:12.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:49:12.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:51:13.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:53:13.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:55:13.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:57:13.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T12:59:13.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:01:13.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:03:14.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:05:14.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:07:14.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:09:14.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:11:14.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:13:14.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:15:14.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:17:15.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:19:15.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:21:15.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:23:15.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:25:15.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:27:15.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:29:16.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:31:16.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:33:16.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:35:16.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:37:16.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:39:16.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:41:17.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:43:17.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:45:17.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:47:17.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:49:17.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:51:18.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:53:18.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:55:18.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:57:18.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T13:59:18.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:01:18.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:03:19.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:05:19.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:07:19.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:09:19.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:11:19.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:13:19.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:15:19.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:17:20.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:19:20.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:21:20.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:23:20.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:25:20.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:27:20.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:29:21.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:31:21.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:33:21.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:35:21.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:37:21.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:39:21.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:41:22.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:43:22.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:45:22.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:47:22.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:49:22.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:51:22.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:53:23.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:55:23.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:57:23.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T14:59:23.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:01:23.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:03:23.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:05:24.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:07:24.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:09:24.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:11:24.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:13:24.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:15:25.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:17:25.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:19:25.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:21:25.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:23:25.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:25:25.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:27:26.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:29:26.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:31:26.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:33:26.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:35:26.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:37:26.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:39:27.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:41:27.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:43:27.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:45:27.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:47:27.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:49:27.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:51:28.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:53:28.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:55:28.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:57:28.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T15:59:28.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:01:28.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:03:29.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:05:29.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:07:29.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:09:29.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:11:29.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:13:29.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:15:30.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:17:30.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:19:30.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:21:30.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:23:30.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:25:30.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:27:31.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:29:31.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:31:31.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:33:31.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:35:31.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:37:31.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:39:32.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:41:32.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:43:32.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:45:32.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:47:32.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:49:32.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:51:33.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:53:33.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:55:33.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:57:33.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T16:59:33.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:01:33.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:03:34.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:05:34.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:07:34.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:09:34.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:11:34.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:13:34.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:15:35.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:17:35.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:19:35.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:21:35.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:23:35.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:25:35.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:27:35.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:29:36.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:31:36.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:33:36.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:35:36.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:37:36.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:39:36.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:41:37.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:43:37.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:45:37.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:47:37.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:49:37.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:51:37.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:53:38.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:55:38.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:57:38.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T17:59:38.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:01:38.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:03:38.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:05:39.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:07:39.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:09:39.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:11:39.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:13:39.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:15:39.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:17:40.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:19:40.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:21:40.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:23:40.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:25:40.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:27:40.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:29:40.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:31:41.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:33:41.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:35:41.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:37:41.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:39:41.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:41:41.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:43:41.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:45:42.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:47:42.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:49:42.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:51:42.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:53:42.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:55:42.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:57:43.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T18:59:43.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:01:43.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:03:43.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:05:43.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:07:43.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:09:44.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:11:44.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:13:44.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:15:44.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:17:44.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:19:44.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:21:45.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:23:45.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:25:45.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:27:45.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:29:45.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:31:45.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:33:45.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:35:46.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:37:46.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:39:46.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:41:46.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:43:46.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:45:46.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:47:47.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:49:47.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:51:47.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:53:47.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:55:47.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:57:50.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T19:59:50.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:01:50.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:03:50.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:05:50.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:07:51.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:09:51.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:11:51.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:13:51.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:15:51.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:17:51.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:19:51.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:21:52.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:23:52.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:25:52.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:27:52.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:29:52.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:31:52.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:33:53.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:35:53.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:37:53.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:39:53.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:41:53.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:43:53.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:45:54.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:47:54.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:49:54.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:51:54.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:53:54.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:55:54.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:57:55.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T20:59:55.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:01:55.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:03:55.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:05:55.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:07:56.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:09:56.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:11:56.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:13:56.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:15:56.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:17:56.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:19:56.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:21:57.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:23:57.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:25:57.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:27:57.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:29:57.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:31:57.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:33:58.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:35:58.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:37:58.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:39:58.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:41:58.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:43:58.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:45:59.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:47:59.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:49:59.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:51:59.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:53:59.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:55:59.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T21:58:00.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:00:00.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:02:00.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:04:00.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:06:00.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:08:00.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:10:00.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:12:01.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:14:01.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:16:01.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:18:01.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:20:01.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:22:01.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:24:01.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:26:02.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:28:02.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:30:02.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:32:02.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:34:02.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:36:02.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:38:03.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:40:03.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:42:03.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:44:03.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:46:03.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:48:03.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:50:04.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:52:04.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:54:04.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:56:04.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T22:58:04.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:00:04.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:02:05.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:04:05.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:06:05.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:08:05.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:10:05.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:12:05.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:14:06.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:16:06.192 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2024-01-28T23:16:06.330 INFO:teuthology.kill:Killing Pids: {87865} 2024-01-28T23:16:07.340 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-01-28T23:16:07.341 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-01-28T23:16:07.341 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-01-28T23:16:07.341 INFO:teuthology.misc:Compressing logs... 2024-01-28T23:16:07.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-28T23:16:07.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T23:16:07.440 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-01-28T23:16:07.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-01-28T23:16:07.560 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:07.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-28T23:16:07.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T23:16:07.638 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-01-28T23:16:07.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-28T23:16:07.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:07.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-01-28T23:16:07.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-28T23:16:07.837 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-01-28T23:16:07.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-01-28T23:16:07.910 DEBUG:teuthology.orchestra.run.smithi190:> sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:08.012 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi073/crash 2024-01-28T23:16:08.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-28T23:16:08.080 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi084/crash 2024-01-28T23:16:08.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-28T23:16:08.127 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi190/crash 2024-01-28T23:16:08.128 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-28T23:16:08.164 INFO:teuthology.misc:Compressing logs... 2024-01-28T23:16:08.164 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:08.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:08.171 DEBUG:teuthology.orchestra.run.smithi190:> sudo find /home/ubuntu/cephtest/archive -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-28T23:16:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-28T23:16:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-01-28T23:16:08.228 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-28T23:16:08.229 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-28T23:16:08.233 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-28T23:16:08.234 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-28T23:16:08.234 INFO:teuthology.orchestra.run.smithi190.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 81.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-01-28T23:16:08.238 INFO:teuthology.orchestra.run.smithi073.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 92.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-01-28T23:16:08.271 INFO:teuthology.orchestra.run.smithi084.stderr: 89.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-01-28T23:16:08.305 INFO:teuthology.orchestra.run.smithi190.stderr: 89.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-01-28T23:16:08.311 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-01-28T23:16:08.312 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi073/ 2024-01-28T23:16:08.312 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-28T23:16:08.397 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi084/ 2024-01-28T23:16:08.397 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-28T23:16:08.439 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi190/ 2024-01-28T23:16:08.439 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-28T23:16:08.480 INFO:teuthology.misc:Compressing logs... 2024-01-28T23:16:08.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:08.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:08.487 DEBUG:teuthology.orchestra.run.smithi190:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-28T23:16:08.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-28T23:16:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.7.log 2024-01-28T23:16:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.1.log 2024-01-28T23:16:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.h.log 2024-01-28T23:16:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log 2024-01-28T23:16:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.1.log: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.k.log 2024-01-28T23:16:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.k.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-28T23:16:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.e.log 2024-01-28T23:16:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.b.log 2024-01-28T23:16:08.527 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.e.log: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.b.log 2024-01-28T23:16:08.527 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.y.log 2024-01-28T23:16:08.544 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-28T23:16:08.544 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.5.log 2024-01-28T23:16:08.546 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.i.log 2024-01-28T23:16:08.546 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.c.log 2024-01-28T23:16:08.546 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.5.log: gzip /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.i.log: -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.f.log 2024-01-28T23:16:08.546 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.z.log 2024-01-28T23:16:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-28T23:16:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-01-28T23:16:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.a.log 2024-01-28T23:16:08.548 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.f.log: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.z.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-28T23:16:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.g.log 2024-01-28T23:16:08.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.j.log 2024-01-28T23:16:08.549 INFO:teuthology.orchestra.run.smithi073.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-01-28T23:16:08.550 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.a.log 2024-01-28T23:16:08.551 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.11.log 2024-01-28T23:16:08.551 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.2.log 2024-01-28T23:16:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.9.log 2024-01-28T23:16:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.3.log 2024-01-28T23:16:08.555 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.10.log 2024-01-28T23:16:08.555 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log.gz 2024-01-28T23:16:08.556 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.11.log: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log 2024-01-28T23:16:08.556 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.9.log: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.3.log: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-28T23:16:08.557 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log 2024-01-28T23:16:08.559 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.l.log 2024-01-28T23:16:08.560 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.0.log 2024-01-28T23:16:08.562 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.d.log 2024-01-28T23:16:08.569 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.6.log 2024-01-28T23:16:08.572 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.d.log: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.x.log 2024-01-28T23:16:08.574 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.c.log 2024-01-28T23:16:08.575 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.4.log 2024-01-28T23:16:08.597 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log.gz 2024-01-28T23:16:08.597 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.8.log 2024-01-28T23:16:08.631 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.x.log: 91.5% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-volume.log.gz 2024-01-28T23:16:08.673 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.8.log: 94.5% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.z.log.gz 2024-01-28T23:16:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.4.log: 94.5% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.y.log.gz 2024-01-28T23:16:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.k.log: file size changed while zipping 2024-01-28T23:16:11.104 INFO:teuthology.orchestra.run.smithi084.stderr: 95.2% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.k.log.gz 2024-01-28T23:16:11.447 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.i.log: file size changed while zipping 2024-01-28T23:16:11.447 INFO:teuthology.orchestra.run.smithi190.stderr: 95.9% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.i.log.gz 2024-01-28T23:16:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.g.log: file size changed while zipping 2024-01-28T23:16:11.625 INFO:teuthology.orchestra.run.smithi073.stderr: 95.0% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.g.log.gz 2024-01-28T23:16:11.845 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.e.log: file size changed while zipping 2024-01-28T23:16:11.846 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.e.log.gz 2024-01-28T23:16:11.954 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.a.log: file size changed while zipping 2024-01-28T23:16:11.955 INFO:teuthology.orchestra.run.smithi073.stderr: 95.0% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.a.log.gz 2024-01-28T23:16:13.348 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.f.log: file size changed while zipping 2024-01-28T23:16:13.348 INFO:teuthology.orchestra.run.smithi190.stderr: 91.0% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.f.log.gz 2024-01-28T23:16:15.755 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.x.log: file size changed while zipping 2024-01-28T23:16:15.756 INFO:teuthology.orchestra.run.smithi073.stderr: 91.3% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mgr.x.log.gz 2024-01-28T23:16:18.774 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.c.log: file size changed while zipping 2024-01-28T23:16:18.775 INFO:teuthology.orchestra.run.smithi190.stderr: 90.9% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.c.log.gz 2024-01-28T23:16:18.791 INFO:teuthology.orchestra.run.smithi190.stderr: 95.0% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.l.log.gz 2024-01-28T23:16:19.074 INFO:teuthology.orchestra.run.smithi073.stderr: 95.0% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.j.log.gz 2024-01-28T23:16:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 95.0% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.d.log.gz 2024-01-28T23:16:20.551 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.c.log: file size changed while zipping 2024-01-28T23:16:20.551 INFO:teuthology.orchestra.run.smithi190.stderr: 92.1% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.c.log.gz 2024-01-28T23:16:22.564 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.b.log: file size changed while zipping 2024-01-28T23:16:22.564 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.b.log.gz 2024-01-28T23:16:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.b.log: file size changed while zipping 2024-01-28T23:16:27.175 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.b.log.gz 2024-01-28T23:16:27.770 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mds.h.log.gz 2024-01-28T23:16:34.395 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.0.log: file size changed while zipping 2024-01-28T23:16:34.395 INFO:teuthology.orchestra.run.smithi073.stderr: 92.8% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.0.log.gz 2024-01-28T23:16:34.443 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.11.log: file size changed while zipping 2024-01-28T23:16:34.443 INFO:teuthology.orchestra.run.smithi190.stderr: 92.8% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.11.log.gz 2024-01-28T23:16:36.442 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.8.log: file size changed while zipping 2024-01-28T23:16:36.443 INFO:teuthology.orchestra.run.smithi190.stderr: 92.4% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.8.log.gz 2024-01-28T23:16:37.328 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.3.log: file size changed while zipping 2024-01-28T23:16:37.329 INFO:teuthology.orchestra.run.smithi073.stderr: 92.8% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.3.log.gz 2024-01-28T23:16:37.572 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.1.log: file size changed while zipping 2024-01-28T23:16:37.572 INFO:teuthology.orchestra.run.smithi084.stderr: 92.5% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.1.log.gz 2024-01-28T23:16:38.132 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.4.log: file size changed while zipping 2024-01-28T23:16:38.132 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.4.log.gz 2024-01-28T23:16:38.272 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.2.log: file size changed while zipping 2024-01-28T23:16:38.273 INFO:teuthology.orchestra.run.smithi190.stderr: 92.5% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.2.log.gz 2024-01-28T23:16:41.631 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.6.log: file size changed while zipping 2024-01-28T23:16:41.631 INFO:teuthology.orchestra.run.smithi073.stderr: 92.7% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.6.log.gz 2024-01-28T23:16:41.801 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.a.log: file size changed while zipping 2024-01-28T23:16:41.801 INFO:teuthology.orchestra.run.smithi073.stderr: 89.9% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-mon.a.log.gz 2024-01-28T23:16:43.236 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.7.log: file size changed while zipping 2024-01-28T23:16:43.236 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.7.log.gz 2024-01-28T23:16:45.082 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.10.log: file size changed while zipping 2024-01-28T23:16:45.082 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.10.log.gz 2024-01-28T23:16:45.253 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.9.log: file size changed while zipping 2024-01-28T23:16:45.253 INFO:teuthology.orchestra.run.smithi073.stderr: 92.1% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.9.log.gz 2024-01-28T23:16:49.393 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.5.log: file size changed while zipping 2024-01-28T23:16:49.394 INFO:teuthology.orchestra.run.smithi190.stderr: 92.6% -- replaced with /var/log/ceph/11299222-bdd1-11ee-95b2-87774f69a715/ceph-osd.5.log.gz 2024-01-28T23:16:49.396 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi073/log 2024-01-28T23:16:49.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-28T23:17:12.021 INFO:teuthology.orchestra.run.smithi073.stderr:tar: .: file changed as we read it 2024-01-28T23:17:12.022 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi084/log 2024-01-28T23:17:12.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-28T23:17:34.393 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-01-28_10:21:48-fs:workload-wip-khiremat-49945-referent-inode-3-distro-default-smithi/7535742/remote/smithi190/log 2024-01-28T23:17:34.394 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-28T23:17:55.808 INFO:teuthology.kill:No teuthology processes running 2024-01-28T23:17:56.908 INFO:teuthology.kill:Nuking machines: ['smithi073', 'smithi084', 'smithi190'] 2024-01-28T23:17:57.877 INFO:teuthology.kill:2024-01-28 23:17:57,876.876 INFO:teuthology.nuke:targets: 2024-01-28T23:17:57.877 INFO:teuthology.kill: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJQ6A96xtCyItzGHjqN2/3410canaIQWgeg1grS6mU2hk6lrZVaeQ5XjnRxn7f2Cxzx90XBuT1wh18H6FdVu9Z0= 2024-01-28T23:17:57.877 INFO:teuthology.kill: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK+Ou1ckJ1tRBdD5/L300IsqejNEoWIMrw5P6rKFLcpk8/u9nD96AExVVE7A/xX6nrsdYaXzg7vawVE8MS+qCBM= 2024-01-28T23:17:57.877 INFO:teuthology.kill: smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNq9ruuLL58TS0VprNyzhNhKel9e8IQP4g6GDN1dLLrdUTZFSPkcUDgun4pGYLPDIQ+sh4IHO3bn6pJU1p474MU= 2024-01-28T23:17:57.878 INFO:teuthology.kill:2024-01-28 23:17:57,877.877 INFO:teuthology.nuke:Checking targets against current locks 2024-01-28T23:17:57.928 INFO:teuthology.kill:2024-01-28 23:17:57,928.928 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-28T23:17:57.959 INFO:teuthology.kill:2024-01-28 23:17:57,959.959 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-28T23:17:57.983 INFO:teuthology.kill:2024-01-28 23:17:57,983.983 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-28T23:17:58.011 INFO:teuthology.kill:2024-01-28 23:17:58,010.010 INFO:teuthology.orchestra.console.smithi073:Power off 2024-01-28T23:17:58.053 INFO:teuthology.kill:2024-01-28 23:17:58,053.053 INFO:teuthology.orchestra.console.smithi084:Power off 2024-01-28T23:17:58.091 INFO:teuthology.kill:2024-01-28 23:17:58,090.090 INFO:teuthology.orchestra.console.smithi190:Power off 2024-01-28T23:18:06.391 INFO:teuthology.kill:2024-01-28 23:18:06,390.390 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-01-28T23:18:06.538 INFO:teuthology.kill:2024-01-28 23:18:06,537.537 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2024-01-28T23:18:10.531 INFO:teuthology.kill:2024-01-28 23:18:10,530.530 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-01-28T23:18:10.561 INFO:teuthology.kill:2024-01-28 23:18:10,561.561 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-01-28T23:18:10.679 INFO:teuthology.kill:2024-01-28 23:18:10,679.679 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2024-01-28T23:18:10.706 INFO:teuthology.kill:2024-01-28 23:18:10,705.705 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com 2024-01-28T23:18:10.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:20:10.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-28T23:20:11.012 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2024-01-28T23:20:11.140 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-01-28_20:25:38-rados:thrash-wip-rf-reserver2-distro-default-smithi/7535997 2024-01-28T23:20:11.141 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi084 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-01-28_20:25:38-rados:thrash-wip-rf-reserver2-distro-default-smithi/7536000 2024-01-28T23:20:11.141 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi190 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-01-28_20:25:38-rados:thrash-wip-rf-reserver2-distro-default-smithi/7535997