2023-06-09T22:19:10.528 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T22:19:10.725 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging 2023-06-09T22:19:10.727 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server 2023-06-09T22:19:10.727 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2023-06-09T22:19:10.747 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-06-09T22:19:10.747 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-06-09T22:19:10.747 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-06-09T22:19:10.771 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-06-09T22:19:10.772 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-06-09T22:19:10.772 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-06-09T22:19:10.929 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of rhel 8.6 2023-06-09T22:19:10.938 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6 2023-06-09T22:19:10.989 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.6 2023-06-09T22:19:11.226 INFO:teuthology.orchestra.console:Power off smithi047 2023-06-09T22:19:11.249 INFO:teuthology.orchestra.console:Power off smithi057 2023-06-09T22:19:11.309 INFO:teuthology.orchestra.console:Power off smithi152 2023-06-09T22:19:19.640 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-06-09T22:19:19.741 INFO:teuthology.orchestra.console:Power on smithi057 2023-06-09T22:19:23.729 INFO:teuthology.orchestra.console:Power off for smithi047 completed 2023-06-09T22:19:23.794 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2023-06-09T22:19:23.831 INFO:teuthology.orchestra.console:Power on smithi047 2023-06-09T22:19:23.896 INFO:teuthology.orchestra.console:Power on smithi152 2023-06-09T22:19:23.996 INFO:teuthology.orchestra.console:Power on for smithi057 completed 2023-06-09T22:19:24.097 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-06-09T22:19:28.087 INFO:teuthology.orchestra.console:Power on for smithi047 completed 2023-06-09T22:19:28.149 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2023-06-09T22:19:28.189 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish 2023-06-09T22:19:28.250 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-06-09T22:22:02.100 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-06-09T22:22:11.188 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-06-09T22:22:13.136 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-09T22:22:17.204 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-06-09T22:22:20.276 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-06-09T22:22:22.192 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-09T22:22:26.256 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-06-09T22:22:29.328 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-06-09T22:22:31.252 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-09T22:22:35.312 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-06-09T22:22:38.384 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-06-09T22:22:40.340 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-09T22:22:44.368 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-06-09T22:22:47.440 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.47 2023-06-09T22:22:49.424 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-09T22:22:53.424 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-06-09T22:22:58.480 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-09T22:23:02.480 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-06-09T22:23:07.536 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-09T22:23:11.536 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-06-09T22:23:53.476 WARNING:teuthology.provision.fog:timed out 2023-06-09T22:23:59.833 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-09T22:24:00.099 INFO:teuthology.provision.fog.smithi047:Node is ready 2023-06-09T22:24:00.117 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com 2023-06-09T22:24:00.176 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047 2023-06-09T22:24:00.572 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T22:24:00.572 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T22:24:00.572 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel" 2023-06-09T22:24:00.572 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora" 2023-06-09T22:24:00.572 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.6" 2023-06-09T22:24:00.573 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2023-06-09T22:24:00.573 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T22:24:00.573 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2023-06-09T22:24:00.573 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T22:24:00.573 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T22:24:00.573 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T22:24:00.573 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T22:24:00.574 INFO:teuthology.orchestra.run.smithi047.stdout: 2023-06-09T22:24:00.574 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T22:24:00.574 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T22:24:00.574 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T22:24:00.574 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T22:24:00.575 INFO:teuthology.provision.fog.smithi047:Deploy complete! 2023-06-09T22:24:13.541 WARNING:teuthology.provision.fog:timed out 2023-06-09T22:24:17.541 WARNING:teuthology.provision.fog:timed out 2023-06-09T22:24:19.878 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-09T22:24:20.175 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-06-09T22:24:20.193 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-06-09T22:24:20.252 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-06-09T22:24:20.666 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T22:24:20.667 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T22:24:20.667 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-06-09T22:24:20.667 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-06-09T22:24:20.667 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-06-09T22:24:20.667 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-06-09T22:24:20.667 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T22:24:20.667 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-06-09T22:24:20.668 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T22:24:20.668 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T22:24:20.668 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T22:24:20.668 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T22:24:20.668 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-06-09T22:24:20.668 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T22:24:20.669 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T22:24:20.669 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T22:24:20.669 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T22:24:20.669 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-06-09T22:24:23.890 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-09T22:24:24.157 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-06-09T22:24:24.175 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152 2023-06-09T22:24:24.233 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-06-09T22:24:24.660 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T22:24:24.661 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T22:24:24.661 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-06-09T22:24:24.661 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-06-09T22:24:24.661 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2023-06-09T22:24:24.661 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-06-09T22:24:24.661 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T22:24:24.662 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-06-09T22:24:24.662 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T22:24:24.662 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T22:24:24.662 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T22:24:24.662 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T22:24:24.662 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-06-09T22:24:24.662 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T22:24:24.663 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T22:24:24.663 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T22:24:24.663 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T22:24:24.663 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-06-09T22:24:24.859 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com 2023-06-09T22:24:24.860 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-09T22:24:24.881 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-06-09T22:24:24.881 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-09T22:24:24.897 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-06-09T22:24:24.897 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-09T22:24:24.923 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server 2023-06-09T22:24:24.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2023-06-09T22:24:25.125 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2023-06-09T22:24:25.184 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T22:24:25.184 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T22:24:25.184 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel" 2023-06-09T22:24:25.185 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora" 2023-06-09T22:24:25.185 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.6" 2023-06-09T22:24:25.185 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2023-06-09T22:24:25.185 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T22:24:25.185 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2023-06-09T22:24:25.185 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T22:24:25.185 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T22:24:25.186 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T22:24:25.186 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T22:24:25.186 INFO:teuthology.orchestra.run.smithi047.stdout: 2023-06-09T22:24:25.186 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T22:24:25.186 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T22:24:25.187 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T22:24:25.187 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T22:24:25.187 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2023-06-09T22:24:25.215 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-06-09T22:24:25.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-06-09T22:24:25.411 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-06-09T22:24:25.470 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T22:24:25.471 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T22:24:25.471 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-06-09T22:24:25.471 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-06-09T22:24:25.472 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-06-09T22:24:25.472 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-06-09T22:24:25.472 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T22:24:25.472 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-06-09T22:24:25.472 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T22:24:25.472 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T22:24:25.473 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T22:24:25.473 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T22:24:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-06-09T22:24:25.473 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T22:24:25.473 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T22:24:25.473 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T22:24:25.474 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T22:24:25.474 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-06-09T22:24:25.515 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-06-09T22:24:25.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-06-09T22:24:25.664 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-06-09T22:24:25.722 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T22:24:25.722 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T22:24:25.722 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-06-09T22:24:25.722 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-06-09T22:24:25.722 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2023-06-09T22:24:25.723 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-06-09T22:24:25.723 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T22:24:25.723 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-06-09T22:24:25.723 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T22:24:25.723 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T22:24:25.723 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T22:24:25.723 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T22:24:25.723 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-06-09T22:24:25.724 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T22:24:25.724 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T22:24:25.724 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T22:24:25.724 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T22:24:25.725 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-06-09T22:24:25.863 INFO:teuthology.dispatcher.supervisor:Running job 7300067 2023-06-09T22:24:25.863 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-09_20:58:32-fs-reef-distro-default-smithi/7300067 --name yuriw-2023-06-09_20:58:32-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/yuriw-2023-06-09_20:58:32-fs-reef-distro-default-smithi/7300067/orig.config.yaml 2023-06-09T22:24:25.867 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-09_20:58:32-fs-reef-distro-default-smithi/7300067 2023-06-09T22:24:25.868 INFO:teuthology.dispatcher.supervisor:Job PID: 13983 2023-06-09T22:24:25.869 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-10T10:24:54.141 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-06-10T10:24:54.313 INFO:teuthology.kill:Killing Pids: {13983} 2023-06-10T10:24:55.147 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-06-10T10:24:55.148 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-06-10T10:24:55.148 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-06-10T10:24:55.148 INFO:teuthology.misc:Compressing logs... 2023-06-10T10:24:55.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2023-06-10T10:24:55.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-06-10T10:24:55.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-06-10T10:24:56.027 INFO:teuthology.misc:Compressing logs... 2023-06-10T10:24:56.061 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-10T10:24:56.062 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-10T10:24:56.062 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-10T10:24:56.079 INFO:teuthology.orchestra.run.smithi047.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 82.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-06-10T10:24:56.090 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-10T10:24:56.097 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-10T10:24:56.097 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-10T10:24:56.098 INFO:teuthology.orchestra.run.smithi152.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 75.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-06-10T10:24:56.101 INFO:teuthology.orchestra.run.smithi057.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 79.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-06-10T10:24:56.145 INFO:teuthology.orchestra.run.smithi047.stderr: 91.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-06-10T10:24:56.148 INFO:teuthology.orchestra.run.smithi152.stderr: 91.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-06-10T10:24:56.167 INFO:teuthology.orchestra.run.smithi057.stderr: 91.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-06-10T10:24:56.298 INFO:teuthology.misc:Compressing logs... 2023-06-10T10:24:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-06-10T10:24:56.329 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.0.log 2023-06-10T10:24:56.330 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 /var/log/ceph/cephadm.log: --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.g.log 2023-06-10T10:24:56.331 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.a.log 2023-06-10T10:24:56.331 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.0.log: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.6.log 2023-06-10T10:24:56.331 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.3.log 2023-06-10T10:24:56.331 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.d.log 2023-06-10T10:24:56.333 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.x.log 2023-06-10T10:24:56.333 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.9.log 2023-06-10T10:24:56.334 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log 2023-06-10T10:24:56.334 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.j.log 2023-06-10T10:24:56.334 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.a.log 2023-06-10T10:24:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-06-10T10:24:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.10.log 2023-06-10T10:24:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.h.log 2023-06-10T10:24:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.e.log 2023-06-10T10:24:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.10.log: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.4.log 2023-06-10T10:24:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.1.log 2023-06-10T10:24:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.k.log 2023-06-10T10:24:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log 2023-06-10T10:24:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.7.log 2023-06-10T10:24:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.b.log 2023-06-10T10:24:56.337 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.b.log 2023-06-10T10:24:56.337 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.y.log 2023-06-10T10:24:56.346 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.b.log: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.y.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-06-10T10:24:56.363 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-06-10T10:24:56.364 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.5.log 2023-06-10T10:24:56.364 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.2.log 2023-06-10T10:24:56.364 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.11.log 2023-06-10T10:24:56.374 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.5.log: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.z.log 2023-06-10T10:24:56.375 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.8.log 2023-06-10T10:24:56.375 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.f.log 2023-06-10T10:24:56.375 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.8.log: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.f.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-06-10T10:24:56.375 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.c.log 2023-06-10T10:24:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.i.log 2023-06-10T10:24:56.382 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.c.log 2023-06-10T10:24:56.407 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log 2023-06-10T10:24:56.432 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.l.log 2023-06-10T10:24:56.444 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.l.log: 93.5% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log.gz 2023-06-10T10:24:56.459 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.j.log: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.a.log: 94.7% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.a.log.gz 2023-06-10T10:24:56.491 INFO:teuthology.orchestra.run.smithi152.stderr: 94.6% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.z.log.gz 2023-06-10T10:24:56.524 INFO:teuthology.orchestra.run.smithi152.stderr: 94.4% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.f.log.gz 2023-06-10T10:24:56.569 INFO:teuthology.orchestra.run.smithi152.stderr: 94.3% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.l.log.gz 2023-06-10T10:24:56.626 INFO:teuthology.orchestra.run.smithi047.stderr: 94.7% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.g.log.gz 2023-06-10T10:24:56.635 INFO:teuthology.orchestra.run.smithi047.stderr: 94.7% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.d.log.gz 2023-06-10T10:24:56.642 INFO:teuthology.orchestra.run.smithi047.stderr: 94.7% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.j.log.gz 2023-06-10T10:24:56.720 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/cephadm.log: file size changed while zipping 2023-06-10T10:24:56.720 INFO:teuthology.orchestra.run.smithi047.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-06-10T10:24:56.766 INFO:teuthology.orchestra.run.smithi047.stderr: 93.5% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log.gz 2023-06-10T10:24:56.889 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-volume.log.gz 2023-06-10T10:25:00.239 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.k.log: file size changed while zipping 2023-06-10T10:25:00.240 INFO:teuthology.orchestra.run.smithi057.stderr: 94.3% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.k.log.gz 2023-06-10T10:25:01.604 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.y.log: file size changed while zipping 2023-06-10T10:25:01.605 INFO:teuthology.orchestra.run.smithi057.stderr: 94.6% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.y.log.gz 2023-06-10T10:25:02.587 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.x.log: file size changed while zipping 2023-06-10T10:25:02.587 INFO:teuthology.orchestra.run.smithi047.stderr: 90.2% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mgr.x.log.gz 2023-06-10T10:25:04.462 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.c.log: file size changed while zipping 2023-06-10T10:25:04.462 INFO:teuthology.orchestra.run.smithi152.stderr: 95.3% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.c.log.gz 2023-06-10T10:25:07.321 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2023-06-10T10:25:07.322 INFO:teuthology.orchestra.run.smithi152.stderr: 92.1% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.c.log.gz 2023-06-10T10:25:14.784 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.i.log: file size changed while zipping 2023-06-10T10:25:14.784 INFO:teuthology.orchestra.run.smithi152.stderr: 94.9% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.i.log.gz 2023-06-10T10:25:19.613 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2023-06-10T10:25:19.613 INFO:teuthology.orchestra.run.smithi047.stderr: 89.9% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.a.log.gz 2023-06-10T10:25:21.400 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.h.log: file size changed while zipping 2023-06-10T10:25:21.400 INFO:teuthology.orchestra.run.smithi057.stderr: 95.4% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.h.log.gz 2023-06-10T10:25:21.838 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-06-10T10:25:21.838 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.2.log.gz 2023-06-10T10:25:23.156 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-06-10T10:25:23.157 INFO:teuthology.orchestra.run.smithi047.stderr: 93.2% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.0.log.gz 2023-06-10T10:25:23.220 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2023-06-10T10:25:23.220 INFO:teuthology.orchestra.run.smithi047.stderr: 93.2% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.6.log.gz 2023-06-10T10:25:23.525 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.11.log: file size changed while zipping 2023-06-10T10:25:23.525 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.11.log.gz 2023-06-10T10:25:25.886 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-06-10T10:25:25.887 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.5.log.gz 2023-06-10T10:25:25.913 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2023-06-10T10:25:25.913 INFO:teuthology.orchestra.run.smithi057.stderr: 92.6% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mon.b.log.gz 2023-06-10T10:25:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2023-06-10T10:25:26.255 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.8.log.gz 2023-06-10T10:25:26.303 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.9.log: file size changed while zipping 2023-06-10T10:25:26.304 INFO:teuthology.orchestra.run.smithi047.stderr: 93.1% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.9.log.gz 2023-06-10T10:25:32.663 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-06-10T10:25:32.664 INFO:teuthology.orchestra.run.smithi047.stderr: 93.2% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.3.log.gz 2023-06-10T10:25:37.045 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.e.log: file size changed while zipping 2023-06-10T10:25:37.045 INFO:teuthology.orchestra.run.smithi057.stderr: 95.7% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.e.log.gz 2023-06-10T10:25:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-06-10T10:25:54.443 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.4.log.gz 2023-06-10T10:26:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-06-10T10:26:04.128 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.1.log.gz 2023-06-10T10:26:11.075 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2023-06-10T10:26:11.075 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.10.log.gz 2023-06-10T10:26:11.143 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-06-10T10:26:11.144 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-osd.7.log.gz 2023-06-10T10:33:15.547 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.b.log: file size changed while zipping 2023-06-10T10:33:15.547 INFO:teuthology.orchestra.run.smithi057.stderr: 92.7% -- replaced with /var/log/ceph/1c15f12a-0716-11ee-9b1e-001a4aab830c/ceph-mds.b.log.gz 2023-06-10T10:34:46.539 INFO:teuthology.kill:No teuthology processes running 2023-06-10T10:34:47.277 INFO:teuthology.kill:Nuking machines: ['smithi047', 'smithi057', 'smithi152'] 2023-06-10T10:34:47.849 INFO:teuthology.kill:2023-06-10 10:34:47,848.848 INFO:teuthology.nuke:targets: 2023-06-10T10:34:47.850 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/dispatcher/supervisor.py", line 320, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/kill.py", line 101, in kill_job nuke_targets(targets, owner) File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/kill.py", line 276, in nuke_targets sys.stdout.flush() OSError: [Errno 5] Input/output error 2023-06-10T10:36:48.029 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15