2023-06-09T07:10:49.372 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T07:10:49.625 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-06-09T07:10:49.626 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-06-09T07:10:49.627 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-06-09T07:10:51.488 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-06-09T07:10:51.488 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-06-09T07:10:51.489 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-06-09T07:10:51.513 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging 2023-06-09T07:10:51.513 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server 2023-06-09T07:10:51.513 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2023-06-09T07:10:51.652 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2023-06-09T07:10:51.675 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of rhel 8.6 2023-06-09T07:10:51.691 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of rhel 8.6 2023-06-09T07:10:51.962 INFO:teuthology.orchestra.console:Power off smithi188 2023-06-09T07:10:51.979 INFO:teuthology.orchestra.console:Power off smithi172 2023-06-09T07:10:51.995 INFO:teuthology.orchestra.console:Power off smithi189 2023-06-09T07:11:00.359 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-06-09T07:11:00.370 INFO:teuthology.orchestra.console:Power off for smithi189 completed 2023-06-09T07:11:00.461 INFO:teuthology.orchestra.console:Power on smithi172 2023-06-09T07:11:00.471 INFO:teuthology.orchestra.console:Power on smithi189 2023-06-09T07:11:04.477 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-06-09T07:11:04.579 INFO:teuthology.orchestra.console:Power on smithi188 2023-06-09T07:11:08.822 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2023-06-09T07:11:08.831 INFO:teuthology.orchestra.console:Power on for smithi189 completed 2023-06-09T07:11:08.835 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2023-06-09T07:11:08.924 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-06-09T07:11:08.932 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2023-06-09T07:11:08.935 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-06-09T07:14:58.800 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-09T07:15:07.888 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-09T07:15:16.944 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-09T07:15:26.000 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-09T07:15:35.056 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-09T07:15:43.856 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.189 2023-06-09T07:15:52.912 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.189 2023-06-09T07:15:58.960 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-09T07:15:59.472 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-09T07:16:01.968 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.189 2023-06-09T07:16:08.016 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-09T07:16:08.528 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-09T07:16:11.024 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.189 2023-06-09T07:16:17.072 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-09T07:16:17.584 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-06-09T07:16:20.080 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.189 2023-06-09T07:16:23.953 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-09T07:16:24.221 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-06-09T07:16:24.237 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2023-06-09T07:16:24.294 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-06-09T07:16:24.706 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T07:16:24.706 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T07:16:24.706 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-06-09T07:16:24.706 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-06-09T07:16:24.706 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-06-09T07:16:24.707 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-06-09T07:16:24.707 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T07:16:24.707 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-06-09T07:16:24.707 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T07:16:24.707 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T07:16:24.707 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T07:16:24.707 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T07:16:24.708 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-06-09T07:16:24.708 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T07:16:24.708 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T07:16:24.708 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T07:16:24.708 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T07:16:24.709 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-06-09T07:16:26.128 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-09T07:16:29.136 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.189 2023-06-09T07:17:32.165 WARNING:teuthology.provision.fog:timed out 2023-06-09T07:17:35.144 WARNING:teuthology.provision.fog:timed out 2023-06-09T07:17:38.700 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-09T07:17:38.988 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-06-09T07:17:39.007 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-06-09T07:17:39.064 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-06-09T07:17:39.473 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T07:17:39.473 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T07:17:39.473 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-06-09T07:17:39.473 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-06-09T07:17:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.6" 2023-06-09T07:17:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-06-09T07:17:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T07:17:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-06-09T07:17:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T07:17:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T07:17:39.474 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T07:17:39.475 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T07:17:39.475 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-06-09T07:17:39.475 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T07:17:39.475 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T07:17:39.475 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T07:17:39.475 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T07:17:39.475 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-06-09T07:17:41.393 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-09T07:17:41.710 INFO:teuthology.provision.fog.smithi189:Node is ready 2023-06-09T07:17:41.728 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com 2023-06-09T07:17:41.786 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189 2023-06-09T07:17:42.203 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T07:17:42.203 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T07:17:42.204 INFO:teuthology.orchestra.run.smithi189.stdout:ID="rhel" 2023-06-09T07:17:42.204 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="fedora" 2023-06-09T07:17:42.204 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="8.6" 2023-06-09T07:17:42.204 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el8" 2023-06-09T07:17:42.204 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T07:17:42.204 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2023-06-09T07:17:42.204 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T07:17:42.205 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T07:17:42.205 INFO:teuthology.orchestra.run.smithi189.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T07:17:42.205 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T07:17:42.205 INFO:teuthology.orchestra.run.smithi189.stdout: 2023-06-09T07:17:42.205 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T07:17:42.205 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T07:17:42.205 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T07:17:42.206 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T07:17:42.206 INFO:teuthology.provision.fog.smithi189:Deploy complete! 2023-06-09T07:17:42.418 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-06-09T07:17:42.419 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-09T07:17:42.446 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-06-09T07:17:42.446 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-09T07:17:42.462 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com 2023-06-09T07:17:42.463 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-09T07:17:42.489 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-06-09T07:17:42.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-06-09T07:17:42.749 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-06-09T07:17:42.806 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T07:17:42.806 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T07:17:42.806 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-06-09T07:17:42.807 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-06-09T07:17:42.807 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-06-09T07:17:42.807 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-06-09T07:17:42.807 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T07:17:42.807 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-06-09T07:17:42.807 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T07:17:42.807 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T07:17:42.808 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T07:17:42.808 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T07:17:42.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-06-09T07:17:42.808 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T07:17:42.808 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T07:17:42.808 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T07:17:42.808 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T07:17:42.809 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-06-09T07:17:42.830 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-06-09T07:17:42.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-06-09T07:17:43.025 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-06-09T07:17:43.083 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T07:17:43.083 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T07:17:43.084 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-06-09T07:17:43.084 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-06-09T07:17:43.084 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.6" 2023-06-09T07:17:43.084 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-06-09T07:17:43.084 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T07:17:43.084 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-06-09T07:17:43.084 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T07:17:43.085 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T07:17:43.085 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T07:17:43.085 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T07:17:43.085 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-06-09T07:17:43.085 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T07:17:43.085 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T07:17:43.086 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T07:17:43.086 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T07:17:43.086 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-06-09T07:17:43.104 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server 2023-06-09T07:17:43.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2023-06-09T07:17:43.299 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2023-06-09T07:17:43.359 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T07:17:43.359 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T07:17:43.359 INFO:teuthology.orchestra.run.smithi189.stdout:ID="rhel" 2023-06-09T07:17:43.359 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="fedora" 2023-06-09T07:17:43.359 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="8.6" 2023-06-09T07:17:43.360 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el8" 2023-06-09T07:17:43.360 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T07:17:43.360 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2023-06-09T07:17:43.360 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T07:17:43.360 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T07:17:43.360 INFO:teuthology.orchestra.run.smithi189.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T07:17:43.361 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T07:17:43.361 INFO:teuthology.orchestra.run.smithi189.stdout: 2023-06-09T07:17:43.361 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T07:17:43.361 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T07:17:43.361 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T07:17:43.361 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T07:17:43.362 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2023-06-09T07:17:43.473 INFO:teuthology.dispatcher.supervisor:Running job 7299748 2023-06-09T07:17:43.473 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-09_07:09:47-fs-wip-rishabh-2023Jun8-1855-testing-default-smithi/7299748 --name rishabh-2023-06-09_07:09:47-fs-wip-rishabh-2023Jun8-1855-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/rishabh-2023-06-09_07:09:47-fs-wip-rishabh-2023Jun8-1855-testing-default-smithi/7299748/orig.config.yaml 2023-06-09T07:17:43.477 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-09_07:09:47-fs-wip-rishabh-2023Jun8-1855-testing-default-smithi/7299748 2023-06-09T07:17:43.477 INFO:teuthology.dispatcher.supervisor:Job PID: 5669 2023-06-09T07:17:43.478 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-09T19:18:37.821 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-06-09T19:18:38.005 INFO:teuthology.kill:Killing Pids: {5669} 2023-06-09T19:18:45.205 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-06-09T19:18:45.205 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-06-09T19:18:45.206 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-06-09T19:18:45.206 INFO:teuthology.misc:Compressing logs... 2023-06-09T19:18:45.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-06-09T19:18:45.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-06-09T19:18:45.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2023-06-09T19:18:45.986 INFO:teuthology.misc:Compressing logs... 2023-06-09T19:18:46.016 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T19:18:46.017 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T19:18:46.017 INFO:teuthology.orchestra.run.smithi188.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 79.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-06-09T19:18:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T19:18:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T19:18:46.028 INFO:teuthology.orchestra.run.smithi172.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 88.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-06-09T19:18:46.055 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T19:18:46.056 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T19:18:46.056 INFO:teuthology.orchestra.run.smithi189.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 79.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-06-09T19:18:46.098 INFO:teuthology.orchestra.run.smithi188.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 94.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-06-09T19:18:46.126 INFO:teuthology.orchestra.run.smithi172.stderr: 94.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-06-09T19:18:46.140 INFO:teuthology.orchestra.run.smithi189.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 94.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-06-09T19:18:46.276 INFO:teuthology.misc:Compressing logs... 2023-06-09T19:18:46.303 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-06-09T19:18:46.303 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-06-09T19:18:46.304 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.0.log 2023-06-09T19:18:46.304 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.g.log 2023-06-09T19:18:46.304 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.a.log 2023-06-09T19:18:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.6.log 2023-06-09T19:18:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.3.log 2023-06-09T19:18:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.d.log 2023-06-09T19:18:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.x.log 2023-06-09T19:18:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.9.log 2023-06-09T19:18:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log 2023-06-09T19:18:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.j.log 2023-06-09T19:18:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.a.log 2023-06-09T19:18:46.307 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-06-09T19:18:46.308 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.10.log 2023-06-09T19:18:46.308 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.h.log 2023-06-09T19:18:46.308 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.e.log 2023-06-09T19:18:46.308 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.4.log 2023-06-09T19:18:46.308 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.1.log 2023-06-09T19:18:46.309 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.4.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.1.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-06-09T19:18:46.309 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.k.log 2023-06-09T19:18:46.309 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log 2023-06-09T19:18:46.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.0.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.g.log: /var/log/ceph/ceph-client.admin.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.a.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.6.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.3.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.d.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.x.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.9.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.j.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.a.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-06-09T19:18:46.317 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.k.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.7.log 2023-06-09T19:18:46.320 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.b.log 2023-06-09T19:18:46.323 INFO:teuthology.orchestra.run.smithi188.stderr: 93.5% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log.gz 2023-06-09T19:18:46.334 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.b.log 2023-06-09T19:18:46.340 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-06-09T19:18:46.340 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log.gz 2023-06-09T19:18:46.341 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.5.log 2023-06-09T19:18:46.341 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.2.log 2023-06-09T19:18:46.342 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.11.log 2023-06-09T19:18:46.342 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.z.log 2023-06-09T19:18:46.342 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.8.log 2023-06-09T19:18:46.342 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.11.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.f.log 2023-06-09T19:18:46.344 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.8.log: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.f.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-06-09T19:18:46.348 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.c.log 2023-06-09T19:18:46.354 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.i.log 2023-06-09T19:18:46.355 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.c.log 2023-06-09T19:18:46.364 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.y.log 2023-06-09T19:18:46.375 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log 2023-06-09T19:18:46.394 INFO:teuthology.orchestra.run.smithi172.stderr: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-06-09T19:18:46.396 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.l.log 2023-06-09T19:18:46.427 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.l.log: 93.7% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-volume.log.gz 2023-06-09T19:18:46.465 INFO:teuthology.orchestra.run.smithi189.stderr: 94.6% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.z.log.gz 2023-06-09T19:18:46.521 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.y.log: 94.6% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.y.log.gz 2023-06-09T19:18:46.546 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.k.log: file size changed while zipping 2023-06-09T19:18:46.547 INFO:teuthology.orchestra.run.smithi188.stderr: 94.4% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.k.log.gz 2023-06-09T19:18:46.575 INFO:teuthology.orchestra.run.smithi189.stderr: 94.4% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.l.log.gz 2023-06-09T19:18:46.595 INFO:teuthology.orchestra.run.smithi172.stderr: 94.7% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.g.log.gz 2023-06-09T19:18:46.596 INFO:teuthology.orchestra.run.smithi172.stderr: 94.7% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.j.log.gz 2023-06-09T19:18:46.597 INFO:teuthology.orchestra.run.smithi172.stderr: 94.7% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.a.log.gz 2023-06-09T19:18:46.647 INFO:teuthology.orchestra.run.smithi172.stderr: 94.7% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.d.log.gz 2023-06-09T19:18:47.581 INFO:teuthology.orchestra.run.smithi189.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.c.log: file size changed while zipping 2023-06-09T19:18:47.581 INFO:teuthology.orchestra.run.smithi189.stderr: 94.5% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.c.log.gz 2023-06-09T19:18:47.696 INFO:teuthology.orchestra.run.smithi189.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.i.log: file size changed while zipping 2023-06-09T19:18:47.697 INFO:teuthology.orchestra.run.smithi189.stderr: 94.7% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.i.log.gz 2023-06-09T19:18:48.261 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.h.log: file size changed while zipping 2023-06-09T19:18:48.261 INFO:teuthology.orchestra.run.smithi188.stderr: 95.1% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.h.log.gz 2023-06-09T19:18:48.289 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.e.log: file size changed while zipping 2023-06-09T19:18:48.289 INFO:teuthology.orchestra.run.smithi188.stderr: 95.0% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.e.log.gz 2023-06-09T19:18:48.291 INFO:teuthology.orchestra.run.smithi189.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.f.log: file size changed while zipping 2023-06-09T19:18:48.292 INFO:teuthology.orchestra.run.smithi189.stderr: 95.2% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.f.log.gz 2023-06-09T19:18:50.911 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.b.log: file size changed while zipping 2023-06-09T19:18:50.911 INFO:teuthology.orchestra.run.smithi188.stderr: 93.4% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mds.b.log.gz 2023-06-09T19:18:51.553 INFO:teuthology.orchestra.run.smithi189.stderr: 93.5% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.11.log.gz 2023-06-09T19:18:52.364 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.x.log: file size changed while zipping 2023-06-09T19:18:52.364 INFO:teuthology.orchestra.run.smithi172.stderr: 93.2% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mgr.x.log.gz 2023-06-09T19:18:53.206 INFO:teuthology.orchestra.run.smithi189.stderr: 93.6% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.2.log.gz 2023-06-09T19:18:54.285 INFO:teuthology.orchestra.run.smithi189.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2023-06-09T19:18:54.285 INFO:teuthology.orchestra.run.smithi189.stderr: 91.9% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.c.log.gz 2023-06-09T19:18:55.251 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2023-06-09T19:18:55.251 INFO:teuthology.orchestra.run.smithi188.stderr: 92.1% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.b.log.gz 2023-06-09T19:18:55.641 INFO:teuthology.orchestra.run.smithi189.stderr: 93.6% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.5.log.gz 2023-06-09T19:18:56.630 INFO:teuthology.orchestra.run.smithi188.stderr: 93.4% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.4.log.gz 2023-06-09T19:18:57.114 INFO:teuthology.orchestra.run.smithi172.stderr: 93.6% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.9.log.gz 2023-06-09T19:19:08.824 INFO:teuthology.orchestra.run.smithi189.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2023-06-09T19:19:08.824 INFO:teuthology.orchestra.run.smithi189.stderr: 93.0% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.8.log.gz 2023-06-09T19:19:11.314 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-06-09T19:19:11.314 INFO:teuthology.orchestra.run.smithi188.stderr: 93.0% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.1.log.gz 2023-06-09T19:19:13.447 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2023-06-09T19:19:13.448 INFO:teuthology.orchestra.run.smithi172.stderr: 89.8% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-mon.a.log.gz 2023-06-09T19:19:14.259 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-06-09T19:19:14.259 INFO:teuthology.orchestra.run.smithi172.stderr: 93.2% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.0.log.gz 2023-06-09T19:19:20.469 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-06-09T19:19:20.469 INFO:teuthology.orchestra.run.smithi172.stderr: 93.2% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.3.log.gz 2023-06-09T19:19:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2023-06-09T19:19:21.493 INFO:teuthology.orchestra.run.smithi172.stderr: 92.9% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.6.log.gz 2023-06-09T19:19:25.205 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2023-06-09T19:19:25.206 INFO:teuthology.orchestra.run.smithi188.stderr: 93.0% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.10.log.gz 2023-06-09T19:19:25.672 INFO:teuthology.orchestra.run.smithi188.stderr:gzip: /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-06-09T19:19:25.672 INFO:teuthology.orchestra.run.smithi188.stderr: 92.8% -- replaced with /var/log/ceph/e2eec210-0697-11ee-9b1e-001a4aab830c/ceph-osd.7.log.gz 2023-06-09T19:20:02.832 INFO:teuthology.kill:No teuthology processes running 2023-06-09T19:20:03.625 INFO:teuthology.kill:Nuking machines: ['smithi172', 'smithi188', 'smithi189'] 2023-06-09T19:20:04.250 INFO:teuthology.kill:2023-06-09 19:20:04,250.250 INFO:teuthology.nuke:targets: 2023-06-09T19:20:04.252 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/dispatcher/supervisor.py", line 320, in run_with_watchdog kill.kill_job( File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/kill.py", line 101, in kill_job nuke_targets(targets, owner) File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/kill.py", line 276, in nuke_targets sys.stdout.flush() OSError: [Errno 5] Input/output error 2023-06-09T19:22:04.506 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15