2021-07-27T21:40:46.794 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-07-27T21:40:46.949 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging 2021-07-27T21:40:46.950 INFO:teuthology.lock.ops:Updating [ubuntu@smithi008.front.sepia.ceph.com]: reset os type and version on server 2021-07-27T21:40:46.950 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2021-07-27T21:40:46.964 INFO:teuthology.lock.ops:Node 'ubuntu@smithi008.front.sepia.ceph.com' reimaging is complete 2021-07-27T21:40:46.965 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging 2021-07-27T21:40:46.965 INFO:teuthology.lock.ops:Updating [ubuntu@smithi039.front.sepia.ceph.com]: reset os type and version on server 2021-07-27T21:40:46.965 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2021-07-27T21:40:46.981 INFO:teuthology.lock.ops:Node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging is complete 2021-07-27T21:40:46.981 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging 2021-07-27T21:40:46.982 INFO:teuthology.lock.ops:Updating [ubuntu@smithi065.front.sepia.ceph.com]: reset os type and version on server 2021-07-27T21:40:46.982 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server 2021-07-27T21:40:46.997 INFO:teuthology.lock.ops:Node 'ubuntu@smithi065.front.sepia.ceph.com' reimaging is complete 2021-07-27T21:40:46.997 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging 2021-07-27T21:40:46.998 INFO:teuthology.lock.ops:Updating [ubuntu@smithi087.front.sepia.ceph.com]: reset os type and version on server 2021-07-27T21:40:46.998 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2021-07-27T21:40:47.012 INFO:teuthology.lock.ops:Node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging is complete 2021-07-27T21:40:47.177 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.4 2021-07-27T21:40:47.206 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of rhel 8.4 2021-07-27T21:40:47.231 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of rhel 8.4 2021-07-27T21:40:47.252 INFO:teuthology.provision.fog.smithi065:Scheduling deploy of rhel 8.4 2021-07-27T21:40:47.561 INFO:teuthology.orchestra.console:Power off smithi039 2021-07-27T21:40:47.598 INFO:teuthology.orchestra.console:Power off smithi008 2021-07-27T21:40:47.612 INFO:teuthology.orchestra.console:Power off smithi087 2021-07-27T21:40:47.652 INFO:teuthology.orchestra.console:Power off smithi065 2021-07-27T21:40:55.957 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2021-07-27T21:40:55.980 INFO:teuthology.orchestra.console:Power off for smithi087 completed 2021-07-27T21:40:56.059 INFO:teuthology.orchestra.console:Power on smithi039 2021-07-27T21:40:56.089 INFO:teuthology.orchestra.console:Power on smithi087 2021-07-27T21:41:00.081 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2021-07-27T21:41:00.128 INFO:teuthology.orchestra.console:Power off for smithi065 completed 2021-07-27T21:41:00.183 INFO:teuthology.orchestra.console:Power on smithi008 2021-07-27T21:41:00.230 INFO:teuthology.orchestra.console:Power on smithi065 2021-07-27T21:41:04.438 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2021-07-27T21:41:04.530 INFO:teuthology.orchestra.console:Power on for smithi087 completed 2021-07-27T21:41:04.539 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2021-07-27T21:41:04.631 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2021-07-27T21:41:08.590 INFO:teuthology.orchestra.console:Power on for smithi065 completed 2021-07-27T21:41:08.666 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2021-07-27T21:41:08.692 INFO:teuthology.provision.fog.smithi065:Waiting for deploy to finish 2021-07-27T21:41:08.768 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2021-07-27T21:43:36.021 ERROR:teuthology.orchestra.connection:Error authenticating with smithi087.front.sepia.ceph.com: Authentication failed. 2021-07-27T21:45:40.710 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-27T21:45:40.946 INFO:teuthology.provision.fog.smithi008:Node is ready 2021-07-27T21:45:40.964 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2021-07-27T21:45:41.023 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2021-07-27T21:45:41.356 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2021-07-27T21:45:49.238 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-27T21:45:49.456 INFO:teuthology.provision.fog.smithi087:Node is ready 2021-07-27T21:45:49.471 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com 2021-07-27T21:45:49.526 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2021-07-27T21:45:49.616 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-27T21:45:49.828 INFO:teuthology.provision.fog.smithi065:Node is ready 2021-07-27T21:45:49.845 INFO:teuthology.orchestra.run.smithi065.stdout:smithi065.front.sepia.ceph.com 2021-07-27T21:45:49.846 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2021-07-27T21:45:49.901 INFO:teuthology.orchestra.run.smithi065.stdout:172.21.15.65 smithi065.front.sepia.ceph.com smithi065 2021-07-27T21:45:50.229 INFO:teuthology.provision.fog.smithi065:Deploy complete! 2021-07-27T21:46:24.777 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-27T21:46:24.992 INFO:teuthology.provision.fog.smithi039:Node is ready 2021-07-27T21:46:25.008 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2021-07-27T21:46:25.064 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2021-07-27T21:46:25.411 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2021-07-27T21:46:25.618 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2021-07-27T21:46:25.619 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-27T21:46:25.635 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2021-07-27T21:46:25.636 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-27T21:46:25.675 INFO:teuthology.lock.ops:Checking smithi065.front.sepia.ceph.com 2021-07-27T21:46:25.676 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-27T21:46:25.690 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2021-07-27T21:46:25.691 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-27T21:46:25.704 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2021-07-27T21:46:25.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-27T21:46:25.950 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2021-07-27T21:46:26.006 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2021-07-27T21:46:26.006 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.4 (Ootpa)" 2021-07-27T21:46:26.006 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2021-07-27T21:46:26.007 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2021-07-27T21:46:26.007 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.4" 2021-07-27T21:46:26.007 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2021-07-27T21:46:26.008 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-07-27T21:46:26.008 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2021-07-27T21:46:26.008 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-07-27T21:46:26.008 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2021-07-27T21:46:26.009 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-07-27T21:46:26.009 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-27T21:46:26.009 INFO:teuthology.orchestra.run.smithi008.stdout: 2021-07-27T21:46:26.009 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-27T21:46:26.010 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-07-27T21:46:26.010 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-07-27T21:46:26.010 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-07-27T21:46:26.011 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2021-07-27T21:46:26.026 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2021-07-27T21:46:26.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-27T21:46:26.216 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2021-07-27T21:46:26.274 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux" 2021-07-27T21:46:26.275 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.4 (Ootpa)" 2021-07-27T21:46:26.275 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel" 2021-07-27T21:46:26.275 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora" 2021-07-27T21:46:26.275 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.4" 2021-07-27T21:46:26.276 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2021-07-27T21:46:26.276 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-07-27T21:46:26.277 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2021-07-27T21:46:26.277 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-07-27T21:46:26.277 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/" 2021-07-27T21:46:26.277 INFO:teuthology.orchestra.run.smithi039.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-07-27T21:46:26.277 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-27T21:46:26.278 INFO:teuthology.orchestra.run.smithi039.stdout: 2021-07-27T21:46:26.278 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-27T21:46:26.278 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-07-27T21:46:26.278 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-07-27T21:46:26.279 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-07-27T21:46:26.279 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2021-07-27T21:46:26.296 INFO:teuthology.lock.ops:Updating [smithi065.front.sepia.ceph.com]: set os type and version on server 2021-07-27T21:46:26.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-27T21:46:26.494 INFO:teuthology.orchestra.run.smithi065.stdout:x86_64 2021-07-27T21:46:26.551 INFO:teuthology.orchestra.run.smithi065.stdout:NAME="Red Hat Enterprise Linux" 2021-07-27T21:46:26.551 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION="8.4 (Ootpa)" 2021-07-27T21:46:26.552 INFO:teuthology.orchestra.run.smithi065.stdout:ID="rhel" 2021-07-27T21:46:26.552 INFO:teuthology.orchestra.run.smithi065.stdout:ID_LIKE="fedora" 2021-07-27T21:46:26.552 INFO:teuthology.orchestra.run.smithi065.stdout:VERSION_ID="8.4" 2021-07-27T21:46:26.552 INFO:teuthology.orchestra.run.smithi065.stdout:PLATFORM_ID="platform:el8" 2021-07-27T21:46:26.553 INFO:teuthology.orchestra.run.smithi065.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-07-27T21:46:26.553 INFO:teuthology.orchestra.run.smithi065.stdout:ANSI_COLOR="0;31" 2021-07-27T21:46:26.553 INFO:teuthology.orchestra.run.smithi065.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-07-27T21:46:26.553 INFO:teuthology.orchestra.run.smithi065.stdout:HOME_URL="https://www.redhat.com/" 2021-07-27T21:46:26.554 INFO:teuthology.orchestra.run.smithi065.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-07-27T21:46:26.554 INFO:teuthology.orchestra.run.smithi065.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-27T21:46:26.554 INFO:teuthology.orchestra.run.smithi065.stdout: 2021-07-27T21:46:26.554 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-27T21:46:26.554 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-07-27T21:46:26.555 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-07-27T21:46:26.555 INFO:teuthology.orchestra.run.smithi065.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-07-27T21:46:26.555 INFO:teuthology.lock.ops:Updating smithi065.front.sepia.ceph.com on lock server 2021-07-27T21:46:26.571 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2021-07-27T21:46:26.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-27T21:46:26.804 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2021-07-27T21:46:26.858 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux" 2021-07-27T21:46:26.859 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.4 (Ootpa)" 2021-07-27T21:46:26.859 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel" 2021-07-27T21:46:26.859 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora" 2021-07-27T21:46:26.859 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.4" 2021-07-27T21:46:26.860 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2021-07-27T21:46:26.860 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-07-27T21:46:26.860 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2021-07-27T21:46:26.860 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-07-27T21:46:26.861 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/" 2021-07-27T21:46:26.861 INFO:teuthology.orchestra.run.smithi087.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-07-27T21:46:26.861 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-27T21:46:26.861 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-27T21:46:26.862 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-27T21:46:26.862 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-07-27T21:46:26.862 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-07-27T21:46:26.862 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-07-27T21:46:26.863 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2021-07-27T21:46:26.948 INFO:teuthology.dispatcher.supervisor:Running job 6296372 2021-07-27T21:46:26.949 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296372 --name benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296372/orig.config.yaml 2021-07-27T21:46:26.953 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296372 2021-07-27T21:46:26.954 INFO:teuthology.dispatcher.supervisor:Job PID: 7428 2021-07-27T21:46:26.955 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-07-28T09:46:44.716 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-07-28T09:46:44.977 INFO:teuthology.kill:Killing Pids: {7428} 2021-07-28T09:46:46.062 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi039', 'smithi065', 'smithi087'] 2021-07-28T09:46:46.981 INFO:teuthology.kill:2021-07-28 09:46:46,980.980 INFO:teuthology.nuke:targets: 2021-07-28T09:46:46.982 INFO:teuthology.kill: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkWILs+sCI1dHtwosOfpVIZOHYKpi+VUCi41BRBPmG8OOy8AHpGKI4/IGLkNzX124X/kNVzQhAe8P5iBrfWKSUca4WE5V05sCXi0IlmZJFSHX5DX7U3551UnBSw73IkIENcA+f/ZwPMKgkGNK1l4jogbTdJLB1A4q0iTCNWgzwarvih2+hppqbhkkesydYfHnXff9ijp9zJs8K9PCD4XAxy9/xSFzaP8vGJsEvTPjYydaAE4FUyK9U0ml4JQaGsdRhInMG7Yk5vnTFlDa0OpdWFu2pxwlNEoIwz6L7BGqS/GlptP2HsbCPzPfVmUAW7LvYPVCJImaCiujyRHLZSdDBGgf5CivZw2Tiw1lrfyV992wfTQbSS7/MBgFIwa9xb3eDSXTRTUbA2hQxrbNI2X9Od8ahxrf1HzrNF0Q3rOkvAWN4yj+zMQRH1YJGsvQrtC0aBuQUppgaGcR37PEn5D3orhvrZ7fx+YTc8N89ZY36Lp4f97Nho3TYXWYneBg2Av8= 2021-07-28T09:46:46.982 INFO:teuthology.kill: smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCffNtx9U0pcNOwdeW8eMpaYaYBRy/Q0QVVCXMld+yvDCrwp39A3yTEy2GB2EUjSVgvvYVgkxxoaSBqPzBsAQKHwHcjabemEpJQawpeAUuiJXDhMbo87MvLVUx2KSCBfBMPPw0KqChReq+X17L+pELC3auhDL8xIqYX+WLyf57vw2UH3lNRe/nfvpXJ7PW1UUTClT+6Lylp6V+i/uRvHfpogsGbFnROnTlZMpH8vo2+1uH0AorgtuSDPIaBzSDu5v+wzOdVbaXzWUfiMVH1BCAYDCD67+hTPaADojBCTkNfknjfAIPmOdHfJZahzghZxoNMBsom11wBWtwPQzvU9//Tw6fGAC0StZfPfn4imHWLmWZYQInOGL0QwG2Jmu8A8v61uQhKow4ur/XJW8XpLA82za2S5QYKQ/lekdQ5hGm1DF1i4itSv1hwOHbG3lpi4s3u389qiTUyhlEgvc0bXzgR1vDuA+gzODAk7eWuYVndGmd/tMuOynOqQyfoZNTiV1M= 2021-07-28T09:46:46.982 INFO:teuthology.kill: smithi065.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs0r5jl9ci4eMlnBokALNOD6DWNRpEdAU2jQxLxiiGkF/ifVEdGvGswqGDM/pep5Vje0urwnnsS+3Bzn2BAFfW4Lli50JpNpm0z2xBZLjGBHGbbChB/HybGcjQMpuxjBucNskfUy6xg3fxL9jkeGY1Jq89xRpKGMARLCQo7qzIWPJhyMH0OSE0u7CIWFoYth2uMoqDMxE2q+iOPBGiFmL+WFbSd7gIQiru39kD/N4rO0qWdkNBOKeXRtU2zAZZSyZVxFdoSDIReRCyHcTgkW1smmGIF3DAXNwtsUm0N5Q8jLrX2e4jVrJp0UBmq08mHdK+Yi1mOoaSsFE4xLki+gP35hdgRqMwWuelpncEHvwdQuHfPIfyY4FJCr0zcHfFanX++hZF0eupf6Yi3+3qCRfjjz3fRNzf3aJt/T4OmLQtBtm6v0YH7NK44B97/NAJFhrNNwMQFWS/dF5m+IzQnqX54Giy+g2VfNgUsg4oEgg/kwHx8o+Rmjp+CtLLzFU4QdM= 2021-07-28T09:46:46.983 INFO:teuthology.kill: smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BoJZHQ5OmhjexwQzTOw5PdfTBB3KB4zqpAbKy+fnJwmWZsyxk5fTDk4EhIlec7dbZ5dJz/ee5mky+9/3mvLxp6uPKOl7nswC6bE0B4td1AQIafyUaXQE+09dzi11mwwkL2Ktf2ZGqBXIAD4DJz3xJvtqRWoD2a6IYPdl72dRfDv1625fQWZ1rpxy/FBMvPM6LREQ+/4asv0Gu/7ruq/wwvzpLVKtjfXUmiL4c5/LPh0FGFVoIdhemjlikkOvQ+u65r4TuyVYTIB3NXWSqPNFfh+IkotijiAKKK8vfnRCcE9scas71KC3KvARcrcgO+oeSDfmdqejXoynyB1X/MM4we8OOy1LoRBTNEkDaPMMzhHaL6PTbcqLCo9xG8aTYlQqApoxQQjwftAB13CqO/h1PzDYnKC7rC6DlX45RFL+5l0zm0s4s5C1u/kafsD7eSPSeQE/aU3yai6618LjRKeHmdYdNqNzptkuLyezs9dkww005l/dLY05ws16CfIQQT8= 2021-07-28T09:46:46.983 INFO:teuthology.kill:2021-07-28 09:46:46,981.981 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T09:46:46.983 INFO:teuthology.kill:2021-07-28 09:46:46,983.983 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T09:46:46.985 INFO:teuthology.kill:2021-07-28 09:46:46,984.984 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T09:46:46.986 INFO:teuthology.kill:2021-07-28 09:46:46,986.986 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T09:46:47.049 INFO:teuthology.kill:2021-07-28 09:46:47,048.048 INFO:teuthology.orchestra.console:Power off smithi039 2021-07-28T09:46:47.062 INFO:teuthology.kill:2021-07-28 09:46:47,061.061 INFO:teuthology.orchestra.console:Power off smithi008 2021-07-28T09:46:47.074 INFO:teuthology.kill:2021-07-28 09:46:47,073.073 INFO:teuthology.orchestra.console:Power off smithi087 2021-07-28T09:46:47.090 INFO:teuthology.kill:2021-07-28 09:46:47,089.089 INFO:teuthology.orchestra.console:Power off smithi065 2021-07-28T09:46:55.452 INFO:teuthology.kill:2021-07-28 09:46:55,452.452 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2021-07-28T09:46:55.457 INFO:teuthology.kill:2021-07-28 09:46:55,456.456 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2021-07-28T09:46:55.466 INFO:teuthology.kill:2021-07-28 09:46:55,466.466 INFO:teuthology.orchestra.console:Power off for smithi065 completed 2021-07-28T09:46:59.574 INFO:teuthology.kill:2021-07-28 09:46:59,573.573 INFO:teuthology.orchestra.console:Power off for smithi087 completed 2021-07-28T09:46:59.798 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2021-07-28T09:46:59.798 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2021-07-28T09:46:59.799 INFO:teuthology.task.internal:roles: ubuntu@smithi065.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2021-07-28T09:46:59.799 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2021-07-28T09:46:59.799 INFO:teuthology.misc:Compressing logs... 2021-07-28T09:46:59.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-28T09:47:34.475 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-07-28T09:47:34.544 INFO:teuthology.kill:No teuthology processes running 2021-07-28T09:47:35.628 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi039', 'smithi065', 'smithi087'] 2021-07-28T09:47:36.639 INFO:teuthology.kill:2021-07-28 09:47:36,639.639 INFO:teuthology.nuke:targets: 2021-07-28T09:47:36.640 INFO:teuthology.kill: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDkWILs+sCI1dHtwosOfpVIZOHYKpi+VUCi41BRBPmG8OOy8AHpGKI4/IGLkNzX124X/kNVzQhAe8P5iBrfWKSUca4WE5V05sCXi0IlmZJFSHX5DX7U3551UnBSw73IkIENcA+f/ZwPMKgkGNK1l4jogbTdJLB1A4q0iTCNWgzwarvih2+hppqbhkkesydYfHnXff9ijp9zJs8K9PCD4XAxy9/xSFzaP8vGJsEvTPjYydaAE4FUyK9U0ml4JQaGsdRhInMG7Yk5vnTFlDa0OpdWFu2pxwlNEoIwz6L7BGqS/GlptP2HsbCPzPfVmUAW7LvYPVCJImaCiujyRHLZSdDBGgf5CivZw2Tiw1lrfyV992wfTQbSS7/MBgFIwa9xb3eDSXTRTUbA2hQxrbNI2X9Od8ahxrf1HzrNF0Q3rOkvAWN4yj+zMQRH1YJGsvQrtC0aBuQUppgaGcR37PEn5D3orhvrZ7fx+YTc8N89ZY36Lp4f97Nho3TYXWYneBg2Av8= 2021-07-28T09:47:36.641 INFO:teuthology.kill: smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCffNtx9U0pcNOwdeW8eMpaYaYBRy/Q0QVVCXMld+yvDCrwp39A3yTEy2GB2EUjSVgvvYVgkxxoaSBqPzBsAQKHwHcjabemEpJQawpeAUuiJXDhMbo87MvLVUx2KSCBfBMPPw0KqChReq+X17L+pELC3auhDL8xIqYX+WLyf57vw2UH3lNRe/nfvpXJ7PW1UUTClT+6Lylp6V+i/uRvHfpogsGbFnROnTlZMpH8vo2+1uH0AorgtuSDPIaBzSDu5v+wzOdVbaXzWUfiMVH1BCAYDCD67+hTPaADojBCTkNfknjfAIPmOdHfJZahzghZxoNMBsom11wBWtwPQzvU9//Tw6fGAC0StZfPfn4imHWLmWZYQInOGL0QwG2Jmu8A8v61uQhKow4ur/XJW8XpLA82za2S5QYKQ/lekdQ5hGm1DF1i4itSv1hwOHbG3lpi4s3u389qiTUyhlEgvc0bXzgR1vDuA+gzODAk7eWuYVndGmd/tMuOynOqQyfoZNTiV1M= 2021-07-28T09:47:36.641 INFO:teuthology.kill: smithi065.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs0r5jl9ci4eMlnBokALNOD6DWNRpEdAU2jQxLxiiGkF/ifVEdGvGswqGDM/pep5Vje0urwnnsS+3Bzn2BAFfW4Lli50JpNpm0z2xBZLjGBHGbbChB/HybGcjQMpuxjBucNskfUy6xg3fxL9jkeGY1Jq89xRpKGMARLCQo7qzIWPJhyMH0OSE0u7CIWFoYth2uMoqDMxE2q+iOPBGiFmL+WFbSd7gIQiru39kD/N4rO0qWdkNBOKeXRtU2zAZZSyZVxFdoSDIReRCyHcTgkW1smmGIF3DAXNwtsUm0N5Q8jLrX2e4jVrJp0UBmq08mHdK+Yi1mOoaSsFE4xLki+gP35hdgRqMwWuelpncEHvwdQuHfPIfyY4FJCr0zcHfFanX++hZF0eupf6Yi3+3qCRfjjz3fRNzf3aJt/T4OmLQtBtm6v0YH7NK44B97/NAJFhrNNwMQFWS/dF5m+IzQnqX54Giy+g2VfNgUsg4oEgg/kwHx8o+Rmjp+CtLLzFU4QdM= 2021-07-28T09:47:36.641 INFO:teuthology.kill: smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BoJZHQ5OmhjexwQzTOw5PdfTBB3KB4zqpAbKy+fnJwmWZsyxk5fTDk4EhIlec7dbZ5dJz/ee5mky+9/3mvLxp6uPKOl7nswC6bE0B4td1AQIafyUaXQE+09dzi11mwwkL2Ktf2ZGqBXIAD4DJz3xJvtqRWoD2a6IYPdl72dRfDv1625fQWZ1rpxy/FBMvPM6LREQ+/4asv0Gu/7ruq/wwvzpLVKtjfXUmiL4c5/LPh0FGFVoIdhemjlikkOvQ+u65r4TuyVYTIB3NXWSqPNFfh+IkotijiAKKK8vfnRCcE9scas71KC3KvARcrcgO+oeSDfmdqejXoynyB1X/MM4we8OOy1LoRBTNEkDaPMMzhHaL6PTbcqLCo9xG8aTYlQqApoxQQjwftAB13CqO/h1PzDYnKC7rC6DlX45RFL+5l0zm0s4s5C1u/kafsD7eSPSeQE/aU3yai6618LjRKeHmdYdNqNzptkuLyezs9dkww005l/dLY05ws16CfIQQT8= 2021-07-28T09:47:36.664 INFO:teuthology.kill:2021-07-28 09:47:36,663.663 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T09:47:36.665 INFO:teuthology.kill:2021-07-28 09:47:36,665.665 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T09:47:36.669 INFO:teuthology.kill:2021-07-28 09:47:36,669.669 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T09:47:36.671 INFO:teuthology.kill:2021-07-28 09:47:36,671.671 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T09:47:36.723 INFO:teuthology.kill:2021-07-28 09:47:36,723.723 INFO:teuthology.orchestra.console:Power off smithi039 2021-07-28T09:47:36.741 INFO:teuthology.kill:2021-07-28 09:47:36,741.741 INFO:teuthology.orchestra.console:Power off smithi008 2021-07-28T09:47:36.757 INFO:teuthology.kill:2021-07-28 09:47:36,756.756 INFO:teuthology.orchestra.console:Power off smithi065 2021-07-28T09:47:36.769 INFO:teuthology.kill:2021-07-28 09:47:36,768.768 INFO:teuthology.orchestra.console:Power off smithi087 2021-07-28T09:47:36.905 INFO:teuthology.kill:2021-07-28 09:47:36,904.904 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2021-07-28T09:47:36.906 INFO:teuthology.kill:2021-07-28 09:47:36,906.906 INFO:teuthology.orchestra.console:Power off for smithi065 completed 2021-07-28T09:47:36.912 INFO:teuthology.kill:2021-07-28 09:47:36,911.911 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2021-07-28T09:47:36.918 INFO:teuthology.kill:2021-07-28 09:47:36,918.918 INFO:teuthology.orchestra.console:Power off for smithi087 completed 2021-07-28T09:47:37.057 INFO:teuthology.kill:2021-07-28 09:47:37,056.056 INFO:teuthology.lock.ops:unlocked smithi008.front.sepia.ceph.com 2021-07-28T09:47:37.065 INFO:teuthology.kill:2021-07-28 09:47:37,064.064 INFO:teuthology.lock.ops:unlocked smithi039.front.sepia.ceph.com 2021-07-28T09:47:37.068 INFO:teuthology.kill:2021-07-28 09:47:37,068.068 INFO:teuthology.lock.ops:unlocked smithi087.front.sepia.ceph.com 2021-07-28T09:47:37.070 INFO:teuthology.kill:2021-07-28 09:47:37,070.070 INFO:teuthology.lock.ops:unlocked smithi065.front.sepia.ceph.com 2021-07-28T09:49:37.270 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-07-28T09:49:37.422 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-07-28T09:49:37.423 INFO:teuthology.nuke:Checking targets against current locks 2021-07-28T09:49:37.498 INFO:teuthology.nuke:Not nuking smithi087.front.sepia.ceph.com because description doesn't match 2021-07-28T09:49:37.498 INFO:teuthology.nuke:Not nuking smithi039.front.sepia.ceph.com because description doesn't match 2021-07-28T09:49:37.499 INFO:teuthology.nuke:Not nuking smithi008.front.sepia.ceph.com because description doesn't match 2021-07-28T09:49:37.499 INFO:teuthology.nuke:Not nuking smithi065.front.sepia.ceph.com because description doesn't match