2021-07-27T22:22:25.562 INFO:root:teuthology version: 1.1.0-73aa7e3b 2021-07-27T22:22:25.721 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi012.front.sepia.ceph.com' reimaging 2021-07-27T22:22:25.722 INFO:teuthology.lock.ops:Updating [ubuntu@smithi012.front.sepia.ceph.com]: reset os type and version on server 2021-07-27T22:22:25.722 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2021-07-27T22:22:25.737 INFO:teuthology.lock.ops:Node 'ubuntu@smithi012.front.sepia.ceph.com' reimaging is complete 2021-07-27T22:22:25.738 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging 2021-07-27T22:22:25.738 INFO:teuthology.lock.ops:Updating [ubuntu@smithi136.front.sepia.ceph.com]: reset os type and version on server 2021-07-27T22:22:25.738 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2021-07-27T22:22:25.753 INFO:teuthology.lock.ops:Node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging is complete 2021-07-27T22:22:25.754 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi192.front.sepia.ceph.com' reimaging 2021-07-27T22:22:25.754 INFO:teuthology.lock.ops:Updating [ubuntu@smithi192.front.sepia.ceph.com]: reset os type and version on server 2021-07-27T22:22:25.754 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2021-07-27T22:22:25.769 INFO:teuthology.lock.ops:Node 'ubuntu@smithi192.front.sepia.ceph.com' reimaging is complete 2021-07-27T22:22:25.770 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging 2021-07-27T22:22:25.770 INFO:teuthology.lock.ops:Updating [ubuntu@smithi195.front.sepia.ceph.com]: reset os type and version on server 2021-07-27T22:22:25.771 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2021-07-27T22:22:25.787 INFO:teuthology.lock.ops:Node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging is complete 2021-07-27T22:22:25.942 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 8.stream 2021-07-27T22:22:25.958 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.stream 2021-07-27T22:22:25.974 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream 2021-07-27T22:22:26.002 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.stream 2021-07-27T22:22:26.373 INFO:teuthology.orchestra.console:Power off smithi012 2021-07-27T22:22:26.398 INFO:teuthology.orchestra.console:Power off smithi192 2021-07-27T22:22:26.425 INFO:teuthology.orchestra.console:Power off smithi195 2021-07-27T22:22:26.473 INFO:teuthology.orchestra.console:Power off smithi136 2021-07-27T22:22:34.765 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2021-07-27T22:22:34.790 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2021-07-27T22:22:34.866 INFO:teuthology.orchestra.console:Power on smithi012 2021-07-27T22:22:34.896 INFO:teuthology.orchestra.console:Power on smithi192 2021-07-27T22:22:38.917 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2021-07-27T22:22:38.958 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2021-07-27T22:22:39.019 INFO:teuthology.orchestra.console:Power on smithi195 2021-07-27T22:22:39.060 INFO:teuthology.orchestra.console:Power on smithi136 2021-07-27T22:22:43.240 INFO:teuthology.orchestra.console:Power on for smithi012 completed 2021-07-27T22:22:43.266 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2021-07-27T22:22:43.342 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2021-07-27T22:22:43.367 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2021-07-27T22:22:47.393 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2021-07-27T22:22:47.429 INFO:teuthology.orchestra.console:Power on for smithi136 completed 2021-07-27T22:22:47.495 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2021-07-27T22:22:47.530 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2021-07-27T22:26:54.087 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-27T22:27:14.057 INFO:teuthology.provision.fog.smithi136:Node is ready 2021-07-27T22:27:14.079 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2021-07-27T22:27:14.137 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2021-07-27T22:27:14.499 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2021-07-27T22:27:19.433 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-27T22:27:19.713 INFO:teuthology.provision.fog.smithi195:Node is ready 2021-07-27T22:27:19.769 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2021-07-27T22:27:19.826 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2021-07-27T22:27:20.164 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2021-07-27T22:27:24.387 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-27T22:27:24.650 INFO:teuthology.provision.fog.smithi192:Node is ready 2021-07-27T22:27:24.708 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2021-07-27T22:27:24.765 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2021-07-27T22:27:25.115 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2021-07-27T22:27:36.957 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-27T22:27:52.024 INFO:teuthology.provision.fog.smithi012:Node is ready 2021-07-27T22:27:52.090 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2021-07-27T22:27:52.149 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2021-07-27T22:27:52.509 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2021-07-27T22:27:52.676 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2021-07-27T22:27:52.677 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-27T22:27:52.693 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2021-07-27T22:27:52.694 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-27T22:27:52.711 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2021-07-27T22:27:52.712 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-27T22:27:52.726 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2021-07-27T22:27:52.727 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-27T22:27:52.743 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2021-07-27T22:27:52.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-27T22:27:52.937 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2021-07-27T22:27:52.994 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2021-07-27T22:27:52.994 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2021-07-27T22:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2021-07-27T22:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2021-07-27T22:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2021-07-27T22:27:52.995 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2021-07-27T22:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2021-07-27T22:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2021-07-27T22:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-27T22:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2021-07-27T22:27:52.996 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-27T22:27:52.997 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-27T22:27:52.997 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-07-27T22:27:52.998 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2021-07-27T22:27:53.013 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2021-07-27T22:27:53.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-27T22:27:53.206 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2021-07-27T22:27:53.263 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2021-07-27T22:27:53.263 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8" 2021-07-27T22:27:53.263 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2021-07-27T22:27:53.264 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2021-07-27T22:27:53.264 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8" 2021-07-27T22:27:53.264 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2021-07-27T22:27:53.264 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8" 2021-07-27T22:27:53.264 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2021-07-27T22:27:53.265 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-27T22:27:53.265 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2021-07-27T22:27:53.265 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-27T22:27:53.265 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-27T22:27:53.266 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-07-27T22:27:53.266 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2021-07-27T22:27:53.282 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2021-07-27T22:27:53.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-27T22:27:53.524 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2021-07-27T22:27:53.581 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2021-07-27T22:27:53.581 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2021-07-27T22:27:53.581 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2021-07-27T22:27:53.581 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2021-07-27T22:27:53.582 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2021-07-27T22:27:53.582 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2021-07-27T22:27:53.582 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2021-07-27T22:27:53.582 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2021-07-27T22:27:53.583 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-27T22:27:53.583 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2021-07-27T22:27:53.583 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-27T22:27:53.583 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-27T22:27:53.583 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-07-27T22:27:53.584 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2021-07-27T22:27:53.606 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2021-07-27T22:27:53.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-27T22:27:53.875 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2021-07-27T22:27:53.943 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2021-07-27T22:27:53.943 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2021-07-27T22:27:53.943 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2021-07-27T22:27:53.943 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2021-07-27T22:27:53.944 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2021-07-27T22:27:53.944 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2021-07-27T22:27:53.945 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2021-07-27T22:27:53.945 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2021-07-27T22:27:53.945 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-07-27T22:27:53.945 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2021-07-27T22:27:53.946 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-27T22:27:53.946 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-27T22:27:53.946 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-07-27T22:27:53.947 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2021-07-27T22:27:54.053 INFO:teuthology.dispatcher.supervisor:Running job 6296442 2021-07-27T22:27:54.053 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296442 --name benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296442/orig.config.yaml 2021-07-27T22:27:54.058 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-07-27_13:23:42-rados-wip_gbenhano_ncb_fix2-distro-basic-smithi/6296442 2021-07-27T22:27:54.059 INFO:teuthology.dispatcher.supervisor:Job PID: 19585 2021-07-27T22:27:54.059 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-07-28T10:28:42.459 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-07-28T10:28:42.714 INFO:teuthology.kill:Killing Pids: {19585} 2021-07-28T10:28:44.035 INFO:teuthology.kill:Nuking machines: ['smithi012', 'smithi136', 'smithi192', 'smithi195'] 2021-07-28T10:28:45.050 INFO:teuthology.kill:2021-07-28 10:28:45,049.049 INFO:teuthology.nuke:targets: 2021-07-28T10:28:45.051 INFO:teuthology.kill: smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE+wGcA+RjJbo+vmjnNjTz9wL9rlG2erpDyEPv1B0i2qvWu6Npr4jrhIFcuyOpXgxjkijwQp4yeu/ar1lbR7uqOMo7Tn/7DvBy/B7u0UIF5LPMJl5aXmDpUy2mtFuNOL0kUlMYdnPR301J3qT4k+b5VqJ96WKwuFcdrpQUw/qXsdJf3N3eWF1TRs+wnXMlJKjtO6zc5er9uj88hD6bovHgfhsuG1UfbO89uwtAlSUsjQAuzToi/bivPrdt3kE7/u1mPUS5qhZ531BIW/17r1Wv1Zj0W3jPKTUm8SNdW2Yes7+jAG3LKAgQahl0Kt6dOCKPxmxcHnk4cb84g6MBwl1JSJK7UV7ynaTNpjP84FPlm8pE7Ct1d2od21P/aOUdIfLYRjYADLgiicmAw1UuFFLPjuz3JsiyZGRLS7+ijK4xv6lXxMsGb6kpi1SiC+knmADsQrEfonX5yCLRjygYoy6cK7re/oGWJ1V6P67J0HMKQN24M0nD+dHx6GSmDhNzRuM= 2021-07-28T10:28:45.052 INFO:teuthology.kill: smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4sHtmJsrIp2RakM0+UYkfCQISGF4is/8L/mlKgclAN61OOFUXrnvimWDi5NRVNXwgnUVStjKXqPtcaiTIjZZsGCBp6zqgY6kph2l3WnIPYuZfuQ4ShWf+QhCSNSw1rleo1lhpYvWAhDGGXbt2BxremX8H8QYGXhYRE1pqBfvszFR1+vu9O6G+LcAJbQaR5MX3ak+tflDR+jTBN3/141GZHnDRoLeWuz5Ud2Sn12s4Plds/SMp43J7KyM2JlNg6AHM/xLgkj8qGdL7AvFUBiZUBrc15eM71T77k2L+05T/pWZRLVh19LK6rfVCb4JVOXE0qOJS5XnCPRfC7i/U0R3s5axoPSG0uwNOchWWvMAE3eLnQ3KbFhVih1TYLT7Cv65FCOyhhCLuE/0EjismB3xtVKxEVk6GD7+n4yF8wByk4OdhHjhuomz55Ejh1M4NzOtH2zrbWyxWAb+kwqAbSDRUbWSVUgXcaJiLtk6nUxZrMHkYwyI13VmTDjphbJMgbi0= 2021-07-28T10:28:45.053 INFO:teuthology.kill: smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxInAGreHc739agihcsHjAuSN0zxVC2Psbu1XzYyh7TLalKAAWoiexU0p2UeTyLFq1aIRJp1gNAuV0QcTtx5KrdyAyQywZZY/AX7HangHp4T85NTJtcHcJTBOIgL+5Kh9CJw0ancy73Aflb2ac6vntDqRiLkjp1ITPZzhK1C+eLBKRiufxxctTAsgtOoHUlNyFGh7FhKmHHDqT1MrnJpDU7WDkfir7a32TC5rVZDafCnKR8XA1d7JmiYzmH69av4PKGGsiuqSR/096fenWkckahYYDxwdJnmlpPt2RO8QAtTCvRGOGNnjNrXkupB1yyUm6J79am60SDeAkzuXTBLftmh5qND+UkwX3ZGRvQuO/G6eTEJGj0kG6y/qS6iPHplkQSJO5MLe/OrVI1snwL9GOFiR6Gqh6n0nf3d5vwmF1MY19psmlYaS1rczfES+CMZHNWGcNn6aPf+quJB/WV4sWdL7GStdg4rpmPmNp8Q9tw9bNcd0mXRl52UVK50qrD5s= 2021-07-28T10:28:45.053 INFO:teuthology.kill: smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvc8K5MZkJEoRf6D6dQGePLlQOp1QYWJgM6nmlYA2VxxltVBd5+pewPsMQb7SkVpl3QaV4SKJiDbDot8J8mZh/ENL8ikerxrutJ8w2WqYwCh8k68iIbIQaIm0+lmYNzNP3tpzl74qgO+uS5bdArLtqFmcj9370WHA8X1zXTGvMIabol3fAjZs15Vc9MvyLrXeAsJLbIaFCilNRujpO9f5D17VWTCCa7br3/xK1Vj2H2dHyLTYBSGvuosJCSemJhrFyd8IFVJKdE4wdJTQ9v2rf+SZeipAI5q0MVcW5uiSAanrEAgKnZ2CzhSnIsj1VAeGAcYlw5EHRJTFALmGz+nSZp0pjNnaMhFBCe40RQ6Mg1vCq1CJzTCQst1T4yiesC6/UbY4SQBDElujTip8BlFthW1kWKd54+2hggWAxaY1AZZLJ2NTlEQqfAbfd3f60KBd8MUT+ZDxOaf4bnexVt3eBg6XB2GheEbFfTKcJHm8Zt1TWXvYBrbV6Vw0Uf5FK/gU= 2021-07-28T10:28:45.054 INFO:teuthology.kill:2021-07-28 10:28:45,050.050 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T10:28:45.054 INFO:teuthology.kill:2021-07-28 10:28:45,052.052 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T10:28:45.055 INFO:teuthology.kill:2021-07-28 10:28:45,053.053 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T10:28:45.055 INFO:teuthology.kill:2021-07-28 10:28:45,054.054 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T10:28:45.126 INFO:teuthology.kill:2021-07-28 10:28:45,125.125 INFO:teuthology.orchestra.console:Power off smithi136 2021-07-28T10:28:45.145 INFO:teuthology.kill:2021-07-28 10:28:45,144.144 INFO:teuthology.orchestra.console:Power off smithi012 2021-07-28T10:28:45.162 INFO:teuthology.kill:2021-07-28 10:28:45,162.162 INFO:teuthology.orchestra.console:Power off smithi192 2021-07-28T10:28:45.173 INFO:teuthology.kill:2021-07-28 10:28:45,172.172 INFO:teuthology.orchestra.console:Power off smithi195 2021-07-28T10:28:53.533 INFO:teuthology.kill:2021-07-28 10:28:53,533.533 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2021-07-28T10:28:53.553 INFO:teuthology.kill:2021-07-28 10:28:53,552.552 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2021-07-28T10:28:57.652 INFO:teuthology.kill:2021-07-28 10:28:57,651.651 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2021-07-28T10:28:57.658 INFO:teuthology.kill:2021-07-28 10:28:57,658.658 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2021-07-28T10:28:57.906 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2021-07-28T10:28:57.907 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2021-07-28T10:28:57.907 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2021-07-28T10:28:57.907 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2021-07-28T10:28:57.908 INFO:teuthology.misc:Compressing logs... 2021-07-28T10:28:57.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-28T10:29:32.491 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-07-28T10:29:32.562 INFO:teuthology.kill:No teuthology processes running 2021-07-28T10:29:33.668 INFO:teuthology.kill:Nuking machines: ['smithi012', 'smithi136', 'smithi192', 'smithi195'] 2021-07-28T10:29:34.640 INFO:teuthology.kill:2021-07-28 10:29:34,640.640 INFO:teuthology.nuke:targets: 2021-07-28T10:29:34.642 INFO:teuthology.kill: smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDE+wGcA+RjJbo+vmjnNjTz9wL9rlG2erpDyEPv1B0i2qvWu6Npr4jrhIFcuyOpXgxjkijwQp4yeu/ar1lbR7uqOMo7Tn/7DvBy/B7u0UIF5LPMJl5aXmDpUy2mtFuNOL0kUlMYdnPR301J3qT4k+b5VqJ96WKwuFcdrpQUw/qXsdJf3N3eWF1TRs+wnXMlJKjtO6zc5er9uj88hD6bovHgfhsuG1UfbO89uwtAlSUsjQAuzToi/bivPrdt3kE7/u1mPUS5qhZ531BIW/17r1Wv1Zj0W3jPKTUm8SNdW2Yes7+jAG3LKAgQahl0Kt6dOCKPxmxcHnk4cb84g6MBwl1JSJK7UV7ynaTNpjP84FPlm8pE7Ct1d2od21P/aOUdIfLYRjYADLgiicmAw1UuFFLPjuz3JsiyZGRLS7+ijK4xv6lXxMsGb6kpi1SiC+knmADsQrEfonX5yCLRjygYoy6cK7re/oGWJ1V6P67J0HMKQN24M0nD+dHx6GSmDhNzRuM= 2021-07-28T10:29:34.642 INFO:teuthology.kill: smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4sHtmJsrIp2RakM0+UYkfCQISGF4is/8L/mlKgclAN61OOFUXrnvimWDi5NRVNXwgnUVStjKXqPtcaiTIjZZsGCBp6zqgY6kph2l3WnIPYuZfuQ4ShWf+QhCSNSw1rleo1lhpYvWAhDGGXbt2BxremX8H8QYGXhYRE1pqBfvszFR1+vu9O6G+LcAJbQaR5MX3ak+tflDR+jTBN3/141GZHnDRoLeWuz5Ud2Sn12s4Plds/SMp43J7KyM2JlNg6AHM/xLgkj8qGdL7AvFUBiZUBrc15eM71T77k2L+05T/pWZRLVh19LK6rfVCb4JVOXE0qOJS5XnCPRfC7i/U0R3s5axoPSG0uwNOchWWvMAE3eLnQ3KbFhVih1TYLT7Cv65FCOyhhCLuE/0EjismB3xtVKxEVk6GD7+n4yF8wByk4OdhHjhuomz55Ejh1M4NzOtH2zrbWyxWAb+kwqAbSDRUbWSVUgXcaJiLtk6nUxZrMHkYwyI13VmTDjphbJMgbi0= 2021-07-28T10:29:34.643 INFO:teuthology.kill: smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxInAGreHc739agihcsHjAuSN0zxVC2Psbu1XzYyh7TLalKAAWoiexU0p2UeTyLFq1aIRJp1gNAuV0QcTtx5KrdyAyQywZZY/AX7HangHp4T85NTJtcHcJTBOIgL+5Kh9CJw0ancy73Aflb2ac6vntDqRiLkjp1ITPZzhK1C+eLBKRiufxxctTAsgtOoHUlNyFGh7FhKmHHDqT1MrnJpDU7WDkfir7a32TC5rVZDafCnKR8XA1d7JmiYzmH69av4PKGGsiuqSR/096fenWkckahYYDxwdJnmlpPt2RO8QAtTCvRGOGNnjNrXkupB1yyUm6J79am60SDeAkzuXTBLftmh5qND+UkwX3ZGRvQuO/G6eTEJGj0kG6y/qS6iPHplkQSJO5MLe/OrVI1snwL9GOFiR6Gqh6n0nf3d5vwmF1MY19psmlYaS1rczfES+CMZHNWGcNn6aPf+quJB/WV4sWdL7GStdg4rpmPmNp8Q9tw9bNcd0mXRl52UVK50qrD5s= 2021-07-28T10:29:34.643 INFO:teuthology.kill: smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvc8K5MZkJEoRf6D6dQGePLlQOp1QYWJgM6nmlYA2VxxltVBd5+pewPsMQb7SkVpl3QaV4SKJiDbDot8J8mZh/ENL8ikerxrutJ8w2WqYwCh8k68iIbIQaIm0+lmYNzNP3tpzl74qgO+uS5bdArLtqFmcj9370WHA8X1zXTGvMIabol3fAjZs15Vc9MvyLrXeAsJLbIaFCilNRujpO9f5D17VWTCCa7br3/xK1Vj2H2dHyLTYBSGvuosJCSemJhrFyd8IFVJKdE4wdJTQ9v2rf+SZeipAI5q0MVcW5uiSAanrEAgKnZ2CzhSnIsj1VAeGAcYlw5EHRJTFALmGz+nSZp0pjNnaMhFBCe40RQ6Mg1vCq1CJzTCQst1T4yiesC6/UbY4SQBDElujTip8BlFthW1kWKd54+2hggWAxaY1AZZLJ2NTlEQqfAbfd3f60KBd8MUT+ZDxOaf4bnexVt3eBg6XB2GheEbFfTKcJHm8Zt1TWXvYBrbV6Vw0Uf5FK/gU= 2021-07-28T10:29:34.666 INFO:teuthology.kill:2021-07-28 10:29:34,665.665 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T10:29:34.670 INFO:teuthology.kill:2021-07-28 10:29:34,669.669 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T10:29:34.671 INFO:teuthology.kill:2021-07-28 10:29:34,671.671 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T10:29:34.672 INFO:teuthology.kill:2021-07-28 10:29:34,672.672 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-28T10:29:34.726 INFO:teuthology.kill:2021-07-28 10:29:34,726.726 INFO:teuthology.orchestra.console:Power off smithi192 2021-07-28T10:29:34.741 INFO:teuthology.kill:2021-07-28 10:29:34,741.741 INFO:teuthology.orchestra.console:Power off smithi012 2021-07-28T10:29:34.754 INFO:teuthology.kill:2021-07-28 10:29:34,754.754 INFO:teuthology.orchestra.console:Power off smithi195 2021-07-28T10:29:34.767 INFO:teuthology.kill:2021-07-28 10:29:34,766.766 INFO:teuthology.orchestra.console:Power off smithi136 2021-07-28T10:29:34.906 INFO:teuthology.kill:2021-07-28 10:29:34,906.906 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2021-07-28T10:29:34.916 INFO:teuthology.kill:2021-07-28 10:29:34,916.916 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2021-07-28T10:29:34.919 INFO:teuthology.kill:2021-07-28 10:29:34,919.919 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2021-07-28T10:29:34.930 INFO:teuthology.kill:2021-07-28 10:29:34,929.929 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2021-07-28T10:29:35.048 INFO:teuthology.kill:2021-07-28 10:29:35,047.047 INFO:teuthology.lock.ops:unlocked smithi192.front.sepia.ceph.com 2021-07-28T10:29:35.057 INFO:teuthology.kill:2021-07-28 10:29:35,057.057 INFO:teuthology.lock.ops:unlocked smithi012.front.sepia.ceph.com 2021-07-28T10:29:35.061 INFO:teuthology.kill:2021-07-28 10:29:35,061.061 INFO:teuthology.lock.ops:unlocked smithi195.front.sepia.ceph.com 2021-07-28T10:29:35.070 INFO:teuthology.kill:2021-07-28 10:29:35,070.070 INFO:teuthology.lock.ops:unlocked smithi136.front.sepia.ceph.com 2021-07-28T10:31:35.340 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-07-28T10:31:35.463 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-07-28T10:31:35.464 INFO:teuthology.nuke:Checking targets against current locks 2021-07-28T10:31:35.543 INFO:teuthology.nuke:Not nuking smithi195.front.sepia.ceph.com because description doesn't match 2021-07-28T10:31:35.543 INFO:teuthology.nuke:Not nuking smithi012.front.sepia.ceph.com because description doesn't match 2021-07-28T10:31:35.543 INFO:teuthology.nuke:Not nuking smithi192.front.sepia.ceph.com because description doesn't match 2021-07-28T10:31:35.544 INFO:teuthology.nuke:Not nuking smithi136.front.sepia.ceph.com because description doesn't match