2021-07-16T08:06:09.352 INFO:root:teuthology version: 1.1.0-43790980 2021-07-16T08:06:09.597 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi094.front.sepia.ceph.com' reimaging 2021-07-16T08:06:09.598 INFO:teuthology.lock.ops:Updating [ubuntu@smithi094.front.sepia.ceph.com]: reset os type and version on server 2021-07-16T08:06:09.598 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2021-07-16T08:06:09.614 INFO:teuthology.lock.ops:Node 'ubuntu@smithi094.front.sepia.ceph.com' reimaging is complete 2021-07-16T08:06:09.615 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi099.front.sepia.ceph.com' reimaging 2021-07-16T08:06:09.615 INFO:teuthology.lock.ops:Updating [ubuntu@smithi099.front.sepia.ceph.com]: reset os type and version on server 2021-07-16T08:06:09.615 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2021-07-16T08:06:09.632 INFO:teuthology.lock.ops:Node 'ubuntu@smithi099.front.sepia.ceph.com' reimaging is complete 2021-07-16T08:06:09.633 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging 2021-07-16T08:06:09.633 INFO:teuthology.lock.ops:Updating [ubuntu@smithi115.front.sepia.ceph.com]: reset os type and version on server 2021-07-16T08:06:09.633 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2021-07-16T08:06:09.656 INFO:teuthology.lock.ops:Node 'ubuntu@smithi115.front.sepia.ceph.com' reimaging is complete 2021-07-16T08:06:09.837 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of rhel 8.4 2021-07-16T08:06:09.878 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.4 2021-07-16T08:06:09.915 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of rhel 8.4 2021-07-16T08:06:10.324 INFO:teuthology.orchestra.console:Power off smithi094 2021-07-16T08:06:10.396 INFO:teuthology.orchestra.console:Power off smithi099 2021-07-16T08:06:10.456 INFO:teuthology.orchestra.console:Power off smithi115 2021-07-16T08:06:18.841 INFO:teuthology.orchestra.console:Power off for smithi094 completed 2021-07-16T08:06:18.864 INFO:teuthology.orchestra.console:Power off for smithi099 completed 2021-07-16T08:06:18.905 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2021-07-16T08:06:18.943 INFO:teuthology.orchestra.console:Power on smithi094 2021-07-16T08:06:18.966 INFO:teuthology.orchestra.console:Power on smithi099 2021-07-16T08:06:19.011 INFO:teuthology.orchestra.console:Power on smithi115 2021-07-16T08:06:27.357 INFO:teuthology.orchestra.console:Power on for smithi094 completed 2021-07-16T08:06:27.379 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2021-07-16T08:06:27.436 INFO:teuthology.orchestra.console:Power on for smithi099 completed 2021-07-16T08:06:27.458 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2021-07-16T08:06:27.481 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2021-07-16T08:06:27.537 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2021-07-16T08:08:59.283 ERROR:teuthology.orchestra.connection:Error authenticating with smithi094.front.sepia.ceph.com: Authentication failed. 2021-07-16T08:10:36.492 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-16T08:10:40.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-16T08:10:55.248 INFO:teuthology.provision.fog.smithi094:Node is ready 2021-07-16T08:10:55.266 INFO:teuthology.orchestra.run.smithi094.stdout:smithi204 2021-07-16T08:10:55.322 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2021-07-16T08:10:55.679 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2021-07-16T08:10:56.436 INFO:teuthology.provision.fog.smithi099:Node is ready 2021-07-16T08:10:56.468 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2021-07-16T08:10:56.525 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2021-07-16T08:10:56.873 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2021-07-16T08:11:14.905 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-07-16T08:11:15.143 INFO:teuthology.provision.fog.smithi115:Node is ready 2021-07-16T08:11:15.159 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2021-07-16T08:11:15.215 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2021-07-16T08:11:15.534 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2021-07-16T08:11:15.710 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2021-07-16T08:11:15.711 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-16T08:11:15.731 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2021-07-16T08:11:15.731 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-16T08:11:15.745 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2021-07-16T08:11:15.745 INFO:teuthology.lock.ops:New key found. Updating... 2021-07-16T08:11:15.761 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2021-07-16T08:11:15.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-16T08:11:15.960 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2021-07-16T08:11:16.016 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux" 2021-07-16T08:11:16.016 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.4 (Ootpa)" 2021-07-16T08:11:16.016 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel" 2021-07-16T08:11:16.017 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora" 2021-07-16T08:11:16.017 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.4" 2021-07-16T08:11:16.017 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2021-07-16T08:11:16.017 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-07-16T08:11:16.018 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2021-07-16T08:11:16.018 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-07-16T08:11:16.018 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/" 2021-07-16T08:11:16.022 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-07-16T08:11:16.023 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-16T08:11:16.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2021-07-16T08:11:16.023 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-16T08:11:16.023 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-07-16T08:11:16.023 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-07-16T08:11:16.024 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-07-16T08:11:16.025 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2021-07-16T08:11:16.067 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2021-07-16T08:11:16.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-16T08:11:16.302 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2021-07-16T08:11:16.357 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2021-07-16T08:11:16.358 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.4 (Ootpa)" 2021-07-16T08:11:16.358 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2021-07-16T08:11:16.358 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2021-07-16T08:11:16.359 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.4" 2021-07-16T08:11:16.359 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2021-07-16T08:11:16.359 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-07-16T08:11:16.359 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2021-07-16T08:11:16.359 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-07-16T08:11:16.360 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2021-07-16T08:11:16.360 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-07-16T08:11:16.360 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-16T08:11:16.360 INFO:teuthology.orchestra.run.smithi099.stdout: 2021-07-16T08:11:16.360 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-16T08:11:16.361 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-07-16T08:11:16.361 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-07-16T08:11:16.361 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-07-16T08:11:16.362 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2021-07-16T08:11:16.379 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2021-07-16T08:11:16.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-16T08:11:16.613 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2021-07-16T08:11:16.667 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux" 2021-07-16T08:11:16.668 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.4 (Ootpa)" 2021-07-16T08:11:16.668 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel" 2021-07-16T08:11:16.668 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora" 2021-07-16T08:11:16.669 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.4" 2021-07-16T08:11:16.669 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2021-07-16T08:11:16.669 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-07-16T08:11:16.669 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2021-07-16T08:11:16.669 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-07-16T08:11:16.670 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/" 2021-07-16T08:11:16.670 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-07-16T08:11:16.670 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-07-16T08:11:16.670 INFO:teuthology.orchestra.run.smithi115.stdout: 2021-07-16T08:11:16.671 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-07-16T08:11:16.671 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-07-16T08:11:16.671 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-07-16T08:11:16.671 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-07-16T08:11:16.672 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2021-07-16T08:11:16.747 INFO:teuthology.dispatcher.supervisor:Running job 6275824 2021-07-16T08:11:16.748 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_43790980b608e9a71ad69685c3f7e95578734f1b/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2021-07-16_05:50:11-fs-wip-pdonnell-testing-20210716.022804-distro-basic-smithi/6275824 --name pdonnell-2021-07-16_05:50:11-fs-wip-pdonnell-testing-20210716.022804-distro-basic-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} -- /home/teuthworker/archive/pdonnell-2021-07-16_05:50:11-fs-wip-pdonnell-testing-20210716.022804-distro-basic-smithi/6275824/orig.config.yaml 2021-07-16T08:11:16.754 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2021-07-16_05:50:11-fs-wip-pdonnell-testing-20210716.022804-distro-basic-smithi/6275824 2021-07-16T08:11:16.754 INFO:teuthology.dispatcher.supervisor:Job PID: 22756 2021-07-16T08:11:16.755 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-07-16T20:11:34.872 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-07-16T20:11:35.105 INFO:teuthology.kill:Killing Pids: {22756} 2021-07-16T20:11:37.511 INFO:teuthology.kill:Nuking machines: ['smithi094', 'smithi099', 'smithi115'] 2021-07-16T20:11:38.525 INFO:teuthology.kill:2021-07-16 20:11:38,525.525 INFO:teuthology.nuke:targets: 2021-07-16T20:11:38.526 INFO:teuthology.kill: smithi094.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs+MZu/ju+HhxIq+SkzMtrlHH67Rec5otxyBmzbb3/ZG+7tHAfjQkNOHphNN0vBUpWVDNnUvYFXhLVq6ouuc9MQB/EH4VCgnXHnu85AYjNDhPEwOq4kbYihBlE5/46hRIPc71eqjDhsEJ1cYuijSbKFNubkSH0BHLkSd8X/PPYqJ2dEci3vljyuUnBqutZ0Ub5Pz8eJlesuXX0D4fFNua/Jq4MLk4+eFpqWVe2PYCGU5GYSsVQawVzlwCOZLqCe1bdeihJVR8fPYYnOeeXwBwiuGGOs4Y/Se+/wROkStl3L3mi/nPERd3ja6j4BiIs1Cr2IiZT5N4JyFEi/3Mlqtgl/CQLbvSUTzRddkuPhRTTNa7tDX/AMXcmCqqC5FnvVZlsrSHN9RjD+1yxwun0U0euwRWq1z5etnf4CI7VJhG8rCQ0LeWCoPW63K/JZbaYUKqrSVAmvdu5mBEBuhjjcXC2+6B/hKY6j+sTJAUlrcyNs+G2Ut2kGjbXGSvSrlbxV9c= 2021-07-16T20:11:38.526 INFO:teuthology.kill: smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXOEiHGEf3e/zF5TReg/O76RvC3lOiDMu7KxMMz6Sb6dhURsXVTEiiw3m3U6bHlNC/uH4ZfXEPvwpp7uK8gEAULJxx98D+MQUik/m49uaIHrKtHL5YkbuXeBtRFkgi9SKEZsdx0LI++nLVXx3qBMOQmQLXhEX7M8k33kUBc4Cy+qbkn108rTG2LYgjLCNEHlCRdMI7yLeq/h9shQ47qv3W4g34eIkmWM+cO1j74zSFB+eVpAVnQsFnh6dae0QLEf0EYh5V8U5AKpDKFQfCWw3Bw9eiLSsM/SFfqgtQWLR+lN4eCTz5xWlcUjYZxWSaV/Kf4s2CSWcSs6g3YzYbgfSnj/TmTlBMRhKu+7ELgVsH40i0ndc1DYaAWdDQbcDx1F+5sVVROGfAPi2P/7Xe7gi+7xbp/sfPrrsK1kPR8PlANkL9xBs9vV1jCHnNcHSqdWlsSYBlUrDPfm63q7pMbPJ+tIYGYBOLudj3REGweFn8g3kbKhYLZ5U6+GsVe4ZR66s= 2021-07-16T20:11:38.527 INFO:teuthology.kill: smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRQ9JFW4vRI6FpFgTGxDU9uTHC+gO28tKIX9Cpd3gjOFaPXQU6QdUCOFEnujTsSeOMEW8wy9kIL8eOJmKVv67wn6TBejn/D1JCXpYpPF/5LyzFBSmvjEP9eSDeC76mv5fQz0E29is1pz/DFshsG0REPpT5rjMy3tmTWzfHh95MHxTrdzymmXPomDFtWbJ+PwhfIaBwASc6nYJGWzAfdTYVFYlMuLqiqgUEdjM8SmjmiQd6aB1OM07ibEbL7mM1mU9e985MmPyOgMkHHsJ6dMOGpauj7bSaJGzLxGBxyM15f4VtbtwLansqQy0XxJFFDLHu5wMWogbe+abzZjHCFzlwrGZZ55Yl27VC5Ps3dU3VH1opPwhsREPfneRoI8bt51WapqeepLwmTz8qmMDzSWRPb5TLFj1Ow+ytjZqttspIopXnRRt58HWhOHTyXaS34vvYZobqdZ91iZ00kSp+hzSsHiGrW06+yVNfqjF/Q5U+i+aHIu3Afw+WFkZZYO879Sc= 2021-07-16T20:11:38.527 INFO:teuthology.kill:2021-07-16 20:11:38,525.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-16T20:11:38.528 INFO:teuthology.kill:2021-07-16 20:11:38,528.528 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-16T20:11:38.529 INFO:teuthology.kill:2021-07-16 20:11:38,529.529 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-16T20:11:38.597 INFO:teuthology.kill:2021-07-16 20:11:38,597.597 INFO:teuthology.orchestra.console:Power off smithi094 2021-07-16T20:11:38.620 INFO:teuthology.kill:2021-07-16 20:11:38,619.619 INFO:teuthology.orchestra.console:Power off smithi115 2021-07-16T20:11:38.636 INFO:teuthology.kill:2021-07-16 20:11:38,635.635 INFO:teuthology.orchestra.console:Power off smithi099 2021-07-16T20:11:47.019 INFO:teuthology.kill:2021-07-16 20:11:47,018.018 INFO:teuthology.orchestra.console:Power off for smithi094 completed 2021-07-16T20:11:51.113 INFO:teuthology.kill:2021-07-16 20:11:51,113.113 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2021-07-16T20:11:51.132 INFO:teuthology.kill:2021-07-16 20:11:51,132.132 INFO:teuthology.orchestra.console:Power off for smithi099 completed 2021-07-16T20:11:51.399 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2021-07-16T20:11:51.400 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2021-07-16T20:11:51.401 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2021-07-16T20:11:51.401 INFO:teuthology.misc:Compressing logs... 2021-07-16T20:11:51.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-16T20:12:51.412 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_43790980b608e9a71ad69685c3f7e95578734f1b/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_43790980b608e9a71ad69685c3f7e95578734f1b/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_43790980b608e9a71ad69685c3f7e95578734f1b/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_43790980b608e9a71ad69685c3f7e95578734f1b/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_43790980b608e9a71ad69685c3f7e95578734f1b/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_43790980b608e9a71ad69685c3f7e95578734f1b/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_43790980b608e9a71ad69685c3f7e95578734f1b/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-07-16T20:12:51.485 INFO:teuthology.kill:No teuthology processes running 2021-07-16T20:12:52.699 INFO:teuthology.kill:Nuking machines: ['smithi094', 'smithi099', 'smithi115'] 2021-07-16T20:12:53.664 INFO:teuthology.kill:2021-07-16 20:12:53,664.664 INFO:teuthology.nuke:targets: 2021-07-16T20:12:53.666 INFO:teuthology.kill: smithi094.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs+MZu/ju+HhxIq+SkzMtrlHH67Rec5otxyBmzbb3/ZG+7tHAfjQkNOHphNN0vBUpWVDNnUvYFXhLVq6ouuc9MQB/EH4VCgnXHnu85AYjNDhPEwOq4kbYihBlE5/46hRIPc71eqjDhsEJ1cYuijSbKFNubkSH0BHLkSd8X/PPYqJ2dEci3vljyuUnBqutZ0Ub5Pz8eJlesuXX0D4fFNua/Jq4MLk4+eFpqWVe2PYCGU5GYSsVQawVzlwCOZLqCe1bdeihJVR8fPYYnOeeXwBwiuGGOs4Y/Se+/wROkStl3L3mi/nPERd3ja6j4BiIs1Cr2IiZT5N4JyFEi/3Mlqtgl/CQLbvSUTzRddkuPhRTTNa7tDX/AMXcmCqqC5FnvVZlsrSHN9RjD+1yxwun0U0euwRWq1z5etnf4CI7VJhG8rCQ0LeWCoPW63K/JZbaYUKqrSVAmvdu5mBEBuhjjcXC2+6B/hKY6j+sTJAUlrcyNs+G2Ut2kGjbXGSvSrlbxV9c= 2021-07-16T20:12:53.666 INFO:teuthology.kill: smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXOEiHGEf3e/zF5TReg/O76RvC3lOiDMu7KxMMz6Sb6dhURsXVTEiiw3m3U6bHlNC/uH4ZfXEPvwpp7uK8gEAULJxx98D+MQUik/m49uaIHrKtHL5YkbuXeBtRFkgi9SKEZsdx0LI++nLVXx3qBMOQmQLXhEX7M8k33kUBc4Cy+qbkn108rTG2LYgjLCNEHlCRdMI7yLeq/h9shQ47qv3W4g34eIkmWM+cO1j74zSFB+eVpAVnQsFnh6dae0QLEf0EYh5V8U5AKpDKFQfCWw3Bw9eiLSsM/SFfqgtQWLR+lN4eCTz5xWlcUjYZxWSaV/Kf4s2CSWcSs6g3YzYbgfSnj/TmTlBMRhKu+7ELgVsH40i0ndc1DYaAWdDQbcDx1F+5sVVROGfAPi2P/7Xe7gi+7xbp/sfPrrsK1kPR8PlANkL9xBs9vV1jCHnNcHSqdWlsSYBlUrDPfm63q7pMbPJ+tIYGYBOLudj3REGweFn8g3kbKhYLZ5U6+GsVe4ZR66s= 2021-07-16T20:12:53.667 INFO:teuthology.kill: smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRQ9JFW4vRI6FpFgTGxDU9uTHC+gO28tKIX9Cpd3gjOFaPXQU6QdUCOFEnujTsSeOMEW8wy9kIL8eOJmKVv67wn6TBejn/D1JCXpYpPF/5LyzFBSmvjEP9eSDeC76mv5fQz0E29is1pz/DFshsG0REPpT5rjMy3tmTWzfHh95MHxTrdzymmXPomDFtWbJ+PwhfIaBwASc6nYJGWzAfdTYVFYlMuLqiqgUEdjM8SmjmiQd6aB1OM07ibEbL7mM1mU9e985MmPyOgMkHHsJ6dMOGpauj7bSaJGzLxGBxyM15f4VtbtwLansqQy0XxJFFDLHu5wMWogbe+abzZjHCFzlwrGZZ55Yl27VC5Ps3dU3VH1opPwhsREPfneRoI8bt51WapqeepLwmTz8qmMDzSWRPb5TLFj1Ow+ytjZqttspIopXnRRt58HWhOHTyXaS34vvYZobqdZ91iZ00kSp+hzSsHiGrW06+yVNfqjF/Q5U+i+aHIu3Afw+WFkZZYO879Sc= 2021-07-16T20:12:53.687 INFO:teuthology.kill:2021-07-16 20:12:53,686.686 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-16T20:12:53.691 INFO:teuthology.kill:2021-07-16 20:12:53,691.691 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-16T20:12:53.694 INFO:teuthology.kill:2021-07-16 20:12:53,694.694 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-16T20:12:53.739 INFO:teuthology.kill:2021-07-16 20:12:53,738.738 INFO:teuthology.orchestra.console:Power off smithi099 2021-07-16T20:12:53.754 INFO:teuthology.kill:2021-07-16 20:12:53,754.754 INFO:teuthology.orchestra.console:Power off smithi115 2021-07-16T20:12:53.794 INFO:teuthology.kill:2021-07-16 20:12:53,794.794 INFO:teuthology.orchestra.console:Power off smithi094 2021-07-16T20:12:53.904 INFO:teuthology.kill:2021-07-16 20:12:53,903.903 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2021-07-16T20:12:53.905 INFO:teuthology.kill:2021-07-16 20:12:53,904.904 INFO:teuthology.orchestra.console:Power off for smithi099 completed 2021-07-16T20:12:53.941 INFO:teuthology.kill:2021-07-16 20:12:53,940.940 INFO:teuthology.orchestra.console:Power off for smithi094 completed 2021-07-16T20:12:54.053 INFO:teuthology.kill:2021-07-16 20:12:54,052.052 INFO:teuthology.lock.ops:unlocked smithi115.front.sepia.ceph.com 2021-07-16T20:12:54.058 INFO:teuthology.kill:2021-07-16 20:12:54,058.058 INFO:teuthology.lock.ops:unlocked smithi099.front.sepia.ceph.com 2021-07-16T20:12:54.090 INFO:teuthology.kill:2021-07-16 20:12:54,090.090 INFO:teuthology.lock.ops:unlocked smithi094.front.sepia.ceph.com 2021-07-16T20:14:54.286 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-07-16T20:14:54.420 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-07-16T20:14:54.421 INFO:teuthology.nuke:Checking targets against current locks 2021-07-16T20:14:54.499 INFO:teuthology.nuke:Not nuking smithi094.front.sepia.ceph.com because description doesn't match 2021-07-16T20:14:54.500 INFO:teuthology.nuke:Not nuking smithi099.front.sepia.ceph.com because description doesn't match 2021-07-16T20:14:54.501 INFO:teuthology.nuke:Not nuking smithi115.front.sepia.ceph.com because description doesn't match