2021-08-14T12:25:57.232 INFO:root:teuthology version: 1.1.0-958c1edc 2021-08-14T12:25:57.365 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging 2021-08-14T12:25:57.366 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server 2021-08-14T12:25:57.367 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-08-14T12:25:57.384 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete 2021-08-14T12:25:57.384 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging 2021-08-14T12:25:57.384 INFO:teuthology.lock.ops:Updating [ubuntu@smithi153.front.sepia.ceph.com]: reset os type and version on server 2021-08-14T12:25:57.385 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2021-08-14T12:25:57.402 INFO:teuthology.lock.ops:Node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging is complete 2021-08-14T12:25:57.403 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi181.front.sepia.ceph.com' reimaging 2021-08-14T12:25:57.403 INFO:teuthology.lock.ops:Updating [ubuntu@smithi181.front.sepia.ceph.com]: reset os type and version on server 2021-08-14T12:25:57.403 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2021-08-14T12:25:57.421 INFO:teuthology.lock.ops:Node 'ubuntu@smithi181.front.sepia.ceph.com' reimaging is complete 2021-08-14T12:25:57.583 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.4 2021-08-14T12:25:57.616 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of rhel 8.4 2021-08-14T12:25:57.623 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of rhel 8.4 2021-08-14T12:25:58.007 INFO:teuthology.orchestra.console:Power off smithi134 2021-08-14T12:25:58.028 INFO:teuthology.orchestra.console:Power off smithi153 2021-08-14T12:25:58.072 INFO:teuthology.orchestra.console:Power off smithi181 2021-08-14T12:26:06.398 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-08-14T12:26:06.502 INFO:teuthology.orchestra.console:Power on smithi134 2021-08-14T12:26:10.519 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2021-08-14T12:26:10.546 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2021-08-14T12:26:10.621 INFO:teuthology.orchestra.console:Power on smithi153 2021-08-14T12:26:10.649 INFO:teuthology.orchestra.console:Power on smithi181 2021-08-14T12:26:14.997 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2021-08-14T12:26:15.099 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2021-08-14T12:26:18.999 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2021-08-14T12:26:19.008 INFO:teuthology.orchestra.console:Power on for smithi181 completed 2021-08-14T12:26:19.101 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2021-08-14T12:26:19.109 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2021-08-14T12:30:15.358 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-14T12:30:17.063 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-14T12:30:35.677 INFO:teuthology.provision.fog.smithi181:Node is ready 2021-08-14T12:30:35.700 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2021-08-14T12:30:35.761 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2021-08-14T12:30:36.120 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2021-08-14T12:30:37.081 INFO:teuthology.provision.fog.smithi134:Node is ready 2021-08-14T12:30:37.100 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2021-08-14T12:30:37.157 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2021-08-14T12:30:37.496 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2021-08-14T12:31:06.304 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-08-14T12:31:06.520 INFO:teuthology.provision.fog.smithi153:Node is ready 2021-08-14T12:31:06.536 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2021-08-14T12:31:06.591 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2021-08-14T12:31:06.910 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2021-08-14T12:31:07.077 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2021-08-14T12:31:07.078 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-14T12:31:07.099 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2021-08-14T12:31:07.100 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-14T12:31:07.119 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2021-08-14T12:31:07.119 INFO:teuthology.lock.ops:New key found. Updating... 2021-08-14T12:31:07.138 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2021-08-14T12:31:07.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-14T12:31:07.335 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2021-08-14T12:31:07.392 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2021-08-14T12:31:07.392 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.4 (Ootpa)" 2021-08-14T12:31:07.392 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2021-08-14T12:31:07.393 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2021-08-14T12:31:07.393 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.4" 2021-08-14T12:31:07.393 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2021-08-14T12:31:07.393 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-08-14T12:31:07.394 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2021-08-14T12:31:07.394 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-08-14T12:31:07.394 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2021-08-14T12:31:07.394 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-08-14T12:31:07.395 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-08-14T12:31:07.395 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-08-14T12:31:07.395 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-08-14T12:31:07.395 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-08-14T12:31:07.396 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-08-14T12:31:07.396 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-08-14T12:31:07.397 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-08-14T12:31:07.419 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2021-08-14T12:31:07.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-14T12:31:07.648 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2021-08-14T12:31:07.703 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2021-08-14T12:31:07.704 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.4 (Ootpa)" 2021-08-14T12:31:07.704 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2021-08-14T12:31:07.704 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2021-08-14T12:31:07.705 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.4" 2021-08-14T12:31:07.705 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2021-08-14T12:31:07.705 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-08-14T12:31:07.706 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2021-08-14T12:31:07.706 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-08-14T12:31:07.706 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2021-08-14T12:31:07.707 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-08-14T12:31:07.707 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-08-14T12:31:07.707 INFO:teuthology.orchestra.run.smithi153.stdout: 2021-08-14T12:31:07.708 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-08-14T12:31:07.708 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-08-14T12:31:07.708 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-08-14T12:31:07.708 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-08-14T12:31:07.709 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2021-08-14T12:31:07.728 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2021-08-14T12:31:07.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-14T12:31:07.961 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2021-08-14T12:31:08.016 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2021-08-14T12:31:08.017 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.4 (Ootpa)" 2021-08-14T12:31:08.017 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2021-08-14T12:31:08.017 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2021-08-14T12:31:08.018 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.4" 2021-08-14T12:31:08.018 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2021-08-14T12:31:08.018 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2021-08-14T12:31:08.018 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2021-08-14T12:31:08.019 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2021-08-14T12:31:08.019 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2021-08-14T12:31:08.019 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2021-08-14T12:31:08.019 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-08-14T12:31:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: 2021-08-14T12:31:08.020 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-08-14T12:31:08.020 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2021-08-14T12:31:08.020 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-08-14T12:31:08.020 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2021-08-14T12:31:08.021 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2021-08-14T12:31:08.127 INFO:teuthology.dispatcher.supervisor:Running job 6327918 2021-08-14T12:31:08.128 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2021-08-09_13:23:53-fs-wip-khiremat-test-kernel-exclude-failures-distro-basic-smithi/6327918 --name khiremat-2021-08-09_13:23:53-fs-wip-khiremat-test-kernel-exclude-failures-distro-basic-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} -- /home/teuthworker/archive/khiremat-2021-08-09_13:23:53-fs-wip-khiremat-test-kernel-exclude-failures-distro-basic-smithi/6327918/orig.config.yaml 2021-08-14T12:31:08.132 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2021-08-09_13:23:53-fs-wip-khiremat-test-kernel-exclude-failures-distro-basic-smithi/6327918 2021-08-14T12:31:08.132 INFO:teuthology.dispatcher.supervisor:Job PID: 26661 2021-08-14T12:31:08.133 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-08-15T00:31:29.088 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-08-15T00:31:30.984 INFO:teuthology.kill:Killing Pids: {26661} 2021-08-15T00:31:32.096 INFO:teuthology.kill:Nuking machines: ['smithi134', 'smithi153', 'smithi181'] 2021-08-15T00:31:33.133 INFO:teuthology.kill:2021-08-15 00:31:33,132.132 INFO:teuthology.nuke:targets: 2021-08-15T00:31:33.135 INFO:teuthology.kill: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBnZeWb7SvHx224ZAssHnqPATDUTnc6WvOlSjz1MeRnUzcXAIr3f3oM4p2Z7OO0VZOrWcQnpa/fYUQ8R5j8FvC2fOJRDkQWXVNJsQkVJdzvHfwzMTQvQAHzIj0vMdI4Fu6u8VyrZrIPcfnGZKFEgQtgBgHc14YCIiwFmugwXo7KEoRVMC32aSOk+q+x7uImyJzYc+ovz52UVWXJgsAPR2EnzAl5UQV6//oToUfcNDDMzbUl3BpFLPpfObUgmCaoNiywdhwcUQU0MXWweQrNbEjK/P1wJge4si7/rbc7Zg3Xe+HaIaPWQOTOCm5hZFH8P16rExSkZk7aIEKiSHoA71C/QAwdiLqpcBhpmRXE+5IGiP+TSdmvSALPftKgGOXres1vto/S1pvVMNl2ZypgCiwsLnIYMeXjoPmz9Kl26JoV/XJyE/laBjOaGbt/jIC5jhuKv9GvwbwDEom2MPYoLE3UJCObhzUagEpBdmfj352wrjygW0DCA4jUbBUzwNGQ08= 2021-08-15T00:31:33.136 INFO:teuthology.kill: smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIUV9K+J6WctNbLgZbvoCgPv9AXNTotDM78sty+E/CJ2FvCOZa6sJv3opC9SLV3gdyf9tr4pUnXRNsUCs0nGZd0rBy3rxzoNFQL1LxHlwpMzGX3amF7HDx5WU5iKCB0Uqvtl9+C4lXyPRNH2NXlRBiUhfXGBy159HM4foPqc7goK8k9LXlNKki6g0dfBGkm3FyPePBIGWgg8VxM3VN1iIDR2wM44VwIB1yW+FdXLSQdq3NPiAA3sUB3Ttiny/HQp2rrKBecZ1kknUq2Akxi/dDihax3c4dTq2qZOsxjvoEZOrCDItmVHzGzHo2rBoJfNAIpf+Nf1zVHXhJJbcdHbRNjvs29qqKf77aZ5gOX4D2zN98RJsiJsZ8ezabbcymZsg3c7LAXrYiHBjPzCk7TsVOMHICbC88r4FLulGUzRal4au2xu0tABmu2MoittS9VbqXVZ3NpLKUpsqskMQCj3EYlUWtkej3lAf+35Nwrhx3qGHbcWEFu3rIFZ1s1Fre+x0= 2021-08-15T00:31:33.136 INFO:teuthology.kill: smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD2gvRU/Vs0n9u/oNrqDy2NctpfjSJX88JIF37c4xEs/eaU+5GyzEkUuFa/eEk4+PtcQ6QaIgNQtQvt4Az+qtguaWu38s2x7jgZYAZymhRwMAjg+LRbKipd1Xo4cK/+8FpUSif+sn6smVHjSYUojdbT82OFIr+Y6zx3e3Z+m06stGOvYj4cVrxAyIgtNp+9RayAhICw1zjLzrowyPQ1he3e7q5wVPftjr5ZcqrO1nAInEEQNjddd9znYa3GWWRVAH+m1qu5MSIv0DhyU13My9UbWA5IprjRL8f3KBSaVxxx8iX/DE2mDSaFc7Wskl8AFQOlBd1z/CpCrYw+9EJx4NkNXg89qZlLYrw7Rpiz4CSBS951tWE1xcYIrPKZ77MR8qzJvdGzaJ+YsK2Ncq8Q37j0YwhTClxKTZSQlEFlm0Kz5seJKF1ButatI6E3zVs4rz/zgvF656NeYtAwAgEd4kk+mWbkfg1f1sjM+XZHky86wnu+yNRl1l2xF3AwJUO/E/s= 2021-08-15T00:31:33.136 INFO:teuthology.kill:2021-08-15 00:31:33,133.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-15T00:31:33.137 INFO:teuthology.kill:2021-08-15 00:31:33,135.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-15T00:31:33.137 INFO:teuthology.kill:2021-08-15 00:31:33,137.137 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-15T00:31:33.209 INFO:teuthology.kill:2021-08-15 00:31:33,208.208 INFO:teuthology.orchestra.console:Power off smithi181 2021-08-15T00:31:33.226 INFO:teuthology.kill:2021-08-15 00:31:33,226.226 INFO:teuthology.orchestra.console:Power off smithi134 2021-08-15T00:31:33.237 INFO:teuthology.kill:2021-08-15 00:31:33,237.237 INFO:teuthology.orchestra.console:Power off smithi153 2021-08-15T00:31:41.596 INFO:teuthology.kill:2021-08-15 00:31:41,596.596 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2021-08-15T00:31:41.607 INFO:teuthology.kill:2021-08-15 00:31:41,607.607 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2021-08-15T00:31:45.711 INFO:teuthology.kill:2021-08-15 00:31:45,711.711 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-08-15T00:31:45.944 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2021-08-15T00:31:45.945 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2021-08-15T00:31:45.945 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2021-08-15T00:31:45.945 INFO:teuthology.misc:Compressing logs... 2021-08-15T00:31:45.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-15T00:32:46.007 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-08-15T00:32:46.074 INFO:teuthology.kill:No teuthology processes running 2021-08-15T00:32:47.155 INFO:teuthology.kill:Nuking machines: ['smithi134', 'smithi153', 'smithi181'] 2021-08-15T00:32:48.115 INFO:teuthology.kill:2021-08-15 00:32:48,115.115 INFO:teuthology.nuke:targets: 2021-08-15T00:32:48.116 INFO:teuthology.kill: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBnZeWb7SvHx224ZAssHnqPATDUTnc6WvOlSjz1MeRnUzcXAIr3f3oM4p2Z7OO0VZOrWcQnpa/fYUQ8R5j8FvC2fOJRDkQWXVNJsQkVJdzvHfwzMTQvQAHzIj0vMdI4Fu6u8VyrZrIPcfnGZKFEgQtgBgHc14YCIiwFmugwXo7KEoRVMC32aSOk+q+x7uImyJzYc+ovz52UVWXJgsAPR2EnzAl5UQV6//oToUfcNDDMzbUl3BpFLPpfObUgmCaoNiywdhwcUQU0MXWweQrNbEjK/P1wJge4si7/rbc7Zg3Xe+HaIaPWQOTOCm5hZFH8P16rExSkZk7aIEKiSHoA71C/QAwdiLqpcBhpmRXE+5IGiP+TSdmvSALPftKgGOXres1vto/S1pvVMNl2ZypgCiwsLnIYMeXjoPmz9Kl26JoV/XJyE/laBjOaGbt/jIC5jhuKv9GvwbwDEom2MPYoLE3UJCObhzUagEpBdmfj352wrjygW0DCA4jUbBUzwNGQ08= 2021-08-15T00:32:48.117 INFO:teuthology.kill: smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIUV9K+J6WctNbLgZbvoCgPv9AXNTotDM78sty+E/CJ2FvCOZa6sJv3opC9SLV3gdyf9tr4pUnXRNsUCs0nGZd0rBy3rxzoNFQL1LxHlwpMzGX3amF7HDx5WU5iKCB0Uqvtl9+C4lXyPRNH2NXlRBiUhfXGBy159HM4foPqc7goK8k9LXlNKki6g0dfBGkm3FyPePBIGWgg8VxM3VN1iIDR2wM44VwIB1yW+FdXLSQdq3NPiAA3sUB3Ttiny/HQp2rrKBecZ1kknUq2Akxi/dDihax3c4dTq2qZOsxjvoEZOrCDItmVHzGzHo2rBoJfNAIpf+Nf1zVHXhJJbcdHbRNjvs29qqKf77aZ5gOX4D2zN98RJsiJsZ8ezabbcymZsg3c7LAXrYiHBjPzCk7TsVOMHICbC88r4FLulGUzRal4au2xu0tABmu2MoittS9VbqXVZ3NpLKUpsqskMQCj3EYlUWtkej3lAf+35Nwrhx3qGHbcWEFu3rIFZ1s1Fre+x0= 2021-08-15T00:32:48.117 INFO:teuthology.kill: smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD2gvRU/Vs0n9u/oNrqDy2NctpfjSJX88JIF37c4xEs/eaU+5GyzEkUuFa/eEk4+PtcQ6QaIgNQtQvt4Az+qtguaWu38s2x7jgZYAZymhRwMAjg+LRbKipd1Xo4cK/+8FpUSif+sn6smVHjSYUojdbT82OFIr+Y6zx3e3Z+m06stGOvYj4cVrxAyIgtNp+9RayAhICw1zjLzrowyPQ1he3e7q5wVPftjr5ZcqrO1nAInEEQNjddd9znYa3GWWRVAH+m1qu5MSIv0DhyU13My9UbWA5IprjRL8f3KBSaVxxx8iX/DE2mDSaFc7Wskl8AFQOlBd1z/CpCrYw+9EJx4NkNXg89qZlLYrw7Rpiz4CSBS951tWE1xcYIrPKZ77MR8qzJvdGzaJ+YsK2Ncq8Q37j0YwhTClxKTZSQlEFlm0Kz5seJKF1ButatI6E3zVs4rz/zgvF656NeYtAwAgEd4kk+mWbkfg1f1sjM+XZHky86wnu+yNRl1l2xF3AwJUO/E/s= 2021-08-15T00:32:48.138 INFO:teuthology.kill:2021-08-15 00:32:48,138.138 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-15T00:32:48.142 INFO:teuthology.kill:2021-08-15 00:32:48,142.142 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-15T00:32:48.145 INFO:teuthology.kill:2021-08-15 00:32:48,145.145 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-15T00:32:48.200 INFO:teuthology.kill:2021-08-15 00:32:48,200.200 INFO:teuthology.orchestra.console:Power off smithi134 2021-08-15T00:32:48.217 INFO:teuthology.kill:2021-08-15 00:32:48,216.216 INFO:teuthology.orchestra.console:Power off smithi153 2021-08-15T00:32:48.229 INFO:teuthology.kill:2021-08-15 00:32:48,229.229 INFO:teuthology.orchestra.console:Power off smithi181 2021-08-15T00:32:48.363 INFO:teuthology.kill:2021-08-15 00:32:48,362.362 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2021-08-15T00:32:48.364 INFO:teuthology.kill:2021-08-15 00:32:48,363.363 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-08-15T00:32:48.375 INFO:teuthology.kill:2021-08-15 00:32:48,375.375 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2021-08-15T00:32:48.506 INFO:teuthology.kill:2021-08-15 00:32:48,505.505 INFO:teuthology.lock.ops:unlocked smithi134.front.sepia.ceph.com 2021-08-15T00:32:48.510 INFO:teuthology.kill:2021-08-15 00:32:48,509.509 INFO:teuthology.lock.ops:unlocked smithi153.front.sepia.ceph.com 2021-08-15T00:32:48.513 INFO:teuthology.kill:2021-08-15 00:32:48,513.513 INFO:teuthology.lock.ops:unlocked smithi181.front.sepia.ceph.com 2021-08-15T00:34:48.847 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-08-15T00:34:48.978 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-08-15T00:34:48.979 INFO:teuthology.nuke:Checking targets against current locks 2021-08-15T00:34:49.069 INFO:teuthology.nuke:Not nuking smithi181.front.sepia.ceph.com because description doesn't match 2021-08-15T00:34:49.069 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_958c1edcb5eb270c30cb2287aec6a9ee0cbd48f7/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable