2021-05-26T12:02:20.058 INFO:root:teuthology version: 1.1.0-0c70841a 2021-05-26T12:02:20.188 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging 2021-05-26T12:02:20.189 INFO:teuthology.lock.ops:Updating [ubuntu@smithi006.front.sepia.ceph.com]: reset os type and version on server 2021-05-26T12:02:20.190 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2021-05-26T12:02:20.204 INFO:teuthology.lock.ops:Node 'ubuntu@smithi006.front.sepia.ceph.com' reimaging is complete 2021-05-26T12:02:20.205 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging 2021-05-26T12:02:20.205 INFO:teuthology.lock.ops:Updating [ubuntu@smithi072.front.sepia.ceph.com]: reset os type and version on server 2021-05-26T12:02:20.205 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2021-05-26T12:02:20.220 INFO:teuthology.lock.ops:Node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging is complete 2021-05-26T12:02:20.221 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging 2021-05-26T12:02:20.221 INFO:teuthology.lock.ops:Updating [ubuntu@smithi107.front.sepia.ceph.com]: reset os type and version on server 2021-05-26T12:02:20.221 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2021-05-26T12:02:20.235 INFO:teuthology.lock.ops:Node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging is complete 2021-05-26T12:02:20.419 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.3 2021-05-26T12:02:20.431 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.3 2021-05-26T12:02:20.446 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.3 2021-05-26T12:02:20.783 INFO:teuthology.orchestra.console:Power off smithi006 2021-05-26T12:02:20.801 INFO:teuthology.orchestra.console:Power off smithi072 2021-05-26T12:02:20.835 INFO:teuthology.orchestra.console:Power off smithi107 2021-05-26T12:02:29.171 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2021-05-26T12:02:29.272 INFO:teuthology.orchestra.console:Power on smithi006 2021-05-26T12:02:33.289 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2021-05-26T12:02:33.310 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2021-05-26T12:02:33.391 INFO:teuthology.orchestra.console:Power on smithi072 2021-05-26T12:02:33.411 INFO:teuthology.orchestra.console:Power on smithi107 2021-05-26T12:02:33.530 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2021-05-26T12:02:33.631 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2021-05-26T12:02:37.664 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2021-05-26T12:02:37.765 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2021-05-26T12:02:41.773 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2021-05-26T12:02:41.874 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2021-05-26T12:06:50.249 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-26T12:06:50.559 INFO:teuthology.provision.fog.smithi006:Node is ready 2021-05-26T12:06:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2021-05-26T12:06:50.629 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2021-05-26T12:06:50.955 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2021-05-26T12:06:52.174 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-26T12:07:12.150 INFO:teuthology.provision.fog.smithi107:Node is ready 2021-05-26T12:07:12.169 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2021-05-26T12:07:12.226 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2021-05-26T12:07:12.573 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2021-05-26T12:10:39.023 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-26T12:10:39.421 INFO:teuthology.provision.fog.smithi072:Node is ready 2021-05-26T12:10:39.436 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2021-05-26T12:10:39.491 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2021-05-26T12:10:39.847 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2021-05-26T12:10:39.998 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2021-05-26T12:10:39.999 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-26T12:10:40.016 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2021-05-26T12:10:40.017 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-26T12:10:40.031 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2021-05-26T12:10:40.032 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-26T12:10:40.048 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2021-05-26T12:10:40.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T12:10:40.344 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2021-05-26T12:10:40.399 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2021-05-26T12:10:40.400 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.3 (Ootpa)" 2021-05-26T12:10:40.400 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2021-05-26T12:10:40.400 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2021-05-26T12:10:40.401 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.3" 2021-05-26T12:10:40.401 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2021-05-26T12:10:40.401 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-26T12:10:40.401 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2021-05-26T12:10:40.401 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-26T12:10:40.402 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2021-05-26T12:10:40.402 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-26T12:10:40.402 INFO:teuthology.orchestra.run.smithi006.stdout: 2021-05-26T12:10:40.402 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-26T12:10:40.403 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-26T12:10:40.403 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-26T12:10:40.403 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-26T12:10:40.404 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2021-05-26T12:10:40.420 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2021-05-26T12:10:40.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T12:10:40.702 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2021-05-26T12:10:40.756 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2021-05-26T12:10:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.3 (Ootpa)" 2021-05-26T12:10:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2021-05-26T12:10:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2021-05-26T12:10:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.3" 2021-05-26T12:10:40.758 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2021-05-26T12:10:40.758 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-26T12:10:40.758 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2021-05-26T12:10:40.758 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-26T12:10:40.759 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2021-05-26T12:10:40.759 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-26T12:10:40.759 INFO:teuthology.orchestra.run.smithi072.stdout: 2021-05-26T12:10:40.759 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-26T12:10:40.759 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-26T12:10:40.760 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-26T12:10:40.760 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-26T12:10:40.760 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2021-05-26T12:10:40.778 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2021-05-26T12:10:40.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-26T12:10:41.064 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2021-05-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2021-05-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.3 (Ootpa)" 2021-05-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2021-05-26T12:10:41.118 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2021-05-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.3" 2021-05-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2021-05-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-26T12:10:41.119 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2021-05-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2021-05-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-26T12:10:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: 2021-05-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-26T12:10:41.121 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-26T12:10:41.122 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2021-05-26T12:10:41.207 INFO:teuthology.dispatcher.supervisor:Running job 6136552 2021-05-26T12:10:41.208 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136552 --name kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136552/orig.config.yaml 2021-05-26T12:10:41.211 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-05-26_11:04:40-rados-wip-kefu-testing-2021-05-26-1620-distro-basic-smithi/6136552 2021-05-26T12:10:41.212 INFO:teuthology.dispatcher.supervisor:Job PID: 14797 2021-05-26T12:10:41.212 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-05-27T00:11:31.947 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-05-27T00:11:36.213 INFO:teuthology.kill:Killing Pids: {14797} 2021-05-27T00:11:37.292 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi072', 'smithi107'] 2021-05-27T00:11:38.216 INFO:teuthology.kill:2021-05-27 00:11:38,216.216 INFO:teuthology.nuke:targets: 2021-05-27T00:11:38.217 INFO:teuthology.kill: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJfh2cfRjoutyJWSgkV3xSlhOjA3r7yQ6+Cnl0TrqrFqlmFNVqLZJIfmEBxjnRsz7zbAeLiqNTwD7AASqgfb988tDX+bH7xZtTRR1e95YDkY833W+QeenL5ziFBp7wypPS0gEgO1wDm4A8pKJVVjjNyNfuzMmD3TckgfjogOjxe4ran9bweARfIBbv27r/2lCOqCb+JbK+pFCfe563MoV6crlWsAqYt34Dc1q669ZuonWNPEzxMLRYAn4pYW/9koJd0Hd5CcUvbZ9DtijnJj3VgX5arRDJxJefLDVJm6ImDggh3O34ZvTipXpon9DzNL2Ju5mMiLB+W5N+jAz2tx7Dn8C0AoqcwAgWE1FgbSiwrvnXeNfRxD6dyZ8RJqncSFLXJ+yS6SSBhdnzWQQkebGFeW2F1IUFczwtfaaBeW58rLi1aK5rM9Wkn61ku6YObEa4JD0AaN3Lo9pfe2rvjGWY4ccR0YDt5F5qaUzs/wbqo7J/NDevPBlUIRQ5HkWznIU= 2021-05-27T00:11:38.217 INFO:teuthology.kill: smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgVyDX7T+2CN10x5HFFA9WRYUFNVKkBwUscRyMXG68S9AS60vps+BZR7dW6J96vHgb1tYsdoZ0faxl+iene18Xt2WWwUayHtJ8yXLiiNttEIrCgLbpXydUf9982dR0je3j1VSCa8xBkLfQ6YMo2ZK55kj+TFizUXXvwDX294mTNm7rrblNrGe0+F/+uzDtNVzw/sGmt5r31Ebnmji75iFC++WRZ19rdp5nIvKiHtE031hNCyRmIdLTSgwYBigJ4Vd3+M6n64to2I1wm7qopeOlQofrkBQyP7DCq5L9k82mRKdwCotXkzRda3tINUPnS5Ctys27sW62wwuiKL4SjOrNIswpsQlaJFHVA46ClvLltZohjxhmjL/+GlH8PAtgAc/GuNJ67VPIFiIe5U4rjmLDnKr3aIrWxES+AEcP2RousVgsfnYW+FoQq/TvLCUas15Awslb8LFb82WeaVZcwv1aFjHEAfG8q1fOzl+8Bx5gZwxzmBAYgajpsmb1w6f7fnc= 2021-05-27T00:11:38.217 INFO:teuthology.kill: smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1uqt8CxGJquiJ1JDAouXKBWK+W1bmEMzqKTWi/6JDI8YVSewnTtD7hZuvQWTglBoA8urBPEdy9EHQOmLNmChdxpMLl64zHx45NSuG9FwT/8FyT9IG3NDitN3teupAH2NQQRLtwzzAox2JsTrp3Le0a342XU77iLkBcvYWLzf3Zzo/dOF5O8aq61KT3T2Fk/hBhSxpSodOYFEE25nTBMFUv29R1H9Z4tv5PzUmhgqDEBVaSktuEr6WJHOiJL6hURFgiJxBXI7IupUOMxEQvHPS8k2C3/ZJjt8Dm8IqqkpwbAbm7KLqQpRzeWlh3sWxW27tMvSF/kBafyWZnQWOg7sgfvA8y9xALuSvRYuhF81/gh/NTC2KZ6QmLbO0qB+asxhDQluBo7t6QpN9JTwqyVQubKZT0KIr8gkTWzcw8gYKs2c45X7zhHgyOqI56ATDvryZRy57GhcM0oqnVe1ohJ4PHZopfHPccPXSVMyR4DC2IfWVIvB06NNZPv+J/I0sIX8= 2021-05-27T00:11:38.218 INFO:teuthology.kill:2021-05-27 00:11:38,216.216 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-27T00:11:38.218 INFO:teuthology.kill:2021-05-27 00:11:38,218.218 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-27T00:11:38.220 INFO:teuthology.kill:2021-05-27 00:11:38,219.219 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-27T00:11:38.282 INFO:teuthology.kill:2021-05-27 00:11:38,282.282 INFO:teuthology.orchestra.console:Power off smithi107 2021-05-27T00:11:38.295 INFO:teuthology.kill:2021-05-27 00:11:38,295.295 INFO:teuthology.orchestra.console:Power off smithi006 2021-05-27T00:11:38.306 INFO:teuthology.kill:2021-05-27 00:11:38,305.305 INFO:teuthology.orchestra.console:Power off smithi072 2021-05-27T00:11:46.667 INFO:teuthology.kill:2021-05-27 00:11:46,667.667 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2021-05-27T00:11:46.685 INFO:teuthology.kill:2021-05-27 00:11:46,685.685 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2021-05-27T00:11:50.782 INFO:teuthology.kill:2021-05-27 00:11:50,782.782 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2021-05-27T00:11:51.031 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a'] 2021-05-27T00:11:51.032 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x'] 2021-05-27T00:11:51.032 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c'] 2021-05-27T00:11:51.032 INFO:teuthology.misc:Compressing logs... 2021-05-27T00:11:51.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-27T00:12:51.095 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-05-27T00:12:51.156 INFO:teuthology.kill:No teuthology processes running 2021-05-27T00:12:52.238 INFO:teuthology.kill:Nuking machines: ['smithi006', 'smithi072', 'smithi107'] 2021-05-27T00:12:53.153 INFO:teuthology.kill:2021-05-27 00:12:53,153.153 INFO:teuthology.nuke:targets: 2021-05-27T00:12:53.154 INFO:teuthology.kill: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJfh2cfRjoutyJWSgkV3xSlhOjA3r7yQ6+Cnl0TrqrFqlmFNVqLZJIfmEBxjnRsz7zbAeLiqNTwD7AASqgfb988tDX+bH7xZtTRR1e95YDkY833W+QeenL5ziFBp7wypPS0gEgO1wDm4A8pKJVVjjNyNfuzMmD3TckgfjogOjxe4ran9bweARfIBbv27r/2lCOqCb+JbK+pFCfe563MoV6crlWsAqYt34Dc1q669ZuonWNPEzxMLRYAn4pYW/9koJd0Hd5CcUvbZ9DtijnJj3VgX5arRDJxJefLDVJm6ImDggh3O34ZvTipXpon9DzNL2Ju5mMiLB+W5N+jAz2tx7Dn8C0AoqcwAgWE1FgbSiwrvnXeNfRxD6dyZ8RJqncSFLXJ+yS6SSBhdnzWQQkebGFeW2F1IUFczwtfaaBeW58rLi1aK5rM9Wkn61ku6YObEa4JD0AaN3Lo9pfe2rvjGWY4ccR0YDt5F5qaUzs/wbqo7J/NDevPBlUIRQ5HkWznIU= 2021-05-27T00:12:53.155 INFO:teuthology.kill: smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgVyDX7T+2CN10x5HFFA9WRYUFNVKkBwUscRyMXG68S9AS60vps+BZR7dW6J96vHgb1tYsdoZ0faxl+iene18Xt2WWwUayHtJ8yXLiiNttEIrCgLbpXydUf9982dR0je3j1VSCa8xBkLfQ6YMo2ZK55kj+TFizUXXvwDX294mTNm7rrblNrGe0+F/+uzDtNVzw/sGmt5r31Ebnmji75iFC++WRZ19rdp5nIvKiHtE031hNCyRmIdLTSgwYBigJ4Vd3+M6n64to2I1wm7qopeOlQofrkBQyP7DCq5L9k82mRKdwCotXkzRda3tINUPnS5Ctys27sW62wwuiKL4SjOrNIswpsQlaJFHVA46ClvLltZohjxhmjL/+GlH8PAtgAc/GuNJ67VPIFiIe5U4rjmLDnKr3aIrWxES+AEcP2RousVgsfnYW+FoQq/TvLCUas15Awslb8LFb82WeaVZcwv1aFjHEAfG8q1fOzl+8Bx5gZwxzmBAYgajpsmb1w6f7fnc= 2021-05-27T00:12:53.155 INFO:teuthology.kill: smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1uqt8CxGJquiJ1JDAouXKBWK+W1bmEMzqKTWi/6JDI8YVSewnTtD7hZuvQWTglBoA8urBPEdy9EHQOmLNmChdxpMLl64zHx45NSuG9FwT/8FyT9IG3NDitN3teupAH2NQQRLtwzzAox2JsTrp3Le0a342XU77iLkBcvYWLzf3Zzo/dOF5O8aq61KT3T2Fk/hBhSxpSodOYFEE25nTBMFUv29R1H9Z4tv5PzUmhgqDEBVaSktuEr6WJHOiJL6hURFgiJxBXI7IupUOMxEQvHPS8k2C3/ZJjt8Dm8IqqkpwbAbm7KLqQpRzeWlh3sWxW27tMvSF/kBafyWZnQWOg7sgfvA8y9xALuSvRYuhF81/gh/NTC2KZ6QmLbO0qB+asxhDQluBo7t6QpN9JTwqyVQubKZT0KIr8gkTWzcw8gYKs2c45X7zhHgyOqI56ATDvryZRy57GhcM0oqnVe1ohJ4PHZopfHPccPXSVMyR4DC2IfWVIvB06NNZPv+J/I0sIX8= 2021-05-27T00:12:53.175 INFO:teuthology.kill:2021-05-27 00:12:53,175.175 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-27T00:12:53.178 INFO:teuthology.kill:2021-05-27 00:12:53,178.178 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-27T00:12:53.179 INFO:teuthology.kill:2021-05-27 00:12:53,179.179 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-27T00:12:53.240 INFO:teuthology.kill:2021-05-27 00:12:53,239.239 INFO:teuthology.orchestra.console:Power off smithi006 2021-05-27T00:12:53.256 INFO:teuthology.kill:2021-05-27 00:12:53,256.256 INFO:teuthology.orchestra.console:Power off smithi107 2021-05-27T00:12:53.267 INFO:teuthology.kill:2021-05-27 00:12:53,267.267 INFO:teuthology.orchestra.console:Power off smithi072 2021-05-27T00:12:53.401 INFO:teuthology.kill:2021-05-27 00:12:53,400.400 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2021-05-27T00:12:53.405 INFO:teuthology.kill:2021-05-27 00:12:53,405.405 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2021-05-27T00:12:53.411 INFO:teuthology.kill:2021-05-27 00:12:53,411.411 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2021-05-27T00:12:53.545 INFO:teuthology.kill:2021-05-27 00:12:53,544.544 INFO:teuthology.lock.ops:unlocked smithi006.front.sepia.ceph.com 2021-05-27T00:12:53.547 INFO:teuthology.kill:2021-05-27 00:12:53,547.547 INFO:teuthology.lock.ops:unlocked smithi107.front.sepia.ceph.com 2021-05-27T00:12:53.551 INFO:teuthology.kill:2021-05-27 00:12:53,550.550 INFO:teuthology.lock.ops:unlocked smithi072.front.sepia.ceph.com 2021-05-27T00:14:53.838 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-05-27T00:14:53.943 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-05-27T00:14:53.944 INFO:teuthology.nuke:Checking targets against current locks 2021-05-27T00:14:54.021 INFO:teuthology.nuke:Not nuking smithi107.front.sepia.ceph.com because description doesn't match 2021-05-27T00:14:54.022 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_0c70841acf4fb31ca05cdbebbd295620aac53ce4/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable