2021-02-08T16:40:54.013 INFO:root:teuthology version: 1.1.0-17c09965
2021-02-08T16:40:54.219 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi121.front.sepia.ceph.com' reimaging
2021-02-08T16:40:54.219 INFO:teuthology.lock.ops:Updating [ubuntu@smithi121.front.sepia.ceph.com]: reset os type and version on server
2021-02-08T16:40:54.219 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2021-02-08T16:40:54.233 INFO:teuthology.lock.ops:Node 'ubuntu@smithi121.front.sepia.ceph.com' reimaging is complete
2021-02-08T16:40:54.234 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi188.front.sepia.ceph.com' reimaging
2021-02-08T16:40:54.234 INFO:teuthology.lock.ops:Updating [ubuntu@smithi188.front.sepia.ceph.com]: reset os type and version on server
2021-02-08T16:40:54.234 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2021-02-08T16:40:54.248 INFO:teuthology.lock.ops:Node 'ubuntu@smithi188.front.sepia.ceph.com' reimaging is complete
2021-02-08T16:40:54.446 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of ubuntu 16.04
2021-02-08T16:40:54.469 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of ubuntu 16.04
2021-02-08T16:40:54.817 INFO:teuthology.orchestra.console:Power off smithi121
2021-02-08T16:40:54.912 INFO:teuthology.orchestra.console:Power off smithi188
2021-02-08T16:40:55.089 INFO:teuthology.orchestra.console:Power off for smithi121 completed
2021-02-08T16:40:55.112 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2021-02-08T16:40:55.191 INFO:teuthology.orchestra.console:Power on smithi121
2021-02-08T16:40:55.213 INFO:teuthology.orchestra.console:Power on smithi188
2021-02-08T16:40:59.486 INFO:teuthology.orchestra.console:Power on for smithi121 completed
2021-02-08T16:40:59.587 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish
2021-02-08T16:41:03.633 INFO:teuthology.orchestra.console:Power on for smithi188 completed
2021-02-08T16:41:03.734 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2021-02-08T16:43:34.752 ERROR:teuthology.orchestra.connection:Error authenticating with smithi188.front.sepia.ceph.com: Authentication failed.
2021-02-08T16:45:19.302 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-02-08T16:45:25.445 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-02-08T16:45:31.452 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-02-08T16:45:37.690 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-08T16:45:38.015 INFO:teuthology.provision.fog.smithi188:Node is ready
2021-02-08T16:45:38.057 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2021-02-08T16:45:38.097 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2021-02-08T16:45:38.353 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2021-02-08T16:45:46.291 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-08T16:45:46.663 INFO:teuthology.provision.fog.smithi121:Node is ready
2021-02-08T16:45:46.706 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com
2021-02-08T16:45:46.748 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121
2021-02-08T16:45:46.991 INFO:teuthology.provision.fog.smithi121:Deploy complete!
2021-02-08T16:45:47.107 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com
2021-02-08T16:45:47.107 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-08T16:45:47.125 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2021-02-08T16:45:47.125 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-08T16:45:47.141 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server
2021-02-08T16:45:47.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-08T16:45:47.448 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64
2021-02-08T16:45:47.488 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu"
2021-02-08T16:45:47.488 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="16.04.6 LTS (Xenial Xerus)"
2021-02-08T16:45:47.488 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu
2021-02-08T16:45:47.488 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian
2021-02-08T16:45:47.488 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 16.04.6 LTS"
2021-02-08T16:45:47.488 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="16.04"
2021-02-08T16:45:47.488 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="http://www.ubuntu.com/"
2021-02-08T16:45:47.488 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="http://help.ubuntu.com/"
2021-02-08T16:45:47.489 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
2021-02-08T16:45:47.489 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=xenial
2021-02-08T16:45:47.489 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=xenial
2021-02-08T16:45:47.490 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2021-02-08T16:45:47.505 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2021-02-08T16:45:47.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-08T16:45:47.828 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu"
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="16.04.6 LTS (Xenial Xerus)"
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 16.04.6 LTS"
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="16.04"
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="http://www.ubuntu.com/"
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="http://help.ubuntu.com/"
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=xenial
2021-02-08T16:45:47.869 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=xenial
2021-02-08T16:45:47.870 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2021-02-08T16:45:47.954 INFO:teuthology.dispatcher.supervisor:Running job 5868099
2021-02-08T16:45:47.954 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology -v --owner scheduled_khiremat@teuthology --archive /home/teuthworker/archive/khiremat-2021-02-08_16:28:29-fs-wip-khiremat-mgr-authid-bp-7-nautilus-distro-basic-smithi/5868099 --name khiremat-2021-02-08_16:28:29-fs-wip-khiremat-mgr-authid-bp-7-nautilus-distro-basic-smithi --description fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_16.04} tasks/volumes} -- /home/teuthworker/archive/khiremat-2021-02-08_16:28:29-fs-wip-khiremat-mgr-authid-bp-7-nautilus-distro-basic-smithi/5868099/orig.config.yaml
2021-02-08T16:45:47.959 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/khiremat-2021-02-08_16:28:29-fs-wip-khiremat-mgr-authid-bp-7-nautilus-distro-basic-smithi/5868099
2021-02-08T16:45:47.960 INFO:teuthology.dispatcher.supervisor:Job PID: 867
2021-02-08T16:45:47.960 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-09T04:46:03.654 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-09T04:46:03.805 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1']
2021-02-09T04:46:03.805 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3']
2021-02-09T04:46:03.805 INFO:teuthology.misc:Compressing logs...
2021-02-09T04:46:03.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-09T04:46:04.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-09T04:46:47.934 INFO:teuthology.kill:Killing Pids: {867}
2021-02-09T04:46:49.815 INFO:teuthology.kill:Nuking machines: ['smithi121', 'smithi188']
2021-02-09T04:46:51.390 INFO:teuthology.kill:2021-02-09 04:46:51,389.389 INFO:teuthology.nuke:targets:
2021-02-09T04:46:51.391 INFO:teuthology.kill:  smithi121.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIaZ+m7al59C1erWU1zmuo9AxKAGgRN5kUd8giQOl81Egb6iz/cjPbZhb8JZc1abtIMV9wf9xq4BcjQayPSCLgKIVWC7j8Jb6kUkC8yB4dSSGeD/NHraLtWCL8ANrFg21G9X5/flilTRAzAfJZXR49d7Gvoxxnn1SlVKpscsQ2FSwKT7bSiihLi/22HDE8uAUIZUmMLQv19AnzD2XuOELoTjWXklu25DP/t1g+e9wRD89YmNgsm2YdAl7dLuhiVza72fbkJF2wrAFvh/szriAHEZ5weTKhHedDR5Dmjn2KwRB8q84IHqtq73nbrefNUvjRRxULsXdhHyh1BsDtG8FB
2021-02-09T04:46:51.391 INFO:teuthology.kill:  smithi188.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQClQrk58MXr4Ywpuz1uHQQcRiKAfCQ+EZmQBYiOdR0bYPzDMDDiiUCLZWB0oCD4y0H+hVIZ4rA4/+etig5THrrGzkoGn6MxsOp5m+hC9C+NCdIyyY/cpVPYEDy6gzUiSiZ6r82JNP5cLHm/9PvqcCWYJSd/PXy7aM89Es9HXO7BQyc32MskLcffjaIM9eWyKC8/PxL6E8cMGHnLc7p5r9zFVFn0lKK4JaLK7yQUISKe6lqc+o1MNCMvyaoqJFtR9BFJkhmandon8hDrm0+s7QFL+6VKt6LDxpotVcpd27wZQ49CReHO5iayxkghQsD6KeZ2XohskaFFhQzKESE7bW2v
2021-02-09T04:46:51.417 INFO:teuthology.kill:2021-02-09 04:46:51,416.416 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-09T04:46:51.420 INFO:teuthology.kill:2021-02-09 04:46:51,419.419 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-09T04:46:51.501 INFO:teuthology.kill:2021-02-09 04:46:51,500.500 INFO:teuthology.orchestra.console:Power off smithi188
2021-02-09T04:46:51.522 INFO:teuthology.kill:2021-02-09 04:46:51,521.521 INFO:teuthology.orchestra.console:Power off smithi121
2021-02-09T04:46:59.960 INFO:teuthology.kill:2021-02-09 04:46:59,959.959 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2021-02-09T04:47:00.102 INFO:teuthology.kill:2021-02-09 04:47:00,101.101 INFO:teuthology.lock.ops:unlocked smithi188.front.sepia.ceph.com
2021-02-09T04:47:04.077 INFO:teuthology.kill:2021-02-09 04:47:04,076.076 INFO:teuthology.orchestra.console:Power off for smithi121 completed
2021-02-09T04:47:04.225 INFO:teuthology.kill:2021-02-09 04:47:04,225.225 INFO:teuthology.lock.ops:unlocked smithi121.front.sepia.ceph.com
2021-02-09T04:49:04.431 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-09T04:49:05.412 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-09T04:49:05.413 INFO:teuthology.nuke:Checking targets against current locks
2021-02-09T04:49:05.534 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/dispatcher/supervisor.py", line 152, in run_job
    unlock_targets(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets
    nuke(fake_ctx, True)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/nuke/__init__.py", line 250, in nuke
    if ctx.name not in lock['description']:
TypeError: argument of type 'NoneType' is not iterable