2021-05-14T16:52:05.258 INFO:root:teuthology version: 1.1.0-19220a3b
2021-05-14T16:52:05.347 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba003.front.sepia.ceph.com' reimaging
2021-05-14T16:52:05.348 INFO:teuthology.lock.ops:Updating [ubuntu@gibba003.front.sepia.ceph.com]: reset os type and version on server
2021-05-14T16:52:05.349 INFO:teuthology.lock.ops:Updating gibba003.front.sepia.ceph.com on lock server
2021-05-14T16:52:05.364 INFO:teuthology.lock.ops:Node 'ubuntu@gibba003.front.sepia.ceph.com' reimaging is complete
2021-05-14T16:52:05.365 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba033.front.sepia.ceph.com' reimaging
2021-05-14T16:52:05.365 INFO:teuthology.lock.ops:Updating [ubuntu@gibba033.front.sepia.ceph.com]: reset os type and version on server
2021-05-14T16:52:05.365 INFO:teuthology.lock.ops:Updating gibba033.front.sepia.ceph.com on lock server
2021-05-14T16:52:05.380 INFO:teuthology.lock.ops:Node 'ubuntu@gibba033.front.sepia.ceph.com' reimaging is complete
2021-05-14T16:52:05.557 INFO:teuthology.provision.fog.gibba003:Scheduling deploy of centos 8.3
2021-05-14T16:52:05.567 INFO:teuthology.provision.fog.gibba033:Scheduling deploy of centos 8.3
2021-05-14T16:52:05.823 INFO:teuthology.orchestra.console:Power off gibba003
2021-05-14T16:52:05.835 INFO:teuthology.orchestra.console:Power off gibba033
2021-05-14T16:52:05.980 INFO:teuthology.orchestra.console:Power off for gibba033 completed
2021-05-14T16:52:06.081 INFO:teuthology.orchestra.console:Power on gibba033
2021-05-14T16:52:14.198 INFO:teuthology.orchestra.console:Power off for gibba003 completed
2021-05-14T16:52:14.299 INFO:teuthology.orchestra.console:Power on gibba003
2021-05-14T16:52:14.521 INFO:teuthology.orchestra.console:Power on for gibba033 completed
2021-05-14T16:52:14.623 INFO:teuthology.provision.fog.gibba033:Waiting for deploy to finish
2021-05-14T16:52:22.671 INFO:teuthology.orchestra.console:Power on for gibba003 completed
2021-05-14T16:52:22.772 INFO:teuthology.provision.fog.gibba003:Waiting for deploy to finish
2021-05-14T16:55:55.652 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:55:56.749 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:55:57.805 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:55:58.900 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:55:59.954 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:01.048 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:02.103 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:03.197 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:04.252 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:05.346 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:11.441 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:12.495 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:13.498 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-05-14T16:56:13.499 ERROR:paramiko.transport:Traceback (most recent call last):
2021-05-14T16:56:13.499 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-05-14T16:56:13.500 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-05-14T16:56:13.500 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-05-14T16:56:13.500 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-05-14T16:56:13.500 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-05-14T16:56:13.501 ERROR:paramiko.transport:    raise EOFError()
2021-05-14T16:56:13.501 ERROR:paramiko.transport:EOFError
2021-05-14T16:56:13.501 ERROR:paramiko.transport:
2021-05-14T16:56:13.502 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-05-14T16:56:13.502 ERROR:paramiko.transport:
2021-05-14T16:56:13.502 ERROR:paramiko.transport:Traceback (most recent call last):
2021-05-14T16:56:13.503 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-05-14T16:56:13.503 ERROR:paramiko.transport:    self._check_banner()
2021-05-14T16:56:13.503 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-05-14T16:56:13.503 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-05-14T16:56:13.504 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-05-14T16:56:13.504 ERROR:paramiko.transport:
2021-05-14T16:56:19.559 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:20.562 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-05-14T16:56:20.562 ERROR:paramiko.transport:Traceback (most recent call last):
2021-05-14T16:56:20.563 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-05-14T16:56:20.563 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-05-14T16:56:20.563 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-05-14T16:56:20.564 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-05-14T16:56:20.564 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-05-14T16:56:20.565 ERROR:paramiko.transport:    raise EOFError()
2021-05-14T16:56:20.565 ERROR:paramiko.transport:EOFError
2021-05-14T16:56:20.565 ERROR:paramiko.transport:
2021-05-14T16:56:20.566 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-05-14T16:56:20.566 ERROR:paramiko.transport:
2021-05-14T16:56:20.567 ERROR:paramiko.transport:Traceback (most recent call last):
2021-05-14T16:56:20.567 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-05-14T16:56:20.567 ERROR:paramiko.transport:    self._check_banner()
2021-05-14T16:56:20.568 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-05-14T16:56:20.568 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-05-14T16:56:20.568 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-05-14T16:56:20.569 ERROR:paramiko.transport:
2021-05-14T16:56:26.573 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-05-14T16:56:26.573 ERROR:paramiko.transport:Traceback (most recent call last):
2021-05-14T16:56:26.574 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-05-14T16:56:26.574 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-05-14T16:56:26.574 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-05-14T16:56:26.574 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-05-14T16:56:26.575 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-05-14T16:56:26.575 ERROR:paramiko.transport:    raise EOFError()
2021-05-14T16:56:26.575 ERROR:paramiko.transport:EOFError
2021-05-14T16:56:26.576 ERROR:paramiko.transport:
2021-05-14T16:56:26.576 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-05-14T16:56:26.576 ERROR:paramiko.transport:
2021-05-14T16:56:26.577 ERROR:paramiko.transport:Traceback (most recent call last):
2021-05-14T16:56:26.577 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-05-14T16:56:26.577 ERROR:paramiko.transport:    self._check_banner()
2021-05-14T16:56:26.577 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-05-14T16:56:26.578 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-05-14T16:56:26.578 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-05-14T16:56:26.578 ERROR:paramiko.transport:
2021-05-14T16:56:32.673 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:33.768 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:34.862 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:35.956 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:37.051 ERROR:teuthology.orchestra.connection:Error authenticating with gibba033.front.sepia.ceph.com: Authentication failed.
2021-05-14T16:56:45.513 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-14T16:56:45.795 INFO:teuthology.provision.fog.gibba003:Node is ready
2021-05-14T16:56:45.846 INFO:teuthology.orchestra.run.gibba003.stdout:gibba003.front.sepia.ceph.com
2021-05-14T16:56:45.898 INFO:teuthology.orchestra.run.gibba003.stdout:172.21.2.103 gibba003.front.sepia.ceph.com gibba003
2021-05-14T16:56:46.181 INFO:teuthology.provision.fog.gibba003:Deploy complete!
2021-05-14T16:58:59.452 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-05-14T16:58:59.676 INFO:teuthology.provision.fog.gibba033:Node is ready
2021-05-14T16:58:59.728 INFO:teuthology.orchestra.run.gibba033.stdout:gibba033.front.sepia.ceph.com
2021-05-14T16:58:59.780 INFO:teuthology.orchestra.run.gibba033.stdout:172.21.2.133 gibba033.front.sepia.ceph.com gibba033
2021-05-14T16:59:00.066 INFO:teuthology.provision.fog.gibba033:Deploy complete!
2021-05-14T16:59:00.184 INFO:teuthology.lock.ops:Checking gibba003.front.sepia.ceph.com
2021-05-14T16:59:00.185 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-14T16:59:00.202 INFO:teuthology.lock.ops:Checking gibba033.front.sepia.ceph.com
2021-05-14T16:59:00.202 INFO:teuthology.lock.ops:New key found. Updating...
2021-05-14T16:59:01.230 INFO:teuthology.lock.ops:Updating [gibba003.front.sepia.ceph.com]: set os type and version on server
2021-05-14T16:59:01.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-14T16:59:01.474 INFO:teuthology.orchestra.run.gibba003.stdout:x86_64
2021-05-14T16:59:01.525 INFO:teuthology.orchestra.run.gibba003.stdout:NAME="CentOS Linux"
2021-05-14T16:59:01.526 INFO:teuthology.orchestra.run.gibba003.stdout:VERSION="8"
2021-05-14T16:59:01.526 INFO:teuthology.orchestra.run.gibba003.stdout:ID="centos"
2021-05-14T16:59:01.526 INFO:teuthology.orchestra.run.gibba003.stdout:ID_LIKE="rhel fedora"
2021-05-14T16:59:01.526 INFO:teuthology.orchestra.run.gibba003.stdout:VERSION_ID="8"
2021-05-14T16:59:01.527 INFO:teuthology.orchestra.run.gibba003.stdout:PLATFORM_ID="platform:el8"
2021-05-14T16:59:01.527 INFO:teuthology.orchestra.run.gibba003.stdout:PRETTY_NAME="CentOS Linux 8"
2021-05-14T16:59:01.527 INFO:teuthology.orchestra.run.gibba003.stdout:ANSI_COLOR="0;31"
2021-05-14T16:59:01.527 INFO:teuthology.orchestra.run.gibba003.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-05-14T16:59:01.527 INFO:teuthology.orchestra.run.gibba003.stdout:HOME_URL="https://centos.org/"
2021-05-14T16:59:01.528 INFO:teuthology.orchestra.run.gibba003.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-05-14T16:59:01.528 INFO:teuthology.orchestra.run.gibba003.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-05-14T16:59:01.528 INFO:teuthology.orchestra.run.gibba003.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-05-14T16:59:01.529 INFO:teuthology.lock.ops:Updating gibba003.front.sepia.ceph.com on lock server
2021-05-14T16:59:01.544 INFO:teuthology.lock.ops:Updating [gibba033.front.sepia.ceph.com]: set os type and version on server
2021-05-14T16:59:01.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-05-14T16:59:01.739 INFO:teuthology.orchestra.run.gibba033.stdout:x86_64
2021-05-14T16:59:01.790 INFO:teuthology.orchestra.run.gibba033.stdout:NAME="Red Hat Enterprise Linux"
2021-05-14T16:59:01.790 INFO:teuthology.orchestra.run.gibba033.stdout:VERSION="8.3 (Ootpa)"
2021-05-14T16:59:01.790 INFO:teuthology.orchestra.run.gibba033.stdout:ID="rhel"
2021-05-14T16:59:01.791 INFO:teuthology.orchestra.run.gibba033.stdout:ID_LIKE="fedora"
2021-05-14T16:59:01.791 INFO:teuthology.orchestra.run.gibba033.stdout:VERSION_ID="8.3"
2021-05-14T16:59:01.791 INFO:teuthology.orchestra.run.gibba033.stdout:PLATFORM_ID="platform:el8"
2021-05-14T16:59:01.791 INFO:teuthology.orchestra.run.gibba033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-05-14T16:59:01.792 INFO:teuthology.orchestra.run.gibba033.stdout:ANSI_COLOR="0;31"
2021-05-14T16:59:01.792 INFO:teuthology.orchestra.run.gibba033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-05-14T16:59:01.792 INFO:teuthology.orchestra.run.gibba033.stdout:HOME_URL="https://www.redhat.com/"
2021-05-14T16:59:01.792 INFO:teuthology.orchestra.run.gibba033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-05-14T16:59:01.792 INFO:teuthology.orchestra.run.gibba033.stdout:
2021-05-14T16:59:01.792 INFO:teuthology.orchestra.run.gibba033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-05-14T16:59:01.793 INFO:teuthology.orchestra.run.gibba033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-05-14T16:59:01.793 INFO:teuthology.orchestra.run.gibba033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-05-14T16:59:01.793 INFO:teuthology.orchestra.run.gibba033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-05-14T16:59:01.794 INFO:teuthology.lock.ops:Updating gibba033.front.sepia.ceph.com on lock server
2021-05-14T16:59:01.871 INFO:teuthology.dispatcher.supervisor:Running job 6108320
2021-05-14T16:59:01.871 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-05-11_03:15:03-fs-master-distro-basic-gibba/6108320 --name teuthology-2021-05-11_03:15:03-fs-master-distro-basic-gibba --description fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} -- /home/teuthworker/archive/teuthology-2021-05-11_03:15:03-fs-master-distro-basic-gibba/6108320/orig.config.yaml
2021-05-14T16:59:01.875 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-05-11_03:15:03-fs-master-distro-basic-gibba/6108320
2021-05-14T16:59:01.876 INFO:teuthology.dispatcher.supervisor:Job PID: 984
2021-05-14T16:59:01.876 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-05-14T17:11:02.123 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2021-05-14T17:11:02.216 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-05-14T17:11:02.217 INFO:teuthology.nuke:Checking targets against current locks
2021-05-14T17:11:02.289 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 152, in run_job
    unlock_targets(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets
    nuke(fake_ctx, True)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/teuthology/nuke/__init__.py", line 250, in nuke
    if ctx.name not in lock['description']:
TypeError: argument of type 'NoneType' is not iterable