2022-07-03T00:46:30.845 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-03T00:46:30.997 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging
2022-07-03T00:46:30.998 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server
2022-07-03T00:46:30.999 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2022-07-03T00:46:31.018 INFO:teuthology.lock.ops:Node 'smithi063.front.sepia.ceph.com' reimaging is complete
2022-07-03T00:46:31.018 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging
2022-07-03T00:46:31.019 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server
2022-07-03T00:46:31.019 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server
2022-07-03T00:46:31.042 INFO:teuthology.lock.ops:Node 'smithi189.front.sepia.ceph.com' reimaging is complete
2022-07-03T00:46:31.242 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of ubuntu 20.04
2022-07-03T00:46:31.263 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of ubuntu 20.04
2022-07-03T00:46:31.653 INFO:teuthology.orchestra.console:Power off smithi063
2022-07-03T00:46:31.670 INFO:teuthology.orchestra.console:Power off smithi189
2022-07-03T00:46:40.032 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2022-07-03T00:46:40.134 INFO:teuthology.orchestra.console:Power on smithi063
2022-07-03T00:46:44.152 INFO:teuthology.orchestra.console:Power off for smithi189 completed
2022-07-03T00:46:44.254 INFO:teuthology.orchestra.console:Power on smithi189
2022-07-03T00:46:48.500 INFO:teuthology.orchestra.console:Power on for smithi063 completed
2022-07-03T00:46:48.507 INFO:teuthology.orchestra.console:Power on for smithi189 completed
2022-07-03T00:46:48.602 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2022-07-03T00:46:48.609 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish
2022-07-03T00:51:48.828 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-03T00:51:49.353 INFO:teuthology.provision.fog.smithi063:Node is ready
2022-07-03T00:51:49.360 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2022-07-03T00:51:49.367 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2022-07-03T00:51:49.641 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2022-07-03T00:51:56.051 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-03T00:51:56.568 INFO:teuthology.provision.fog.smithi189:Node is ready
2022-07-03T00:51:56.575 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com
2022-07-03T00:51:56.624 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189
2022-07-03T00:51:56.818 INFO:teuthology.provision.fog.smithi189:Deploy complete!
2022-07-03T00:51:57.046 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2022-07-03T00:51:57.047 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-03T00:51:57.070 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com
2022-07-03T00:51:57.071 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-03T00:51:57.094 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2022-07-03T00:51:57.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2022-07-03T00:51:57.322 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2022-07-03T00:51:57.328 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu"
2022-07-03T00:51:57.329 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-07-03T00:51:57.329 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu
2022-07-03T00:51:57.330 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian
2022-07-03T00:51:57.330 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-07-03T00:51:57.330 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="20.04"
2022-07-03T00:51:57.330 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/"
2022-07-03T00:51:57.331 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-07-03T00:51:57.331 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-07-03T00:51:57.331 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-07-03T00:51:57.331 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=focal
2022-07-03T00:51:57.332 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=focal
2022-07-03T00:51:57.333 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2022-07-03T00:51:57.359 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server
2022-07-03T00:51:57.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com'
2022-07-03T00:51:57.593 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64
2022-07-03T00:51:57.600 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="Ubuntu"
2022-07-03T00:51:57.601 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-07-03T00:51:57.601 INFO:teuthology.orchestra.run.smithi189.stdout:ID=ubuntu
2022-07-03T00:51:57.601 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE=debian
2022-07-03T00:51:57.602 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-07-03T00:51:57.602 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="20.04"
2022-07-03T00:51:57.602 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.ubuntu.com/"
2022-07-03T00:51:57.602 INFO:teuthology.orchestra.run.smithi189.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-07-03T00:51:57.603 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-07-03T00:51:57.603 INFO:teuthology.orchestra.run.smithi189.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-07-03T00:51:57.603 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_CODENAME=focal
2022-07-03T00:51:57.603 INFO:teuthology.orchestra.run.smithi189.stdout:UBUNTU_CODENAME=focal
2022-07-03T00:51:57.604 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server
2022-07-03T00:51:57.717 INFO:teuthology.dispatcher.supervisor:Running job 6910696
2022-07-03T00:51:57.718 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910696 --name rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} -- /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910696/orig.config.yaml
2022-07-03T00:51:57.723 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910696
2022-07-03T00:51:57.724 INFO:teuthology.dispatcher.supervisor:Job PID: 26137
2022-07-03T00:51:57.724 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-03T12:52:21.778 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-03T12:52:21.948 INFO:teuthology.kill:Killing Pids: {26137}
2022-07-03T12:52:23.387 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-07-03T12:52:23.387 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-07-03T12:52:23.388 INFO:teuthology.misc:Compressing logs...
2022-07-03T12:52:23.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2022-07-03T12:52:25.018 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/remote.py", line 509, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi063
2022-07-03T12:52:25.084 INFO:teuthology.kill:No teuthology processes running
2022-07-03T12:52:26.471 INFO:teuthology.kill:Nuking machines: ['smithi063', 'smithi189']
2022-07-03T12:52:27.605 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-03T12:52:27.606 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-03T12:52:27.606 INFO:teuthology.kill:2022-07-03 12:52:27,605.605 INFO:teuthology.nuke:targets:
2022-07-03T12:52:27.607 INFO:teuthology.kill:  smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgndXNAJg25eTI238ZuPtn6bQBxpyPe5xzEW9hbxeEPe66BMpo0cFvt/WM7YUGzd0CYNa0vfUZlWOgWRmbx+4xR6c5um0rEfzsGb/QGWtXLvypYLiwGXM+Fk3Zpdhb4Pz8qz8/CO+IUNhmXDnigYz2rULxuXXlhxleXROAenRyut/XGb7ufWRJUH4+YCnJ+2SfUZDYgjnGjBhw8I02OuXfL45vkcbdCOSJEjAHFbRPMIk+ck28y0HQGGoiFY+dKd2hNaQk1v0KPviSqoWA1j0cSGmcDufduyk6q8QTAfio7Mvd+bcPF8NHEqy2VsCu9XgAOi8dreqWvbrcTjMEcyGrvKQDgS+JS/J8KiPijN0a8XvQW5x0S4QyfKo6Vfl67TwD+Y377S6JOqYno757N+n+6UMKCQQ4XirGTj+NU076wadQ5OfmeMmQctD6mJbQvFxU43afGnj7W0w56nK2s+fNuNmV+vXaRcsxcWdaHnIYFf2e8tx/jI9BT8JElzn/at8=
2022-07-03T12:52:27.607 INFO:teuthology.kill:  smithi189.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSM4NdGnj2mxYGmKbQ/zqUADemLhNx29EooO3Q1fW8o+oruz4rB/u7pWZojicddKViLlpEez6Gvq+l+zGdphlgUSsRfgnXJgRQm0zQtUJFXpgX/vQDq2T8LBCduNpZyChW4dYP4gQifx1W7wNlnujqKfoimHmj0EsZZr1FszIQ4oSiisEiV8TYxFzHU1MdOds9lSdXUzeHGLvIZmdnmbV2RAlDeO1DEYqsxhOyb9Fzul0ss6qhLE9QkOIeIc2WgEtV+cMOfB8G39FDIXic4tjqG/uOpnxsAx3L0BRrLpdhwWj+SUDaI1g+j3wD/a7eCXzf190QI4GLdF0x5eZau+oH+ceRGtcJhHORBtD2D8LZCMkAYv7I4WogxFp3VT0OXo8CInqtNGxz6ASSt2+CSK/YpNoWcBIaNsFK4snF/nAwjXGvjuSL3UwlqGHFvBHOcJoQUeNBQLRE2h3NCMTjlcB4KZaO7okIi56Dp0aD2s3qXI2JK5AYfDChxXRFHqLO0jE=
2022-07-03T12:52:27.607 INFO:teuthology.kill:2022-07-03 12:52:27,605.605 INFO:teuthology.nuke:Checking targets against current locks
2022-07-03T12:52:27.660 INFO:teuthology.kill:2022-07-03 12:52:27,660.660 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-03T12:52:27.689 INFO:teuthology.kill:2022-07-03 12:52:27,689.689 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-03T12:52:27.746 INFO:teuthology.kill:2022-07-03 12:52:27,746.746 INFO:teuthology.orchestra.console:Power off smithi063
2022-07-03T12:52:27.787 INFO:teuthology.kill:2022-07-03 12:52:27,786.786 INFO:teuthology.orchestra.console:Power off smithi189
2022-07-03T12:52:36.126 INFO:teuthology.kill:2022-07-03 12:52:36,126.126 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2022-07-03T12:52:36.151 INFO:teuthology.kill:2022-07-03 12:52:36,151.151 INFO:teuthology.orchestra.console:Power off for smithi189 completed
2022-07-03T12:52:36.279 INFO:teuthology.kill:2022-07-03 12:52:36,279.279 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com
2022-07-03T12:52:36.307 INFO:teuthology.kill:2022-07-03 12:52:36,306.306 INFO:teuthology.lock.ops:unlocked: smithi189.front.sepia.ceph.com
2022-07-03T12:54:36.659 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-03T12:54:36.768 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi189 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-02_14:22:03-upgrade:octopus-x-pacific-distro-default-smithi/6910909