2022-03-05T06:02:44.858 INFO:root:teuthology version: 1.1.0-eeaeee38
2022-03-05T06:02:44.977 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging
2022-03-05T06:02:44.978 INFO:teuthology.lock.ops:Updating [ubuntu@smithi057.front.sepia.ceph.com]: reset os type and version on server
2022-03-05T06:02:44.978 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2022-03-05T06:02:44.999 INFO:teuthology.lock.ops:Node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging is complete
2022-03-05T06:02:44.999 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging
2022-03-05T06:02:45.000 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server
2022-03-05T06:02:45.000 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2022-03-05T06:02:45.019 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete
2022-03-05T06:02:45.225 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of ubuntu 20.04
2022-03-05T06:02:45.229 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of ubuntu 20.04
2022-03-05T06:02:45.575 INFO:teuthology.orchestra.console:Power off smithi057
2022-03-05T06:02:45.591 INFO:teuthology.orchestra.console:Power off smithi082
2022-03-05T06:02:45.731 INFO:teuthology.orchestra.console:Power off for smithi082 completed
2022-03-05T06:02:45.832 INFO:teuthology.orchestra.console:Power on smithi082
2022-03-05T06:02:54.196 INFO:teuthology.orchestra.console:Power on for smithi082 completed
2022-03-05T06:02:54.297 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish
2022-03-05T06:02:58.055 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2022-03-05T06:02:58.156 INFO:teuthology.orchestra.console:Power on smithi057
2022-03-05T06:03:02.410 INFO:teuthology.orchestra.console:Power on for smithi057 completed
2022-03-05T06:03:02.511 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2022-03-05T06:07:56.108 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-05T06:07:56.625 INFO:teuthology.provision.fog.smithi082:Node is ready
2022-03-05T06:07:56.676 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com
2022-03-05T06:07:56.684 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082
2022-03-05T06:07:56.868 INFO:teuthology.provision.fog.smithi082:Deploy complete!
2022-03-05T06:08:04.310 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-05T06:08:04.901 INFO:teuthology.provision.fog.smithi057:Node is ready
2022-03-05T06:08:04.909 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2022-03-05T06:08:04.960 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2022-03-05T06:08:05.165 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2022-03-05T06:08:05.417 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2022-03-05T06:08:05.418 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-05T06:08:05.439 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com
2022-03-05T06:08:05.439 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-05T06:08:05.462 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2022-03-05T06:08:05.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2022-03-05T06:08:05.646 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2022-03-05T06:08:05.694 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu"
2022-03-05T06:08:05.695 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-03-05T06:08:05.695 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu
2022-03-05T06:08:05.695 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian
2022-03-05T06:08:05.695 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-03-05T06:08:05.696 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04"
2022-03-05T06:08:05.696 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-05T06:08:05.696 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-05T06:08:05.696 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-05T06:08:05.697 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-05T06:08:05.697 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal
2022-03-05T06:08:05.697 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal
2022-03-05T06:08:05.698 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2022-03-05T06:08:05.718 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server
2022-03-05T06:08:05.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com'
2022-03-05T06:08:05.904 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64
2022-03-05T06:08:05.951 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu"
2022-03-05T06:08:05.951 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-03-05T06:08:05.952 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu
2022-03-05T06:08:05.952 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian
2022-03-05T06:08:05.952 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-03-05T06:08:05.952 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="20.04"
2022-03-05T06:08:05.953 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/"
2022-03-05T06:08:05.953 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-03-05T06:08:05.953 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-03-05T06:08:05.953 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-03-05T06:08:05.953 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=focal
2022-03-05T06:08:05.954 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=focal
2022-03-05T06:08:05.954 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2022-03-05T06:08:06.069 INFO:teuthology.dispatcher.supervisor:Running job 6722194
2022-03-05T06:08:06.069 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-04_22:04:22-fs-wip-yuri4-testing-2022-03-03-1448-distro-default-smithi/6722194 --name yuriw-2022-03-04_22:04:22-fs-wip-yuri4-testing-2022-03-03-1448-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/fsstress validater/valgrind} -- /home/teuthworker/archive/yuriw-2022-03-04_22:04:22-fs-wip-yuri4-testing-2022-03-03-1448-distro-default-smithi/6722194/orig.config.yaml
2022-03-05T06:08:06.073 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-04_22:04:22-fs-wip-yuri4-testing-2022-03-03-1448-distro-default-smithi/6722194
2022-03-05T06:08:06.074 INFO:teuthology.dispatcher.supervisor:Job PID: 1835
2022-03-05T06:08:06.074 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-05T12:38:35.507 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-03-05T12:38:35.707 INFO:teuthology.kill:Killing Pids: {1835}
2022-03-05T12:38:36.988 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-03-05T12:38:36.988 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-03-05T12:38:36.989 INFO:teuthology.misc:Compressing logs...
2022-03-05T12:38:36.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2022-03-05T12:38:37.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com'
2022-03-05T14:52:04.997 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-03-05T14:52:05.036 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/dispatcher/supervisor.py", line 287, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/dispatcher/supervisor.py", line 345, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/run.py", line 479, in wait
    proc.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eeaeee38264fad8a01fd1ce912d8908676ed64bc/teuthology/orchestra/run.py", line 175, in _raise_for_status
    node=self.hostname)
teuthology.exceptions.ConnectionLostError: SSH connection to smithi057 was lost: 'sudo find /var/lib/ceph/crash -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip --'
2022-03-05T14:52:05.181 INFO:teuthology.kill:No teuthology processes running
2022-03-05T14:52:06.374 INFO:teuthology.kill:Nuking machines: ['smithi057', 'smithi082']
2022-03-05T14:52:07.369 INFO:teuthology.kill:2022-03-05 14:52:07,368.368 INFO:teuthology.nuke:targets:
2022-03-05T14:52:07.369 INFO:teuthology.kill:  smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDyYT2mLcSgsB4E37UYGDAxCK3qOAgdq7188IV4ppPje4rqi3PJVUU4C0prx3o5b1eIS8lcHpmACbh6xDxmheT/Ujt5yVK5hFnQI7OeNBOGAHIu+iAZcXbwaA7NnMP6sBoyPXy3JMLSLcU96qeBveZlukVwFMqzjOEPqGRD7Judj2op96p/RYUsilaNqeQhe8sK94XKYWd792G3IurgN1oL4PmcjG0aQu60f0iVekYXVg6bu535gHU5CaYgSoCF2/xzThL6Hk6blQ5J9t4UqqOlUob0z0CnOUcxp3fGtWCs8jHEvzlKFX7bAcXasd7ryAEbkkR1GUGza+ZvBhhoFbAVbzq+amE2BC3ogNVWxzVyKN2Se90uevf90ex/Zalq6nIfViNNVZjIrMIJweQJiuDxmqZEOvGdxZJLoeDLnCCCokKm7cG5yK4SmZcXVZgO4039WG62kcDhI48hExxlFICNlmhHnRODFJD6qXqUkl0ph04NnooxE3PGZl9HbkidBVk=
2022-03-05T14:52:07.370 INFO:teuthology.kill:  smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsqjb1lO1Au1SP/gTMo41nfRBHoao0Mj4U5fcbKSIsGp16/BZWGZ/5IsJKr07v7AsKrMwMMxjKQchfcZxXB8SUccW1dUZ4mexWOdUvmGP8eHqcnySu3K3IdAfa+KMeBzfkarJwxc0enoQyWBWVlePAv3XEOpnigXUR6lMF35mHqToSvu7IrosM+Lp2nTnUyBIeott9ubJCQMdQJZQhwaoqgATrcOXEvbMsBlzVqktzXDwq6vR7NLOX/7vUPF72gT43zoREPGgAmbJ+o4ADORp3qwO7QKFZFSQykLUv3hPLPpLx60T56523vW8M/FkqeCi0Zqiuc+NEeJ1iS5fGh0PSUQMHqNH/JwItIdH7Kdy7bkSEQol6nt7OGEYboF1tIBVykunilAa3GlVGQ414/OZLw1zRGtGRFDlRVmvyWPyDXtbXkrWolHZWCOsgUO14Rp23FK9XFEDgQWClt+NWPc+4JUz0QDph0RaWbjuFns4Ue1UHPc4uAiX3dLenImAumI0=
2022-03-05T14:52:07.404 INFO:teuthology.kill:2022-03-05 14:52:07,404.404 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-05T14:52:07.409 INFO:teuthology.kill:2022-03-05 14:52:07,408.408 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-05T14:52:07.503 INFO:teuthology.kill:2022-03-05 14:52:07,502.502 INFO:teuthology.orchestra.console:Power off smithi057
2022-03-05T14:52:07.524 INFO:teuthology.kill:2022-03-05 14:52:07,524.524 INFO:teuthology.orchestra.console:Power off smithi082
2022-03-05T14:52:20.049 INFO:teuthology.kill:2022-03-05 14:52:20,049.049 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2022-03-05T14:52:20.069 INFO:teuthology.kill:2022-03-05 14:52:20,069.069 INFO:teuthology.orchestra.console:Power off for smithi082 completed
2022-03-05T14:52:20.198 INFO:teuthology.kill:2022-03-05 14:52:20,197.197 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com
2022-03-05T14:52:20.214 INFO:teuthology.kill:2022-03-05 14:52:20,213.213 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com
2022-03-05T14:54:20.621 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-05T14:54:20.779 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi057 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-04_22:08:01-fs-master-distro-default-smithi/6722327
2022-03-05T14:54:20.779 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi082 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-04_22:08:01-fs-master-distro-default-smithi/6722324