2022-07-02T17:12:26.995 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-02T17:12:27.136 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging
2022-07-02T17:12:27.137 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server
2022-07-02T17:12:27.137 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2022-07-02T17:12:27.157 INFO:teuthology.lock.ops:Node 'smithi042.front.sepia.ceph.com' reimaging is complete
2022-07-02T17:12:27.158 INFO:teuthology.lock.ops:Start node 'smithi197.front.sepia.ceph.com' reimaging
2022-07-02T17:12:27.158 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: reset os type and version on server
2022-07-02T17:12:27.158 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-07-02T17:12:27.182 INFO:teuthology.lock.ops:Node 'smithi197.front.sepia.ceph.com' reimaging is complete
2022-07-02T17:12:27.370 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of ubuntu 20.04
2022-07-02T17:12:27.405 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of ubuntu 20.04
2022-07-02T17:12:27.701 INFO:teuthology.orchestra.console:Power off smithi042
2022-07-02T17:12:27.764 INFO:teuthology.orchestra.console:Power off smithi197
2022-07-02T17:12:36.079 INFO:teuthology.orchestra.console:Power off for smithi042 completed
2022-07-02T17:12:36.180 INFO:teuthology.orchestra.console:Power on smithi042
2022-07-02T17:12:40.239 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-07-02T17:12:40.341 INFO:teuthology.orchestra.console:Power on smithi197
2022-07-02T17:12:44.544 INFO:teuthology.orchestra.console:Power on for smithi042 completed
2022-07-02T17:12:44.594 INFO:teuthology.orchestra.console:Power on for smithi197 completed
2022-07-02T17:12:44.646 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish
2022-07-02T17:12:44.696 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish
2022-07-02T17:17:22.583 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-02T17:17:23.175 INFO:teuthology.provision.fog.smithi042:Node is ready
2022-07-02T17:17:23.182 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com
2022-07-02T17:17:23.190 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042
2022-07-02T17:17:23.407 INFO:teuthology.provision.fog.smithi042:Deploy complete!
2022-07-02T17:17:43.348 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-02T17:17:43.879 INFO:teuthology.provision.fog.smithi197:Node is ready
2022-07-02T17:17:43.929 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com
2022-07-02T17:17:43.937 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2022-07-02T17:17:44.142 INFO:teuthology.provision.fog.smithi197:Deploy complete!
2022-07-02T17:17:44.364 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com
2022-07-02T17:17:44.365 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-02T17:17:44.393 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com
2022-07-02T17:17:44.393 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-02T17:17:44.419 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server
2022-07-02T17:17:44.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com'
2022-07-02T17:17:44.750 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64
2022-07-02T17:17:44.758 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu"
2022-07-02T17:17:44.758 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-07-02T17:17:44.759 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu
2022-07-02T17:17:44.759 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian
2022-07-02T17:17:44.759 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-07-02T17:17:44.760 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="20.04"
2022-07-02T17:17:44.760 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/"
2022-07-02T17:17:44.761 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-07-02T17:17:44.761 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-07-02T17:17:44.762 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-07-02T17:17:44.762 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=focal
2022-07-02T17:17:44.763 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=focal
2022-07-02T17:17:44.764 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2022-07-02T17:17:44.791 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server
2022-07-02T17:17:44.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com'
2022-07-02T17:17:45.040 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64
2022-07-02T17:17:45.047 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="Ubuntu"
2022-07-02T17:17:45.047 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2022-07-02T17:17:45.048 INFO:teuthology.orchestra.run.smithi197.stdout:ID=ubuntu
2022-07-02T17:17:45.048 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE=debian
2022-07-02T17:17:45.048 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2022-07-02T17:17:45.049 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="20.04"
2022-07-02T17:17:45.049 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.ubuntu.com/"
2022-07-02T17:17:45.049 INFO:teuthology.orchestra.run.smithi197.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-07-02T17:17:45.049 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-07-02T17:17:45.050 INFO:teuthology.orchestra.run.smithi197.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-07-02T17:17:45.050 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_CODENAME=focal
2022-07-02T17:17:45.050 INFO:teuthology.orchestra.run.smithi197.stdout:UBUNTU_CODENAME=focal
2022-07-02T17:17:45.051 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server
2022-07-02T17:17:45.180 INFO:teuthology.dispatcher.supervisor:Running job 6909651
2022-07-02T17:17:45.181 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2022-07-01_20:15:02-fs-wip-adk-testing-2022-06-30-2110-distro-default-smithi/6909651 --name adking-2022-07-01_20:15:02-fs-wip-adk-testing-2022-06-30-2110-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} -- /home/teuthworker/archive/adking-2022-07-01_20:15:02-fs-wip-adk-testing-2022-06-30-2110-distro-default-smithi/6909651/orig.config.yaml
2022-07-02T17:17:45.187 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2022-07-01_20:15:02-fs-wip-adk-testing-2022-06-30-2110-distro-default-smithi/6909651
2022-07-02T17:17:45.188 INFO:teuthology.dispatcher.supervisor:Job PID: 25054
2022-07-02T17:17:45.188 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-03T05:18:45.796 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-03T05:18:45.999 INFO:teuthology.kill:Killing Pids: {25054}
2022-07-03T05:18:47.529 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2022-07-03T05:18:47.530 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2022-07-03T05:18:47.530 INFO:teuthology.misc:Compressing logs...
2022-07-03T05:18:47.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com'
2022-07-03T05:18:49.118 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/remote.py", line 509, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi042
2022-07-03T05:18:49.180 INFO:teuthology.kill:No teuthology processes running
2022-07-03T05:18:50.479 INFO:teuthology.kill:Nuking machines: ['smithi042', 'smithi197']
2022-07-03T05:18:51.715 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-03T05:18:51.716 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-03T05:18:51.716 INFO:teuthology.kill:2022-07-03 05:18:51,714.714 INFO:teuthology.nuke:targets:
2022-07-03T05:18:51.716 INFO:teuthology.kill:  smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnGGOzRTkHOhZmDm9bOr60vQy2dI0BIFGm4UPP5PXfRjoQuF++dLRUKR0EaK85ioO8a2AanMa8z46/eW+hNQxfbR0J7iENS+vbpY193sCr4A/RncVDNZ0aWYz4nfFrFOzRiwPyjHIK/7YBsxeWdHCFMIi2Ufln25BI/3oQf01sr71YlyMDjXT+qDpbw6wppWb5E2dG9NUcrDjUtgVJWts8paAxQkFYCbpxS5iVmwsAlHL7qbVXXbOz8noCplGUWSCpIPDT6Gp1HmBpwo4FMqdab8Wj0Xq/ijmLi0xaFVflttr11T+zdUT9QsneFKsKIanAAKrUZ/790ysRfYuK3iYBAtaZ2aFmcTEATsVho9HvTEBAOkr9mD3YwN4Ezd1I3JLPGudoOdAtNtczCRUohMQQ0ViriiRVySBTKgL0Lz6KvgvrwhRVXR0mAKwk7RKxiBFKr98uwvyGP4cnmOSwTNZ/pqjpLIOCYYfJcP2pWTVp45g3zzBAyBz6/KA1Nb0gO5M=
2022-07-03T05:18:51.716 INFO:teuthology.kill:  smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCWWbVSRDnOeuZITkKlIjx8LO6qWyDrAty6reXIww/SdumSVABZ76Mc9B4AveDVVwnSQ/Taf5XIybHW8L3/Iau1KrOYp6EkKoGqF9VHTVOvfjQBdptgwgTAMNG+g4Hla80+U4FQS+M20PfwtnNiJzVvkM3o8J1mq7ZMAsFozVPLh/jUqibuKFXQxdJyZgIMuKozUGhYE6jY6hwJIjXXWjBuvtl9fQ1bI7Hzg2b+kUXtme//wBQznB8vFY6la+MBZxzjCjlArg/OtioFx9wx1fIIFmWSUsaWhgF1tpZCvOoFXx9C3AboxwcSphva45BtQe+E1tNclzp3j20rD7l1WL97N/86yTgldxjBnIsa2rsSdVTjIMNtCCeSS/17tk07dMjxQwW4d8Csda3JkXqy2UHUZ7vRS5CRXgbNI3qrTCfRr8zyxImGJ1qavUvJ4j3wU00/h+nG92yt8bTVFyEPDKyj9yb1XJxEBklFwYOZUn476T5A0D4ZbRtMgh91HiaXpMk=
2022-07-03T05:18:51.717 INFO:teuthology.kill:2022-07-03 05:18:51,714.714 INFO:teuthology.nuke:Checking targets against current locks
2022-07-03T05:18:51.771 INFO:teuthology.kill:2022-07-03 05:18:51,771.771 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-03T05:18:51.799 INFO:teuthology.kill:2022-07-03 05:18:51,799.799 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-03T05:18:51.859 INFO:teuthology.kill:2022-07-03 05:18:51,858.858 INFO:teuthology.orchestra.console:Power off smithi042
2022-07-03T05:18:51.900 INFO:teuthology.kill:2022-07-03 05:18:51,900.900 INFO:teuthology.orchestra.console:Power off smithi197
2022-07-03T05:19:00.237 INFO:teuthology.kill:2022-07-03 05:19:00,236.236 INFO:teuthology.orchestra.console:Power off for smithi042 completed
2022-07-03T05:19:00.263 INFO:teuthology.kill:2022-07-03 05:19:00,263.263 INFO:teuthology.orchestra.console:Power off for smithi197 completed
2022-07-03T05:19:00.400 INFO:teuthology.kill:2022-07-03 05:19:00,399.399 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com
2022-07-03T05:19:00.419 INFO:teuthology.kill:2022-07-03 05:19:00,418.418 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com
2022-07-03T05:21:00.741 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-03T05:21:00.856 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi042 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-03_05:00:02-smoke-main-distro-default-smithi/6911449
2022-07-03T05:21:00.856 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi197 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-03_05:00:02-smoke-main-distro-default-smithi/6911449