2022-07-02T23:35:02.334 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-02T23:35:02.501 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2022-07-02T23:35:02.502 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2022-07-02T23:35:02.502 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-07-02T23:35:02.527 INFO:teuthology.lock.ops:Node 'smithi050.front.sepia.ceph.com' reimaging is complete
2022-07-02T23:35:02.528 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging
2022-07-02T23:35:02.528 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server
2022-07-02T23:35:02.529 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2022-07-02T23:35:02.554 INFO:teuthology.lock.ops:Node 'smithi137.front.sepia.ceph.com' reimaging is complete
2022-07-02T23:35:02.756 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of rhel 8.6
2022-07-02T23:35:02.775 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of rhel 8.6
2022-07-02T23:35:03.085 INFO:teuthology.orchestra.console:Power off smithi050
2022-07-02T23:35:03.102 INFO:teuthology.orchestra.console:Power off smithi137
2022-07-02T23:35:11.477 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-07-02T23:35:11.578 INFO:teuthology.orchestra.console:Power on smithi050
2022-07-02T23:35:15.591 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2022-07-02T23:35:15.694 INFO:teuthology.orchestra.console:Power on smithi137
2022-07-02T23:35:19.954 INFO:teuthology.orchestra.console:Power on for smithi137 completed
2022-07-02T23:35:19.968 INFO:teuthology.orchestra.console:Power on for smithi050 completed
2022-07-02T23:35:20.056 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2022-07-02T23:35:20.070 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2022-07-02T23:39:27.737 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-02T23:39:28.006 INFO:teuthology.provision.fog.smithi050:Node is ready
2022-07-02T23:39:28.025 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2022-07-02T23:39:28.083 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2022-07-02T23:39:28.437 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2022-07-02T23:39:32.464 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-02T23:39:57.504 INFO:teuthology.provision.fog.smithi137:Node is ready
2022-07-02T23:39:57.523 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com
2022-07-02T23:39:57.580 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2022-07-02T23:39:57.929 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2022-07-02T23:39:58.148 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2022-07-02T23:39:58.149 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-02T23:39:58.172 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com
2022-07-02T23:39:58.172 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-02T23:39:58.193 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2022-07-02T23:39:58.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-07-02T23:39:58.472 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2022-07-02T23:39:58.530 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux"
2022-07-02T23:39:58.531 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)"
2022-07-02T23:39:58.531 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel"
2022-07-02T23:39:58.531 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora"
2022-07-02T23:39:58.532 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6"
2022-07-02T23:39:58.532 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2022-07-02T23:39:58.532 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-07-02T23:39:58.532 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2022-07-02T23:39:58.533 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-07-02T23:39:58.533 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/"
2022-07-02T23:39:58.533 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-02T23:39:58.534 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-02T23:39:58.534 INFO:teuthology.orchestra.run.smithi050.stdout:
2022-07-02T23:39:58.534 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-02T23:39:58.535 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-07-02T23:39:58.535 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-02T23:39:58.535 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-07-02T23:39:58.537 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2022-07-02T23:39:58.561 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server
2022-07-02T23:39:58.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com'
2022-07-02T23:39:58.767 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64
2022-07-02T23:39:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux"
2022-07-02T23:39:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)"
2022-07-02T23:39:58.826 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel"
2022-07-02T23:39:58.826 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora"
2022-07-02T23:39:58.827 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6"
2022-07-02T23:39:58.827 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2022-07-02T23:39:58.828 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-07-02T23:39:58.828 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2022-07-02T23:39:58.829 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-07-02T23:39:58.829 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/"
2022-07-02T23:39:58.829 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-02T23:39:58.829 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-02T23:39:58.830 INFO:teuthology.orchestra.run.smithi137.stdout:
2022-07-02T23:39:58.830 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-02T23:39:58.830 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-07-02T23:39:58.830 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-02T23:39:58.831 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-07-02T23:39:58.831 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2022-07-02T23:39:58.968 INFO:teuthology.dispatcher.supervisor:Running job 6910656
2022-07-02T23:39:58.968 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910656 --name rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} -- /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910656/orig.config.yaml
2022-07-02T23:39:58.975 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910656
2022-07-02T23:39:58.976 INFO:teuthology.dispatcher.supervisor:Job PID: 2686
2022-07-02T23:39:58.976 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-03T11:40:57.317 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-03T11:40:57.516 INFO:teuthology.kill:Killing Pids: {2686}
2022-07-03T11:40:59.062 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-07-03T11:40:59.063 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-07-03T11:40:59.064 INFO:teuthology.misc:Compressing logs...
2022-07-03T11:40:59.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2022-07-03T11:41:00.603 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/remote.py", line 509, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi050
2022-07-03T11:41:00.706 INFO:teuthology.kill:No teuthology processes running
2022-07-03T11:41:02.188 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi137']
2022-07-03T11:41:03.356 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-03T11:41:03.357 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-03T11:41:03.357 INFO:teuthology.kill:2022-07-03 11:41:03,355.355 INFO:teuthology.nuke:targets:
2022-07-03T11:41:03.357 INFO:teuthology.kill:  smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW+uohYvFQijzYlGz7G0kRmFEmFyvA3reZU6gbtP2KiS1ObTAyTue5S4Y3z2Wm/6W4Dl5EznxEmHXdstwihIEwvMlUnKUMV/q1bfwMPB6cMSKexfTEGoTBdstaUOyozZ1g8ZADiiWPh6OlI8bLhR0in/uFN5GPc96NfQnl8cS1N+rENkldQA3GQhJw3EVdDaMZf56uhx6D0BTXqflMaSN0xfJl2lB+/Rn48uDrIX5IcjibO2h8tB58akEU1I7JlYEsq5vqF8cDo+cBUiH90bu4OTMg3MRJVzagFk1EDt0/zBqTXJhP1/ty2JZ7Yx2yRPYNnuXVaXhUDCLd9+0RSOhpOc/qDBIzB2l7NXofKIU+T9f5aja7oRcbdk6YlVJO2c1g/12b4mEiyCH7TdHPn2K4laYt7CN93lMmdJNd1vpHJuTNblqaFyYUk7/VtSLAS1okOaX5gPd1hhoWkQSzDmCvV16u9nNPmZ1eWG/ifj83wmCmDPKaARNlgXaKs+IPS20=
2022-07-03T11:41:03.358 INFO:teuthology.kill:  smithi137.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZzc978TBOS8/9XNzBnnO4BjwePAdm6J8KTIjukL/qX8bMbPqRTMJEF0Rot/WXiuvGb80BwaQhRdfhHOFCDcsseozHz1Ym0nUsNeV21CWp6j5+Aw1YbBFnI+ipDasB3I7rmxrga8tS2mhIeMk3LyaQQaKZkRFSBwxDsGwRt7qGAcbHGIm/bZqCCKidW+qI/GfWlrleXIbilNAW9WKPosI+RfcBrxXxyN8cPfO01ofcbo8ptjWv3FhNAwX9HclRfQwrUHxM4dgOwa4WyWdNaBTPeKqSiqz2yCc4TYu4eoZPgAP1yon+X0szYe629YVDEK1FmDuLtSw+8W6hDK/NwZa/b3ReR6Hs2WD+a2qrl2ts72Yq9qUMsYx9bgBfs/oBtq9aP+IG87ZE/h3rg63eQ30cNwfkCHyOB9HqgJezNdnPw7+xJDS1GupwG6P7pNJWAhJfxUfwURdTAdtMp9a2gTiEfOOrssH+ha/T4lOd7Drx0/xUem4Trls/Ft/p0sK6FyE=
2022-07-03T11:41:03.358 INFO:teuthology.kill:2022-07-03 11:41:03,355.355 INFO:teuthology.nuke:Checking targets against current locks
2022-07-03T11:41:03.407 INFO:teuthology.kill:2022-07-03 11:41:03,407.407 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-03T11:41:03.444 INFO:teuthology.kill:2022-07-03 11:41:03,444.444 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-03T11:41:03.526 INFO:teuthology.kill:2022-07-03 11:41:03,525.525 INFO:teuthology.orchestra.console:Power off smithi050
2022-07-03T11:41:03.572 INFO:teuthology.kill:2022-07-03 11:41:03,572.572 INFO:teuthology.orchestra.console:Power off smithi137
2022-07-03T11:41:16.033 INFO:teuthology.kill:2022-07-03 11:41:16,033.033 INFO:teuthology.orchestra.console:Power off for smithi050 completed
2022-07-03T11:41:16.058 INFO:teuthology.kill:2022-07-03 11:41:16,057.057 INFO:teuthology.orchestra.console:Power off for smithi137 completed
2022-07-03T11:41:16.189 INFO:teuthology.kill:2022-07-03 11:41:16,188.188 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2022-07-03T11:41:16.212 INFO:teuthology.kill:2022-07-03 11:41:16,212.212 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com
2022-07-03T11:43:16.572 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-03T11:43:16.698 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-01_05:17:04-krbd-pacific-testing-default-smithi/6908599
2022-07-03T11:43:16.698 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi137 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-01_05:17:04-krbd-pacific-testing-default-smithi/6908599