2022-07-02T21:26:28.685 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-02T21:26:28.868 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2022-07-02T21:26:28.870 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2022-07-02T21:26:28.871 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2022-07-02T21:26:28.898 INFO:teuthology.lock.ops:Node 'smithi037.front.sepia.ceph.com' reimaging is complete
2022-07-02T21:26:28.898 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging
2022-07-02T21:26:28.899 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server
2022-07-02T21:26:28.899 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2022-07-02T21:26:28.929 INFO:teuthology.lock.ops:Node 'smithi188.front.sepia.ceph.com' reimaging is complete
2022-07-02T21:26:29.133 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream
2022-07-02T21:26:29.151 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 8.stream
2022-07-02T21:26:29.468 INFO:teuthology.orchestra.console:Power off smithi037
2022-07-02T21:26:29.486 INFO:teuthology.orchestra.console:Power off smithi188
2022-07-02T21:26:41.971 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2022-07-02T21:26:41.977 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2022-07-02T21:26:42.073 INFO:teuthology.orchestra.console:Power on smithi037
2022-07-02T21:26:42.080 INFO:teuthology.orchestra.console:Power on smithi188
2022-07-02T21:26:46.331 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2022-07-02T21:26:46.432 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2022-07-02T21:26:50.453 INFO:teuthology.orchestra.console:Power on for smithi188 completed
2022-07-02T21:26:50.555 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2022-07-02T21:29:21.555 ERROR:teuthology.orchestra.connection:Error authenticating with smithi188.front.sepia.ceph.com: Authentication failed.
2022-07-02T21:30:26.048 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-02T21:30:46.815 INFO:teuthology.provision.fog.smithi037:Node is ready
2022-07-02T21:30:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2022-07-02T21:30:46.899 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2022-07-02T21:30:47.298 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2022-07-02T21:31:02.249 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-02T21:31:27.522 INFO:teuthology.provision.fog.smithi188:Node is ready
2022-07-02T21:31:27.558 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2022-07-02T21:31:27.618 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2022-07-02T21:31:28.031 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2022-07-02T21:31:28.261 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2022-07-02T21:31:28.263 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-02T21:31:28.333 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2022-07-02T21:31:28.334 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-02T21:31:28.381 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2022-07-02T21:31:28.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2022-07-02T21:31:28.726 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2022-07-02T21:31:28.795 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2022-07-02T21:31:28.796 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8"
2022-07-02T21:31:28.796 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2022-07-02T21:31:28.796 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2022-07-02T21:31:28.797 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8"
2022-07-02T21:31:28.797 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2022-07-02T21:31:28.798 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-02T21:31:28.798 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2022-07-02T21:31:28.799 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-02T21:31:28.799 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2022-07-02T21:31:28.799 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-02T21:31:28.799 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-02T21:31:28.800 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-02T21:31:28.801 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2022-07-02T21:31:28.828 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2022-07-02T21:31:28.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2022-07-02T21:31:29.084 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2022-07-02T21:31:29.141 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2022-07-02T21:31:29.142 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8"
2022-07-02T21:31:29.142 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2022-07-02T21:31:29.142 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2022-07-02T21:31:29.143 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8"
2022-07-02T21:31:29.143 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2022-07-02T21:31:29.143 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-02T21:31:29.143 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2022-07-02T21:31:29.144 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-02T21:31:29.144 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2022-07-02T21:31:29.144 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-02T21:31:29.144 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-02T21:31:29.145 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-02T21:31:29.145 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2022-07-02T21:31:29.292 INFO:teuthology.dispatcher.supervisor:Running job 6910561
2022-07-02T21:31:29.293 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910561 --name rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910561/orig.config.yaml
2022-07-02T21:31:29.303 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910561
2022-07-02T21:31:29.305 INFO:teuthology.dispatcher.supervisor:Job PID: 25371
2022-07-02T21:31:29.305 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-03T09:31:54.263 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-03T09:31:54.455 INFO:teuthology.kill:Killing Pids: {25371}
2022-07-03T09:31:55.900 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-07-03T09:31:55.901 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-07-03T09:31:55.901 INFO:teuthology.misc:Compressing logs...
2022-07-03T09:31:55.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2022-07-03T09:31:57.594 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/remote.py", line 509, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi037
2022-07-03T09:31:57.665 INFO:teuthology.kill:No teuthology processes running
2022-07-03T09:31:58.975 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi188']
2022-07-03T09:32:00.080 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-03T09:32:00.082 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-03T09:32:00.082 INFO:teuthology.kill:2022-07-03 09:32:00,080.080 INFO:teuthology.nuke:targets:
2022-07-03T09:32:00.082 INFO:teuthology.kill:  smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPFEv1Y0yyj9pCWzHzZSxoQ4o68SvYe8JpEsPoQqEeN7uI0Fl9UDo42OMThLQhjiTbFmye9hcbV5BgiG1efMdb6Tl5PV5yz3AKJ/vid8KaoUukEmtWy3eDkIkEuazx6gj40pz4jXWkuZ1Uu+oGA4Wd39XFPsVQaSm7IDd+ngmzsWUWX7fQxQX6hqDsVY9Wh2J8s1cSeoOEQLvKEbYk2w3SWA70qA3vRzdXRlWHmQd0H/qAc3C8zUms1yoYtkoUEVXntSCqmhlxchqIHikBjrOGFKFi1kaeg+wCeHod1a55+xC+W0665smfQnTBBSvyIrN0TKLbHBZjuyVCWIgV9Et4fVpiEo88eC61wwHZfev9mEpS/vPX+zgLiP5CS8aiwmSxhGX3wekSKWjg36a2+VO+RTCgM4P/Dm/6kJegpYqfaVZNB11C3p9hKgfoHw7zO0a2F2lHshw3POeyb/B0IMcy7m/nUQwUByBhEL2nM6y8cN/vOsZm91CRyia1AbC06hc=
2022-07-03T09:32:00.083 INFO:teuthology.kill:  smithi188.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCowdB+H2+SCqeg5G4jvaZIQvn3SrWqi6Fu2LkpRgTxv42xdZ9fzTjCN+CghA1yGg+EnY4SSEUhJcwEVU2SsAHIeHImKm0Fp552WF+Q8oKJEZ3IfGjLoRO5IK1me0++lrxMEZ5wyAF05bsuKZQeW8SWjroUdSkYZRhelHRu68XyxYI7M/rwWpDTqucHphBI5/e76YUf+tx4uR2D8856kmLLlM/SNUf3Hk9U6atLdXNEPf8uXpkFdLWMw/avVvBHpM1HGOYP2QzXCxtkHPVRtned0uw3jKEcCGxoMY6xC1KHJ6U4s/LwHXIsjioVSmj8Ay1Cqt0TiFvek/+BxZ5qFqtjmpFjtPnupX02cduXXXPUNG2smrSCcb6vx4feXledgrRFRtdzrlPJfNWG5+oORBj5oLLm9LzD6+YFZJMZ3GY+KweVziGBmwYnUj3NBuWvyDTnUzNAnNnmmg8PnWb0rUVX7Sjmb53mQeCgzM7eLmkYabGzNOGkx4HfP3/GAZZi308=
2022-07-03T09:32:00.083 INFO:teuthology.kill:2022-07-03 09:32:00,080.080 INFO:teuthology.nuke:Checking targets against current locks
2022-07-03T09:32:00.136 INFO:teuthology.kill:2022-07-03 09:32:00,136.136 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-03T09:32:00.158 INFO:teuthology.kill:2022-07-03 09:32:00,158.158 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-03T09:32:00.219 INFO:teuthology.kill:2022-07-03 09:32:00,219.219 INFO:teuthology.orchestra.console:Power off smithi037
2022-07-03T09:32:00.255 INFO:teuthology.kill:2022-07-03 09:32:00,255.255 INFO:teuthology.orchestra.console:Power off smithi188
2022-07-03T09:32:08.594 INFO:teuthology.kill:2022-07-03 09:32:08,593.593 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2022-07-03T09:32:08.745 INFO:teuthology.kill:2022-07-03 09:32:08,745.745 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com
2022-07-03T09:32:12.732 INFO:teuthology.kill:2022-07-03 09:32:12,731.731 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2022-07-03T09:32:12.879 INFO:teuthology.kill:2022-07-03 09:32:12,879.879 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com
2022-07-03T09:34:13.151 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-03T09:34:13.264 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi037 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910839
2022-07-03T09:34:13.265 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi188 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910841