2022-07-03T15:49:46.813 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-03T15:49:46.976 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging
2022-07-03T15:49:46.977 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server
2022-07-03T15:49:46.977 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2022-07-03T15:49:46.999 INFO:teuthology.lock.ops:Node 'smithi008.front.sepia.ceph.com' reimaging is complete
2022-07-03T15:49:47.000 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging
2022-07-03T15:49:47.000 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server
2022-07-03T15:49:47.000 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2022-07-03T15:49:47.022 INFO:teuthology.lock.ops:Node 'smithi077.front.sepia.ceph.com' reimaging is complete
2022-07-03T15:49:47.209 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream
2022-07-03T15:49:47.238 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 8.stream
2022-07-03T15:49:47.517 INFO:teuthology.orchestra.console:Power off smithi008
2022-07-03T15:49:47.562 INFO:teuthology.orchestra.console:Power off smithi077
2022-07-03T15:49:55.899 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2022-07-03T15:49:56.000 INFO:teuthology.orchestra.console:Power on smithi008
2022-07-03T15:50:00.036 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2022-07-03T15:50:00.138 INFO:teuthology.orchestra.console:Power on smithi077
2022-07-03T15:50:04.389 INFO:teuthology.orchestra.console:Power on for smithi077 completed
2022-07-03T15:50:04.459 INFO:teuthology.orchestra.console:Power on for smithi008 completed
2022-07-03T15:50:04.491 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2022-07-03T15:50:04.560 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish
2022-07-03T15:54:33.358 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-03T15:54:33.662 INFO:teuthology.provision.fog.smithi008:Node is ready
2022-07-03T15:54:33.683 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com
2022-07-03T15:54:33.743 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008
2022-07-03T15:54:34.104 INFO:teuthology.provision.fog.smithi008:Deploy complete!
2022-07-03T15:54:48.320 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-03T15:54:48.579 INFO:teuthology.provision.fog.smithi077:Node is ready
2022-07-03T15:54:48.598 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2022-07-03T15:54:48.658 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2022-07-03T15:54:48.995 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2022-07-03T15:54:49.170 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com
2022-07-03T15:54:49.171 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-03T15:54:49.194 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2022-07-03T15:54:49.195 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-03T15:54:49.216 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server
2022-07-03T15:54:49.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2022-07-03T15:54:49.488 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64
2022-07-03T15:54:49.554 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream"
2022-07-03T15:54:49.554 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8"
2022-07-03T15:54:49.555 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos"
2022-07-03T15:54:49.555 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora"
2022-07-03T15:54:49.555 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8"
2022-07-03T15:54:49.555 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8"
2022-07-03T15:54:49.556 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-03T15:54:49.556 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31"
2022-07-03T15:54:49.556 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-03T15:54:49.557 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/"
2022-07-03T15:54:49.557 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-03T15:54:49.557 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-03T15:54:49.557 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-03T15:54:49.559 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server
2022-07-03T15:54:49.584 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2022-07-03T15:54:49.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2022-07-03T15:54:49.798 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2022-07-03T15:54:49.855 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream"
2022-07-03T15:54:49.856 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8"
2022-07-03T15:54:49.856 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos"
2022-07-03T15:54:49.856 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora"
2022-07-03T15:54:49.856 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8"
2022-07-03T15:54:49.857 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8"
2022-07-03T15:54:49.857 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-03T15:54:49.857 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2022-07-03T15:54:49.858 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-03T15:54:49.858 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/"
2022-07-03T15:54:49.859 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-03T15:54:49.859 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-03T15:54:49.859 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-03T15:54:49.860 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2022-07-03T15:54:49.978 INFO:teuthology.dispatcher.supervisor:Running job 6911885
2022-07-03T15:54:49.978 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2022-07-03_15:10:28-fs-wip-rishabh-testing-20220702-1631-distro-default-smithi/6911885 --name rishabh-2022-07-03_15:10:28-fs-wip-rishabh-testing-20220702-1631-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} -- /home/teuthworker/archive/rishabh-2022-07-03_15:10:28-fs-wip-rishabh-testing-20220702-1631-distro-default-smithi/6911885/orig.config.yaml
2022-07-03T15:54:49.983 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2022-07-03_15:10:28-fs-wip-rishabh-testing-20220702-1631-distro-default-smithi/6911885
2022-07-03T15:54:49.984 INFO:teuthology.dispatcher.supervisor:Job PID: 25353
2022-07-03T15:54:49.985 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-04T03:55:46.735 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-04T03:55:46.921 INFO:teuthology.kill:Killing Pids: {25353}
2022-07-04T03:55:48.306 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2022-07-04T03:55:48.307 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2022-07-04T03:55:48.307 INFO:teuthology.misc:Compressing logs...
2022-07-04T03:55:48.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com'
2022-07-04T03:55:50.046 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/remote.py", line 509, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi008
2022-07-04T03:55:50.120 INFO:teuthology.kill:No teuthology processes running
2022-07-04T03:55:51.627 INFO:teuthology.kill:Nuking machines: ['smithi008', 'smithi077']
2022-07-04T03:55:52.770 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-04T03:55:52.771 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-04T03:55:52.772 INFO:teuthology.kill:2022-07-04 03:55:52,769.769 INFO:teuthology.nuke:targets:
2022-07-04T03:55:52.772 INFO:teuthology.kill:  smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWQzhSFHN2BdXWVcazTn1hkQtSpvQ0/IA/dR51lQtv3UhjNe/5tOejizC+WfKdYWfkY9fx7nz5WO9fzwxY3E+E0nPqvhoeTdCJ65yKsy6ZL1/71L8Ng02NGkr5058LYc8O3dkUczy92jSHCoPd8+JImG9DUijlzWZ1OKkkZdjC9Ya2nbzD2O8lChFzjgf9fazX61PK0DAjZPd/2h/u2590K2v7/xWWaM6lf/AkB0hWiyAalp51Z9lEqe1Q+h/qpPI+SXmxwPybqxQvDNin3jT/sQzyldC2E3fbYIjxgTDDLFqN4loJCy3DgHpznZqo2JdQ0928Ql6FA+kX5ZD8XuUFGPY/Dj8rqUsLp1z+x7PqPeKhHwpf2H6uL3vQALH2HnFukWgMR7gA2UVGqAasuJ4jmyMaVq9rLSxlQUNfF1sgWgUC9wlrr1xguaCAv1GK22aC30cOz1niYaIL19XlqDKjf+yPhb3vdmii/ooCwB0+Q9wMQTr5kU4x9Oi6qomTWLs=
2022-07-04T03:55:52.773 INFO:teuthology.kill:  smithi077.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr2HPQbst37lrCPlmexbYUXXEDZ3zXkp0kHeO0WveOjUMXD5bSzuyA87ePa8smlBhy2mhuw02Clx0blDSA7kC9TUY2BtpvBsuRxgRiEQj2m/iXQqC1kvwe+prX5ZcuNn6Q/VbSS1lrN4L/G8y9Iygg5bDsft7sj+o0NX2wP8QluXBhKVVQ9qtbncSZic3ZahntrxyiK7+7mpWrAGQWtiOc85ybH8mbqz+Akg/oZG1eKumhB0ernZ46cVzSAghoLKJ2REmG+/pVQTl5BhpYqaDkOF5rMQGaeyFArzBjSKw9aHbGaNlVXZkJ4dBJ42jFdEzdz2nNFnxqCdb37IIoXAwO4YljnOKU77sViXzbhdI+AsAOcgKqO1dlzhKl88x7fhRPNLT9vr3UmsUkO60aPNJYUdDzjh+ZAvYULnAfebZEUrNLHjgX0tVBpCDthG99oLy9DqehMPGi46kaitGvDaBVP/p8K7wHk03HrD+TNvTrW30IsGeJRtMrIP6USAH8B7M=
2022-07-04T03:55:52.773 INFO:teuthology.kill:2022-07-04 03:55:52,770.770 INFO:teuthology.nuke:Checking targets against current locks
2022-07-04T03:55:52.826 INFO:teuthology.kill:2022-07-04 03:55:52,826.826 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-04T03:55:52.851 INFO:teuthology.kill:2022-07-04 03:55:52,851.851 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-04T03:55:52.922 INFO:teuthology.kill:2022-07-04 03:55:52,921.921 INFO:teuthology.orchestra.console:Power off smithi008
2022-07-04T03:55:52.945 INFO:teuthology.kill:2022-07-04 03:55:52,944.944 INFO:teuthology.orchestra.console:Power off smithi077
2022-07-04T03:56:01.310 INFO:teuthology.kill:2022-07-04 03:56:01,310.310 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2022-07-04T03:56:01.469 INFO:teuthology.kill:2022-07-04 03:56:01,468.468 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com
2022-07-04T03:56:05.415 INFO:teuthology.kill:2022-07-04 03:56:05,415.415 INFO:teuthology.orchestra.console:Power off for smithi008 completed
2022-07-04T03:56:05.575 INFO:teuthology.kill:2022-07-04 03:56:05,575.575 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com
2022-07-04T03:58:05.942 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-04T03:58:06.079 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911171
2022-07-04T03:58:06.079 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi077 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-03_03:31:04-rados-pacific-distro-default-smithi/6911171