2022-07-02T10:01:11.011 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-07-02T10:01:11.173 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2022-07-02T10:01:11.174 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2022-07-02T10:01:11.175 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2022-07-02T10:01:11.198 INFO:teuthology.lock.ops:Node 'smithi031.front.sepia.ceph.com' reimaging is complete
2022-07-02T10:01:11.199 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2022-07-02T10:01:11.199 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2022-07-02T10:01:11.200 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-07-02T10:01:11.223 INFO:teuthology.lock.ops:Node 'smithi073.front.sepia.ceph.com' reimaging is complete
2022-07-02T10:01:11.419 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6
2022-07-02T10:01:11.442 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.6
2022-07-02T10:01:11.734 INFO:teuthology.orchestra.console:Power off smithi031
2022-07-02T10:01:11.780 INFO:teuthology.orchestra.console:Power off smithi073
2022-07-02T10:01:20.117 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2022-07-02T10:01:20.146 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-07-02T10:01:20.219 INFO:teuthology.orchestra.console:Power on smithi031
2022-07-02T10:01:20.248 INFO:teuthology.orchestra.console:Power on smithi073
2022-07-02T10:01:28.612 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2022-07-02T10:01:28.638 INFO:teuthology.orchestra.console:Power on for smithi073 completed
2022-07-02T10:01:28.714 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2022-07-02T10:01:28.740 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2022-07-02T10:05:42.689 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-02T10:05:42.947 INFO:teuthology.provision.fog.smithi031:Node is ready
2022-07-02T10:05:43.010 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031
2022-07-02T10:05:43.073 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2022-07-02T10:05:43.443 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2022-07-02T10:06:06.865 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-02T10:06:07.146 INFO:teuthology.provision.fog.smithi073:Node is ready
2022-07-02T10:06:07.166 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2022-07-02T10:06:07.226 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2022-07-02T10:06:07.570 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2022-07-02T10:06:07.755 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2022-07-02T10:06:07.756 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-02T10:06:07.778 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2022-07-02T10:06:07.778 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-02T10:06:07.798 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2022-07-02T10:06:07.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2022-07-02T10:06:08.068 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2022-07-02T10:06:08.133 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2022-07-02T10:06:08.134 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)"
2022-07-02T10:06:08.134 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2022-07-02T10:06:08.135 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2022-07-02T10:06:08.135 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6"
2022-07-02T10:06:08.135 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2022-07-02T10:06:08.136 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-07-02T10:06:08.136 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2022-07-02T10:06:08.137 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-07-02T10:06:08.137 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2022-07-02T10:06:08.138 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-02T10:06:08.138 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-02T10:06:08.138 INFO:teuthology.orchestra.run.smithi031.stdout:
2022-07-02T10:06:08.139 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-02T10:06:08.139 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-07-02T10:06:08.139 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-02T10:06:08.140 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-07-02T10:06:08.142 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2022-07-02T10:06:08.166 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2022-07-02T10:06:08.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2022-07-02T10:06:08.374 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2022-07-02T10:06:08.434 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux"
2022-07-02T10:06:08.435 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)"
2022-07-02T10:06:08.435 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel"
2022-07-02T10:06:08.435 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora"
2022-07-02T10:06:08.435 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6"
2022-07-02T10:06:08.436 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2022-07-02T10:06:08.436 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2022-07-02T10:06:08.436 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2022-07-02T10:06:08.436 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2022-07-02T10:06:08.437 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/"
2022-07-02T10:06:08.437 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-07-02T10:06:08.437 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-02T10:06:08.437 INFO:teuthology.orchestra.run.smithi073.stdout:
2022-07-02T10:06:08.438 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-02T10:06:08.438 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2022-07-02T10:06:08.439 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-07-02T10:06:08.439 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2022-07-02T10:06:08.440 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2022-07-02T10:06:08.555 INFO:teuthology.dispatcher.supervisor:Running job 6910344
2022-07-02T10:06:08.556 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/bin/teuthology -v --owner scheduled_nshelke@teuthology --archive /home/teuthworker/archive/nshelke-2022-07-02_08:28:15-fs:volumes-wip-nshelke-in-progress-clone-testing-distro-default-smithi/6910344 --name nshelke-2022-07-02_08:28:15-fs:volumes-wip-nshelke-in-progress-clone-testing-distro-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} -- /home/teuthworker/archive/nshelke-2022-07-02_08:28:15-fs:volumes-wip-nshelke-in-progress-clone-testing-distro-default-smithi/6910344/orig.config.yaml
2022-07-02T10:06:08.561 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nshelke-2022-07-02_08:28:15-fs:volumes-wip-nshelke-in-progress-clone-testing-distro-default-smithi/6910344
2022-07-02T10:06:08.562 INFO:teuthology.dispatcher.supervisor:Job PID: 3223
2022-07-02T10:06:08.563 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-02T22:07:07.915 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-02T22:07:08.095 INFO:teuthology.kill:Killing Pids: {3223}
2022-07-02T22:07:09.826 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2']
2022-07-02T22:07:09.828 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']
2022-07-02T22:07:09.828 INFO:teuthology.misc:Compressing logs...
2022-07-02T22:07:09.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2022-07-02T22:07:11.194 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/teuthology/orchestra/remote.py", line 509, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi031
2022-07-02T22:07:11.307 INFO:teuthology.kill:No teuthology processes running
2022-07-02T22:07:12.985 INFO:teuthology.kill:Nuking machines: ['smithi031', 'smithi073']
2022-07-02T22:07:14.269 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_f58709e3fda190343157063e5edb0d7a36a41afc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-02T22:07:14.270 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-02T22:07:14.270 INFO:teuthology.kill:2022-07-02 22:07:14,269.269 INFO:teuthology.nuke:targets:
2022-07-02T22:07:14.271 INFO:teuthology.kill:  smithi031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGnvWWVQeD1mQ1iMUs99/qSaZilGumfidBmtbn6Z/+FaBl9uwrGVSrZ9PyTVd8YYEu4+xBQbnsP3JAKzkkJ1IrLRE5C52Tgzd8K05gApPIdZ7bXdIPRvgfwqM4gkj7852f2QMLRS6fbNHx9APQAfc8gZowkwU4mij5NArqb/qijgSTgbASeJEwtYCURK5pXViZ/7WeHz7oo52fd6QEJ2AYuQizifvr4ue/l4iwGLs53Y7r5JG9HTUGX+VV4wG8DbTx4CeXtj4d0jj59ZX07snjINw72rL/gpwsCMEB5a7o9GChEU/kuN0z3K4jAxloEWm40iV9QYLyWALLMHSoKSUrpdk+5Oko7zZC5SBanbE1L1+dfJM0hH5ELSP4mxZ5eaPXLRo+0PGGwF7SpWh3ary5Eu4X+AqzzycD4UXiyp3B9OhXlwtQmefK0HpF9umgGKbfCprfMQ15yLn/DUeQ3yToQtfuEJNwaKh6Z2kdHidAW6eRUPC7svrfvfc375t1b3c=
2022-07-02T22:07:14.271 INFO:teuthology.kill:  smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNiYaSmvRHaxGHDds+nNGsn6CFaDU+/zVz8s3vwYAuf2mjlXFxWN+9FYnorGG3Ad1Zp33Gg/OLCzBKdFl+WrC4MA/qTr0DU8+z8styiyG3x7d+OnMom9pHQrf9JgVCZBFOoXYTSIh5TFi7Q641aSh/Sy0GtzQ34lMDkw4+OhZ45uiPcN7VFqEPE0iNpDQbz/+EioCyM+jTSiXzSBhpOxxRj5mNffmRglz61t98u7/tGxAB/yGpo0ApuJnmWB2YQiJqS2khu88lH7r6FFDUNdQbvTPX8BVs0LF/9NBiHObC07bx0adiPWgHLVUDIGg1ZUlj0i+E/VOZCpo19UWk5u1L/1KOLWAEyeLux5hNthcsNR5AGQ+TRHSWmZ8j5EB+xpHPGb9LcmCAbzl2PyMjngbA+GJxfVxo6bLc1KcWTVhxG1TT/KCLpXooypYyhm3kGZYFZM3q9jXcj6df80VIoT+qlPyniBksaiJb7qsdck+EzYlpFvUg+WJVofFBavhHe/E=
2022-07-02T22:07:14.271 INFO:teuthology.kill:2022-07-02 22:07:14,270.270 INFO:teuthology.nuke:Checking targets against current locks
2022-07-02T22:07:14.336 INFO:teuthology.kill:2022-07-02 22:07:14,336.336 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-02T22:07:14.380 INFO:teuthology.kill:2022-07-02 22:07:14,379.379 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-02T22:07:14.466 INFO:teuthology.kill:2022-07-02 22:07:14,465.465 INFO:teuthology.orchestra.console:Power off smithi031
2022-07-02T22:07:14.515 INFO:teuthology.kill:2022-07-02 22:07:14,515.515 INFO:teuthology.orchestra.console:Power off smithi073
2022-07-02T22:07:22.900 INFO:teuthology.kill:2022-07-02 22:07:22,897.897 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2022-07-02T22:07:23.067 INFO:teuthology.kill:2022-07-02 22:07:23,066.066 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com
2022-07-02T22:07:26.973 INFO:teuthology.kill:2022-07-02 22:07:26,973.973 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2022-07-02T22:07:27.128 INFO:teuthology.kill:2022-07-02 22:07:27,127.127 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2022-07-02T22:09:27.593 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-02T22:09:27.776 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi031 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910595
2022-07-02T22:09:27.777 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/rishabh-2022-07-02_14:14:52-fs-wip-rishabh-testing-20220702-1631-testing-default-smithi/6910595