2022-08-24T14:42:46.108 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1
2022-08-24T14:42:46.309 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2022-08-24T14:42:46.339 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2022-08-24T14:42:46.339 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-08-24T14:42:46.363 INFO:teuthology.lock.ops:Node 'smithi099.front.sepia.ceph.com' reimaging is complete
2022-08-24T14:42:46.363 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2022-08-24T14:42:46.364 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2022-08-24T14:42:46.364 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-08-24T14:42:46.387 INFO:teuthology.lock.ops:Node 'smithi136.front.sepia.ceph.com' reimaging is complete
2022-08-24T14:42:46.608 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream
2022-08-24T14:42:46.641 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.stream
2022-08-24T14:42:47.171 INFO:teuthology.orchestra.console:Power off smithi099
2022-08-24T14:42:47.213 INFO:teuthology.orchestra.console:Power off smithi136
2022-08-24T14:42:55.686 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-08-24T14:42:55.803 INFO:teuthology.orchestra.console:Power on smithi136
2022-08-24T14:42:59.808 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-08-24T14:42:59.914 INFO:teuthology.orchestra.console:Power on smithi099
2022-08-24T14:43:04.242 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2022-08-24T14:43:04.344 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2022-08-24T14:43:08.350 INFO:teuthology.orchestra.console:Power on for smithi099 completed
2022-08-24T14:43:08.452 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2022-08-24T14:47:36.549 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-24T14:47:36.754 INFO:teuthology.provision.fog.smithi136:Node is ready
2022-08-24T14:47:36.773 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2022-08-24T14:47:36.834 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2022-08-24T14:47:37.195 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2022-08-24T14:47:55.645 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-08-24T14:47:55.852 INFO:teuthology.provision.fog.smithi099:Node is ready
2022-08-24T14:47:55.888 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2022-08-24T14:47:55.950 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2022-08-24T14:47:56.383 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2022-08-24T14:47:56.645 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2022-08-24T14:47:56.646 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-24T14:47:56.672 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2022-08-24T14:47:56.672 INFO:teuthology.lock.ops:New key found. Updating...
2022-08-24T14:47:56.696 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2022-08-24T14:47:56.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2022-08-24T14:47:57.080 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2022-08-24T14:47:57.137 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2022-08-24T14:47:57.137 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2022-08-24T14:47:57.137 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2022-08-24T14:47:57.138 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2022-08-24T14:47:57.138 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2022-08-24T14:47:57.138 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2022-08-24T14:47:57.138 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2022-08-24T14:47:57.139 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2022-08-24T14:47:57.139 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-08-24T14:47:57.139 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2022-08-24T14:47:57.139 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-08-24T14:47:57.139 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-08-24T14:47:57.140 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-08-24T14:47:57.141 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-08-24T14:47:57.174 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2022-08-24T14:47:57.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2022-08-24T14:47:57.489 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2022-08-24T14:47:57.554 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2022-08-24T14:47:57.555 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8"
2022-08-24T14:47:57.555 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2022-08-24T14:47:57.555 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2022-08-24T14:47:57.557 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8"
2022-08-24T14:47:57.557 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2022-08-24T14:47:57.558 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8"
2022-08-24T14:47:57.558 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2022-08-24T14:47:57.559 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-08-24T14:47:57.559 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2022-08-24T14:47:57.559 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-08-24T14:47:57.560 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-08-24T14:47:57.560 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-08-24T14:47:57.561 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2022-08-24T14:47:57.733 INFO:teuthology.dispatcher.supervisor:Running job 6989087
2022-08-24T14:47:57.735 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-08-24_14:12:57-rados-wip-yuri-testing-2022-08-23-1120-quincy-distro-default-smithi/6989087 --name yuriw-2022-08-24_14:12:57-rados-wip-yuri-testing-2022-08-23-1120-quincy-distro-default-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/yuriw-2022-08-24_14:12:57-rados-wip-yuri-testing-2022-08-23-1120-quincy-distro-default-smithi/6989087/orig.config.yaml
2022-08-24T14:47:57.748 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-08-24_14:12:57-rados-wip-yuri-testing-2022-08-23-1120-quincy-distro-default-smithi/6989087
2022-08-24T14:47:57.750 INFO:teuthology.dispatcher.supervisor:Job PID: 31608
2022-08-24T14:47:57.750 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-08-25T02:49:10.441 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-08-25T02:49:11.611 INFO:teuthology.kill:Killing Pids: {31608}
2022-08-25T02:49:14.779 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-08-25T02:49:14.785 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-08-25T02:49:14.792 INFO:teuthology.misc:Compressing logs...
2022-08-25T02:49:14.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2022-08-25T02:49:15.337 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/teuthology/dispatcher/supervisor.py", line 290, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/teuthology/dispatcher/supervisor.py", line 348, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/teuthology/misc.py", line 1383, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/teuthology/orchestra/remote.py", line 509, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi099
2022-08-25T02:49:15.423 INFO:teuthology.kill:No teuthology processes running
2022-08-25T02:49:17.592 INFO:teuthology.kill:Nuking machines: ['smithi099', 'smithi136']
2022-08-25T02:49:19.623 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b1d387f12b117399cb87c86aaa341398fa0c0919/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-08-25T02:49:19.624 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-08-25T02:49:19.624 INFO:teuthology.kill:2022-08-25 02:49:19,620.620 INFO:teuthology.nuke:targets:
2022-08-25T02:49:19.624 INFO:teuthology.kill:  smithi099.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEhaw7EBOabH15VZkuPuoondnwjrVbbI8Rw3r2yX38XOfVJJHZI/8Edo8NeIzQtJFjl/ypwNMFIVKHsI/SS5rmC7KaaULBoX3bRSlihbgv4hpj20gPhBYzcV4yan3yYkO2BS7FcpbdY/SCj3gvPZniBLfPmCrEbO+5ee+bfcXxnNN68h4DaQe6kKgbRv3nWWu5juBLMXxvumiLUFiINqO8eyamYIcsxTMLZOFMdIieGbgKYqkfyvqj6VGza+64Xfo4hGoqZzKfyc6JjQvYAKUNsRZnsJg1TeBzoe3ge4joCnfvsm+alVOd0loGdIg5UDhtGCYt7v43/5MqO4pvMLspOu8svsuo1BXtdkZXcjVu/Ngu27gaHiSciESQsP+VjfN/zAlaZSPsq5iLqCiYifRLeckJDOQRbt6YH4hd5/6wVP9oNodf6m1tMDAy64Et4q65STPII0u3JLYuSb7l/fPZIsb6YK382zB5htFyAMiFGc6nuRsUiGHP7On0RCVRsH8=
2022-08-25T02:49:19.626 INFO:teuthology.kill:  smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuDqychuki/KW86WVGAOOy8l2NW0QdRCBVPkKXOk7N3GwdYvC+kX5QIRC3MNehex3Babi5bNzLS9kFelFRH26/6fu8p3oamR8aHtqHv7YzDaBLR8A0Ah6nynJBq6W9KcMlVQjCk6x+q0vAOSTowV3upQlLVet0e49tRvHRLTMw26L/26YhJ4NuzRrhEB7Ts2nDPj0yANBP7KwQJZgZBRVekSD0XFE1xPiM54/qAvG05/DbYQr9esajnvl+zU/7EHoZMp3WTWrGFh/aisRCp0TNgUlCtm531n2MiERNDLDxza/MhZDTNuwEkKsjGoKcwxC+Yoo2wgBhk9eaVqL74Vg5Q2+zs/67L1xjCi5NmK4V6WFygm5Kw+YQqnmsBZxZgY0kg+bx1wAS0ysLH5IPvXM7enelA+Bb3L2EF8NAlPMEHEbnDM066776y5hyQnOyzgRfUnUq5QHBJuCeGZb35SI12z5o6oS/sruVuEBnscaoHxmTkpllxHcSTHTmltq47bM=
2022-08-25T02:49:19.627 INFO:teuthology.kill:2022-08-25 02:49:19,620.620 INFO:teuthology.nuke:Checking targets against current locks
2022-08-25T02:49:19.693 INFO:teuthology.kill:2022-08-25 02:49:19,693.693 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-25T02:49:19.722 INFO:teuthology.kill:2022-08-25 02:49:19,721.721 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-08-25T02:49:19.792 INFO:teuthology.kill:2022-08-25 02:49:19,791.791 INFO:teuthology.orchestra.console:Power off smithi099
2022-08-25T02:49:19.854 INFO:teuthology.kill:2022-08-25 02:49:19,843.843 INFO:teuthology.orchestra.console:Power off smithi136
2022-08-25T02:49:28.213 INFO:teuthology.kill:2022-08-25 02:49:28,211.211 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-08-25T02:49:28.268 INFO:teuthology.kill:2022-08-25 02:49:28,268.268 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2022-08-25T02:49:28.388 INFO:teuthology.kill:2022-08-25 02:49:28,385.385 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2022-08-25T02:49:28.440 INFO:teuthology.kill:2022-08-25 02:49:28,438.438 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2022-08-25T02:51:28.897 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-08-25T02:51:29.059 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi099 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-08-24_16:39:47-rados-wip-yuri4-testing-2022-08-24-0707-pacific-distro-default-smithi/6990050
2022-08-25T02:51:29.060 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi136 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-08-24_16:39:47-rados-wip-yuri4-testing-2022-08-24-0707-pacific-distro-default-smithi/6990050