2022-04-28T08:59:30.733 INFO:root:teuthology version: 1.1.1.dev326+g135488ac
2022-04-28T08:59:30.859 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging
2022-04-28T08:59:30.859 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server
2022-04-28T08:59:30.860 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2022-04-28T08:59:30.879 INFO:teuthology.lock.ops:Node 'smithi134.front.sepia.ceph.com' reimaging is complete
2022-04-28T08:59:30.879 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2022-04-28T08:59:30.880 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2022-04-28T08:59:30.880 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2022-04-28T08:59:30.899 INFO:teuthology.lock.ops:Node 'smithi145.front.sepia.ceph.com' reimaging is complete
2022-04-28T08:59:31.107 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.stream
2022-04-28T08:59:31.127 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.stream
2022-04-28T08:59:31.463 INFO:teuthology.orchestra.console:Power off smithi134
2022-04-28T08:59:31.475 INFO:teuthology.orchestra.console:Power off smithi145
2022-04-28T08:59:31.602 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2022-04-28T08:59:31.616 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2022-04-28T08:59:31.703 INFO:teuthology.orchestra.console:Power on smithi134
2022-04-28T08:59:31.736 INFO:teuthology.orchestra.console:Power on smithi145
2022-04-28T08:59:40.064 INFO:teuthology.orchestra.console:Power on for smithi134 completed
2022-04-28T08:59:40.096 INFO:teuthology.orchestra.console:Power on for smithi145 completed
2022-04-28T08:59:40.165 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2022-04-28T08:59:40.196 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2022-04-28T09:03:46.645 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-28T09:04:11.653 INFO:teuthology.provision.fog.smithi145:Node is ready
2022-04-28T09:04:11.674 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2022-04-28T09:04:11.731 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2022-04-28T09:04:12.112 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2022-04-28T09:04:21.161 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-04-28T09:04:21.437 INFO:teuthology.provision.fog.smithi134:Node is ready
2022-04-28T09:04:21.454 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2022-04-28T09:04:21.512 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2022-04-28T09:04:21.859 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2022-04-28T09:04:22.011 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2022-04-28T09:04:22.012 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-28T09:04:22.031 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2022-04-28T09:04:22.032 INFO:teuthology.lock.ops:New key found. Updating...
2022-04-28T09:04:22.052 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2022-04-28T09:04:22.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2022-04-28T09:04:22.262 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2022-04-28T09:04:22.318 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2022-04-28T09:04:22.319 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-28T09:04:22.320 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-28T09:04:22.320 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-28T09:04:22.321 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2022-04-28T09:04:22.340 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2022-04-28T09:04:22.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2022-04-28T09:04:22.625 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2022-04-28T09:04:22.682 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream"
2022-04-28T09:04:22.700 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8"
2022-04-28T09:04:22.700 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos"
2022-04-28T09:04:22.700 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora"
2022-04-28T09:04:22.700 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8"
2022-04-28T09:04:22.701 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8"
2022-04-28T09:04:22.701 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8"
2022-04-28T09:04:22.701 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2022-04-28T09:04:22.701 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-04-28T09:04:22.701 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/"
2022-04-28T09:04:22.701 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-04-28T09:04:22.701 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-04-28T09:04:22.701 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-04-28T09:04:22.702 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2022-04-28T09:04:22.803 INFO:teuthology.dispatcher.supervisor:Running job 6809245
2022-04-28T09:04:22.803 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-04-27_15:24:52-fs-wip-vshankar-testing1-20220427-145314-testing-default-smithi/6809245 --name vshankar-2022-04-27_15:24:52-fs-wip-vshankar-testing1-20220427-145314-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/vshankar-2022-04-27_15:24:52-fs-wip-vshankar-testing1-20220427-145314-testing-default-smithi/6809245/orig.config.yaml
2022-04-28T09:04:22.806 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-04-27_15:24:52-fs-wip-vshankar-testing1-20220427-145314-testing-default-smithi/6809245
2022-04-28T09:04:22.807 INFO:teuthology.dispatcher.supervisor:Job PID: 28433
2022-04-28T09:04:22.807 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-04-28T15:34:52.782 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-04-28T15:34:52.992 INFO:teuthology.kill:Killing Pids: {28433}
2022-04-28T15:34:54.436 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2022-04-28T15:34:54.437 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2022-04-28T15:34:54.437 INFO:teuthology.misc:Compressing logs...
2022-04-28T15:34:54.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2022-04-28T15:35:09.499 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2022-04-28T15:35:09.503 ERROR:paramiko.transport:Traceback (most recent call last):
2022-04-28T15:35:09.503 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2278, in _check_banner
2022-04-28T15:35:09.503 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2022-04-28T15:35:09.503 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2022-04-28T15:35:09.503 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2022-04-28T15:35:09.503 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 622, in _read_timeout
2022-04-28T15:35:09.503 ERROR:paramiko.transport:    raise socket.timeout()
2022-04-28T15:35:09.503 ERROR:paramiko.transport:socket.timeout
2022-04-28T15:35:09.504 ERROR:paramiko.transport:
2022-04-28T15:35:09.504 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2022-04-28T15:35:09.504 ERROR:paramiko.transport:
2022-04-28T15:35:09.504 ERROR:paramiko.transport:Traceback (most recent call last):
2022-04-28T15:35:09.504 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2101, in run
2022-04-28T15:35:09.504 ERROR:paramiko.transport:    self._check_banner()
2022-04-28T15:35:09.504 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2283, in _check_banner
2022-04-28T15:35:09.504 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2022-04-28T15:35:09.505 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2022-04-28T15:35:09.505 ERROR:paramiko.transport:
2022-04-28T15:35:09.505 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/teuthology/dispatcher/supervisor.py", line 346, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/teuthology/misc.py", line 1378, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/teuthology/orchestra/remote.py", line 509, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi134
2022-04-28T15:35:09.579 INFO:teuthology.kill:No teuthology processes running
2022-04-28T15:35:10.897 INFO:teuthology.kill:Nuking machines: ['smithi134', 'smithi145']
2022-04-28T15:35:12.118 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-04-28T15:35:12.119 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-04-28T15:35:12.119 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-04-28T15:35:12.119 INFO:teuthology.kill:  "class": algorithms.Blowfish,
2022-04-28T15:35:12.119 INFO:teuthology.kill:2022-04-28 15:35:12,118.118 INFO:teuthology.nuke:targets:
2022-04-28T15:35:12.119 INFO:teuthology.kill:  smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCleMPGEglfeGqugUqsuhiJCuzjigTjOxWjB1wlIB4hgCbjJXiWwXQtUUJoo27y8n7SWoXpzptuk54uQpEo78zgLa7EqqFosDnA9Us+F4MtePmamwnCdeTwtUOIQf1bbZ3SaJtIT4TJv4Ysrsr1QZYwBzubXIePdr3u/GbUIafCHa8Ux4ganXjRLnnHD0UI0nNdiuUOnAHulNCqnvT/IGB6QU95Hfi4QagCsqQzKCHt1/IapzwH5yk5/OKZEccWQIRrg13ptERzYOTaNB/H0U6MfffPBMHOsLG8HraaZsO2KV+PMYawTQ6cZeKq6tLstwids+/JYNmWCBQhBmkymOYfDb6a255nx51sxpLT/NdJo95SPCETobMbp2qGg33oZfuPlvUMC8fVsVjqlE+A0MpmAEgWH3fy9J9uMOCFmUwAWMyRySL89hWtXp6KUkLtp8Stfv5dF8FLsmi9GjjBBQGI91GJfJxuFQIPGaCxAKeg6yReXJlLuft5HrsO1mE5ba0=
2022-04-28T15:35:12.119 INFO:teuthology.kill:  smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDetiHu/N92szRClAWS2lYULF7CmgH79aO0sxa2+7/DTgLN3gqw7gQnJrke7Pv66PPhiT0BSnKsvNhuR41tWEtqJ/GUJnVbpjz6Q3OC+QIL1wUyt2sdwPdItDyBu+jl6fy3bzrPyZooxQeXGrHsmYMYVEHvB9y+qSR4f5Mhoh1VUAxUTVfCTkXsdsiIhGP9336FJ8sDR+Iaeew8g//kKDvphL0+gKMA0GWMJvfB87u09kYq65HCDc46S4aqSKehnGaSbrb++2jvpWpbzuuVI9IEXChYvwuAy88nebeXT8FyjX9mwRoqyFYuJOPq3Zgiwng9n3Y93CX5Vq2pdDVKwGnLQIHZtxo54mlx2pG2UYRUyDGF/QKg8MCDbapA6VF3VXPiQjjpWdkLECD62U2jXVTPSzGOIBsp94HImqZD8KOAbo4f+PEQpALpGqU4aX7ygQRjZWB7mits4a358KaxzF98rGQGJi+tMav57pYq8Fp1iOsKq0fgA06+Vz+ZPgzkJfU=
2022-04-28T15:35:12.145 INFO:teuthology.kill:2022-04-28 15:35:12,145.145 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-28T15:35:12.150 INFO:teuthology.kill:2022-04-28 15:35:12,150.150 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-04-28T15:35:12.223 INFO:teuthology.kill:2022-04-28 15:35:12,223.223 INFO:teuthology.orchestra.console:Power off smithi145
2022-04-28T15:35:12.235 INFO:teuthology.kill:2022-04-28 15:35:12,235.235 INFO:teuthology.orchestra.console:Power off smithi134
2022-04-28T15:35:20.583 INFO:teuthology.kill:2022-04-28 15:35:20,582.582 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2022-04-28T15:35:20.590 INFO:teuthology.kill:2022-04-28 15:35:20,590.590 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2022-04-28T15:35:20.733 INFO:teuthology.kill:2022-04-28 15:35:20,732.732 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com
2022-04-28T15:35:20.736 INFO:teuthology.kill:2022-04-28 15:35:20,736.736 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com
2022-04-28T15:37:21.060 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-04-28T15:37:21.178 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi134 but it was locked by another job: /home/teuthworker/archive/nmordech-2022-04-28_14:49:38-rados:verify-wip-nm-53582-distro-default-smithi/6811281
2022-04-28T15:37:21.178 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi145 but it was locked by another job: /home/teuthworker/archive/nmordech-2022-04-28_14:49:38-rados:verify-wip-nm-53582-distro-default-smithi/6811281