2023-04-24T15:38:46.596 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae
2023-04-24T15:38:46.742 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging
2023-04-24T15:38:46.743 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server
2023-04-24T15:38:46.743 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2023-04-24T15:38:46.772 INFO:teuthology.lock.ops:Node 'smithi012.front.sepia.ceph.com' reimaging is complete
2023-04-24T15:38:46.773 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2023-04-24T15:38:46.773 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2023-04-24T15:38:46.773 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-04-24T15:38:46.797 INFO:teuthology.lock.ops:Node 'smithi105.front.sepia.ceph.com' reimaging is complete
2023-04-24T15:38:46.929 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 8.stream
2023-04-24T15:38:46.957 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream
2023-04-24T15:38:47.146 INFO:teuthology.orchestra.console:Power off smithi012
2023-04-24T15:38:47.164 INFO:teuthology.orchestra.console:Power off smithi105
2023-04-24T15:38:47.297 INFO:teuthology.orchestra.console:Power off for smithi012 completed
2023-04-24T15:38:47.307 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2023-04-24T15:38:47.398 INFO:teuthology.orchestra.console:Power on smithi012
2023-04-24T15:38:47.407 INFO:teuthology.orchestra.console:Power on smithi105
2023-04-24T15:38:55.846 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2023-04-24T15:38:55.879 INFO:teuthology.orchestra.console:Power on for smithi012 completed
2023-04-24T15:38:55.948 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2023-04-24T15:38:55.980 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2023-04-24T15:41:29.769 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-04-24T15:41:38.857 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-04-24T15:41:44.837 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-04-24T15:41:47.909 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-04-24T15:41:53.893 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-04-24T15:41:56.965 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-04-24T15:42:02.949 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-04-24T15:42:06.021 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.12
2023-04-24T15:42:12.005 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-04-24T15:42:21.061 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-04-24T15:42:30.117 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-04-24T15:43:12.057 WARNING:teuthology.provision.fog:timed out
2023-04-24T15:43:18.365 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-04-24T15:43:18.629 INFO:teuthology.provision.fog.smithi012:Node is ready
2023-04-24T15:43:18.687 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2023-04-24T15:43:18.747 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2023-04-24T15:43:19.111 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2023-04-24T15:43:36.132 WARNING:teuthology.provision.fog:timed out
2023-04-24T15:43:42.415 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-04-24T15:43:42.679 INFO:teuthology.provision.fog.smithi105:Node is ready
2023-04-24T15:43:42.738 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2023-04-24T15:43:42.797 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2023-04-24T15:43:43.168 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2023-04-24T15:43:43.367 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2023-04-24T15:43:43.368 INFO:teuthology.lock.ops:New key found. Updating...
2023-04-24T15:43:43.393 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2023-04-24T15:43:43.394 INFO:teuthology.lock.ops:New key found. Updating...
2023-04-24T15:43:43.412 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2023-04-24T15:43:43.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2023-04-24T15:43:43.675 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2023-04-24T15:43:43.734 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2023-04-24T15:43:43.735 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8"
2023-04-24T15:43:43.735 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2023-04-24T15:43:43.735 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2023-04-24T15:43:43.735 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8"
2023-04-24T15:43:43.735 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8"
2023-04-24T15:43:43.735 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8"
2023-04-24T15:43:43.736 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2023-04-24T15:43:43.736 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-04-24T15:43:43.736 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2023-04-24T15:43:43.736 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-04-24T15:43:43.736 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-04-24T15:43:43.736 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-04-24T15:43:43.737 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2023-04-24T15:43:43.760 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2023-04-24T15:43:43.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-04-24T15:43:43.946 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2023-04-24T15:43:44.003 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2023-04-24T15:43:44.004 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8"
2023-04-24T15:43:44.004 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2023-04-24T15:43:44.004 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2023-04-24T15:43:44.004 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8"
2023-04-24T15:43:44.004 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-04-24T15:43:44.004 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8"
2023-04-24T15:43:44.005 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-04-24T15:43:44.005 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-04-24T15:43:44.005 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2023-04-24T15:43:44.005 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-04-24T15:43:44.005 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-04-24T15:43:44.005 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-04-24T15:43:44.006 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-04-24T15:43:44.118 INFO:teuthology.dispatcher.supervisor:Running job 7249457
2023-04-24T15:43:44.118 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-04-24_13:21:18-orch:cephadm-wip-adk2-testing-2023-04-24-1329-distro-default-smithi/7249457 --name gabrioux-2023-04-24_13:21:18-orch:cephadm-wip-adk2-testing-2023-04-24-1329-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/gabrioux-2023-04-24_13:21:18-orch:cephadm-wip-adk2-testing-2023-04-24-1329-distro-default-smithi/7249457/orig.config.yaml
2023-04-24T15:43:44.123 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-04-24_13:21:18-orch:cephadm-wip-adk2-testing-2023-04-24-1329-distro-default-smithi/7249457
2023-04-24T15:43:44.124 INFO:teuthology.dispatcher.supervisor:Job PID: 24120
2023-04-24T15:43:44.124 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-04-25T03:44:40.900 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-04-25T03:44:41.096 INFO:teuthology.kill:Killing Pids: {24120}
2023-04-25T03:44:41.939 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2023-04-25T03:44:41.940 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2023-04-25T03:44:41.940 INFO:teuthology.misc:Compressing logs...
2023-04-25T03:44:41.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2023-04-25T03:44:42.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-04-25T03:44:57.218 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-04-25T03:44:57.220 ERROR:paramiko.transport:Traceback (most recent call last):
2023-04-25T03:44:57.220 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-04-25T03:44:57.221 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-04-25T03:44:57.221 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-04-25T03:44:57.221 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-04-25T03:44:57.221 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 622, in _read_timeout
2023-04-25T03:44:57.221 ERROR:paramiko.transport:    raise socket.timeout()
2023-04-25T03:44:57.222 ERROR:paramiko.transport:socket.timeout
2023-04-25T03:44:57.222 ERROR:paramiko.transport:
2023-04-25T03:44:57.222 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-04-25T03:44:57.222 ERROR:paramiko.transport:
2023-04-25T03:44:57.223 ERROR:paramiko.transport:Traceback (most recent call last):
2023-04-25T03:44:57.223 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-04-25T03:44:57.223 ERROR:paramiko.transport:    self._check_banner()
2023-04-25T03:44:57.223 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-04-25T03:44:57.223 ERROR:paramiko.transport:    raise SSHException(
2023-04-25T03:44:57.224 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-04-25T03:44:57.224 ERROR:paramiko.transport:
2023-04-25T03:44:57.224 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/supervisor.py", line 313, in run_with_watchdog
    transfer_archives(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/supervisor.py", line 378, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/misc.py", line 1368, in compress_logs
    ctx.cluster.run(
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/remote.py", line 524, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi105
2023-04-25T03:44:57.297 INFO:teuthology.kill:No teuthology processes running
2023-04-25T03:44:58.118 INFO:teuthology.kill:Nuking machines: ['smithi012', 'smithi105']
2023-04-25T03:44:58.706 INFO:teuthology.kill:2023-04-25 03:44:58,706.706 INFO:teuthology.nuke:targets:
2023-04-25T03:44:58.707 INFO:teuthology.kill:  smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKg6ky7YYpmG/kMSSiOqVmSfvrUopUBs5DvoFRwLFrcqoZLuidmNE6PyPNclr7EaNUwhPJFTTMvU51KRIbo6aSw=
2023-04-25T03:44:58.708 INFO:teuthology.kill:  smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA77J2PvtUzBV6MJh3oxPaL/k7aCIZWdJun3qkVL3Tal99eZsqntIvqZHJ5+XXCRmTfEUT1m6Y43q768nVopg9s=
2023-04-25T03:44:58.709 INFO:teuthology.kill:2023-04-25 03:44:58,706.706 INFO:teuthology.nuke:Checking targets against current locks
2023-04-25T03:44:58.759 INFO:teuthology.kill:2023-04-25 03:44:58,759.759 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-04-25T03:44:58.784 INFO:teuthology.kill:2023-04-25 03:44:58,784.784 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-04-25T03:44:58.836 INFO:teuthology.kill:2023-04-25 03:44:58,835.835 INFO:teuthology.orchestra.console:Power off smithi012
2023-04-25T03:44:58.854 INFO:teuthology.kill:2023-04-25 03:44:58,853.853 INFO:teuthology.orchestra.console:Power off smithi105
2023-04-25T03:45:07.215 INFO:teuthology.kill:2023-04-25 03:45:07,215.215 INFO:teuthology.orchestra.console:Power off for smithi012 completed
2023-04-25T03:45:07.222 INFO:teuthology.kill:2023-04-25 03:45:07,222.222 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2023-04-25T03:45:07.377 INFO:teuthology.kill:2023-04-25 03:45:07,377.377 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com
2023-04-25T03:45:07.384 INFO:teuthology.kill:2023-04-25 03:45:07,384.384 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2023-04-25T03:47:07.731 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-04-25T03:47:07.850 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi012 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-04-24_22:49:32-rados-wip-yuri6-testing-2023-04-12-0732-reef-distro-default-smithi/7249907
2023-04-25T03:47:07.850 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-04-24_22:49:32-rados-wip-yuri6-testing-2023-04-12-0732-reef-distro-default-smithi/7249907