2023-05-15T14:16:12.934 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-05-15T14:16:13.074 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2023-05-15T14:16:13.075 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2023-05-15T14:16:13.076 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2023-05-15T14:16:13.092 INFO:teuthology.lock.ops:Node 'smithi176.front.sepia.ceph.com' reimaging is complete
2023-05-15T14:16:13.092 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging
2023-05-15T14:16:13.092 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server
2023-05-15T14:16:13.093 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-05-15T14:16:13.117 INFO:teuthology.lock.ops:Node 'smithi186.front.sepia.ceph.com' reimaging is complete
2023-05-15T14:16:13.249 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 8.stream
2023-05-15T14:16:13.273 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream
2023-05-15T14:16:13.457 INFO:teuthology.orchestra.console:Power off smithi176
2023-05-15T14:16:13.475 INFO:teuthology.orchestra.console:Power off smithi186
2023-05-15T14:16:13.606 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2023-05-15T14:16:13.616 INFO:teuthology.orchestra.console:Power off for smithi186 completed
2023-05-15T14:16:13.708 INFO:teuthology.orchestra.console:Power on smithi176
2023-05-15T14:16:13.718 INFO:teuthology.orchestra.console:Power on smithi186
2023-05-15T14:16:17.967 INFO:teuthology.orchestra.console:Power on for smithi176 completed
2023-05-15T14:16:18.068 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2023-05-15T14:16:22.086 INFO:teuthology.orchestra.console:Power on for smithi186 completed
2023-05-15T14:16:22.187 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2023-05-15T14:19:06.864 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-05-15T14:19:10.960 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-05-15T14:19:15.920 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-05-15T14:19:20.016 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-05-15T14:19:24.980 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-05-15T14:19:29.072 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-05-15T14:19:34.064 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-05-15T14:19:38.128 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-05-15T14:19:43.124 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-05-15T14:19:47.184 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-05-15T14:19:52.176 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-05-15T14:19:56.240 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-05-15T14:20:05.296 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-05-15T14:20:14.356 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-05-15T14:20:58.218 WARNING:teuthology.provision.fog:timed out
2023-05-15T14:21:04.471 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-15T14:21:04.708 INFO:teuthology.provision.fog.smithi176:Node is ready
2023-05-15T14:21:04.727 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2023-05-15T14:21:04.786 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2023-05-15T14:21:05.110 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2023-05-15T14:21:20.376 WARNING:teuthology.provision.fog:timed out
2023-05-15T14:21:26.581 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-15T14:21:26.859 INFO:teuthology.provision.fog.smithi186:Node is ready
2023-05-15T14:21:26.879 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com
2023-05-15T14:21:26.939 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2023-05-15T14:21:27.275 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2023-05-15T14:21:27.428 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2023-05-15T14:21:27.428 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-15T14:21:27.454 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com
2023-05-15T14:21:27.454 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-15T14:21:27.480 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2023-05-15T14:21:27.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2023-05-15T14:21:27.742 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2023-05-15T14:21:27.800 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2023-05-15T14:21:27.801 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8"
2023-05-15T14:21:27.801 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2023-05-15T14:21:27.801 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2023-05-15T14:21:27.801 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8"
2023-05-15T14:21:27.801 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2023-05-15T14:21:27.801 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-15T14:21:27.801 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2023-05-15T14:21:27.802 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-15T14:21:27.802 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2023-05-15T14:21:27.802 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-15T14:21:27.802 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-15T14:21:27.802 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-15T14:21:27.803 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2023-05-15T14:21:27.829 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server
2023-05-15T14:21:27.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2023-05-15T14:21:28.017 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64
2023-05-15T14:21:28.075 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream"
2023-05-15T14:21:28.076 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8"
2023-05-15T14:21:28.076 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos"
2023-05-15T14:21:28.076 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora"
2023-05-15T14:21:28.076 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8"
2023-05-15T14:21:28.076 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2023-05-15T14:21:28.077 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-15T14:21:28.077 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2023-05-15T14:21:28.077 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-15T14:21:28.077 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/"
2023-05-15T14:21:28.077 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-15T14:21:28.077 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-15T14:21:28.077 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-15T14:21:28.078 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-05-15T14:21:28.230 INFO:teuthology.dispatcher.supervisor:Running job 7274113
2023-05-15T14:21:28.230 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274113 --name gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274113/orig.config.yaml
2023-05-15T14:21:28.234 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274113
2023-05-15T14:21:28.235 INFO:teuthology.dispatcher.supervisor:Job PID: 5239
2023-05-15T14:21:28.235 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-05-16T02:22:29.826 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-05-16T02:22:30.008 INFO:teuthology.kill:Killing Pids: {5239}
2023-05-16T02:22:30.925 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2']
2023-05-16T02:22:30.926 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5']
2023-05-16T02:22:30.926 INFO:teuthology.misc:Compressing logs...
2023-05-16T02:22:30.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2023-05-16T02:22:31.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com'
2023-05-16T02:22:46.148 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-05-16T02:22:46.150 ERROR:paramiko.transport:Traceback (most recent call last):
2023-05-16T02:22:46.150 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-05-16T02:22:46.150 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-05-16T02:22:46.151 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-05-16T02:22:46.151 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-05-16T02:22:46.151 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 622, in _read_timeout
2023-05-16T02:22:46.151 ERROR:paramiko.transport:    raise socket.timeout()
2023-05-16T02:22:46.151 ERROR:paramiko.transport:socket.timeout
2023-05-16T02:22:46.152 ERROR:paramiko.transport:
2023-05-16T02:22:46.152 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-05-16T02:22:46.153 ERROR:paramiko.transport:
2023-05-16T02:22:46.153 ERROR:paramiko.transport:Traceback (most recent call last):
2023-05-16T02:22:46.153 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-05-16T02:22:46.154 ERROR:paramiko.transport:    self._check_banner()
2023-05-16T02:22:46.154 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-05-16T02:22:46.155 ERROR:paramiko.transport:    raise SSHException(
2023-05-16T02:22:46.155 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-05-16T02:22:46.156 ERROR:paramiko.transport:
2023-05-16T02:22:46.156 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/dispatcher/supervisor.py", line 313, in run_with_watchdog
    transfer_archives(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/dispatcher/supervisor.py", line 378, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/misc.py", line 1368, in compress_logs
    ctx.cluster.run(
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/remote.py", line 524, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi186
2023-05-16T02:22:46.224 INFO:teuthology.kill:No teuthology processes running
2023-05-16T02:22:46.975 INFO:teuthology.kill:Nuking machines: ['smithi176', 'smithi186']
2023-05-16T02:22:47.572 INFO:teuthology.kill:2023-05-16 02:22:47,572.572 INFO:teuthology.nuke:targets:
2023-05-16T02:22:47.573 INFO:teuthology.kill:  smithi176.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3xYP+7MeJfa3MB0fm2zypEfOGPRwBkbG3FHuziyauN4bhwKnl3kUUhMZ/ERvx0DmDJp/HBXPXheQWtijKEywdwW2VRiVMTpMNqqw+uN15nZqTGYgN50FhZ+7RbQ+Y13H3YRqkfHYZTzyvD/VA17DptpxrdeRJpfdq23XoKtz9tB2jKgfr+t2bZXr8YOXwyBEh8QC/XTNPNk8EeE/03KVlOl2yZVG0AFOu2RzdTnoidS4/685umJDUkJDS74qq62WvKs1hhtAOHLEXix7VMZOGikZ/BTlwaaC6ziGfEfp9DVVDcypKXs3Jl2KwOdluzAh1OhH1/7ZMMYLopKGtfr8TCeTmflIVzekxYQ+9eS3j6qTTR4KYc0NJBVyGC/W9iKLZMBmbS0YsfyO6Oy1jwforPq1p5MUtujMvrkAoPcs3WVg/ClF1QrMBf8uBqZ/usJ24rvxfMu+RngeiMsBhgGEbcfIJfKtf+qP/c1Js67LZruimMJ/YBAaqzkFZ5s2S++U=
2023-05-16T02:22:47.573 INFO:teuthology.kill:  smithi186.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGDSyIEJmDvmjqTDU7C8d9ZA5U3mZhqjFCc88iz+s2c4pMIkS1h9nxugxCh9r87ZhS64V+mP3MNPtxCueP60+gqgRMeUHVFlXlO20THTmxSzBL/osShYcYUACbO1s6QUIUMCGdrRwvUyOQSXIx9i9Q9BQp7jT65sCTNIZ3O61EwAzt38knGHwe2mb2n87vfccDXbE22Z0esiP+2trpl0IBxbzNz2EeR4hRIr9X4UG9luqnHK9nybdoIp7cgXudsqG06fQwgiVFOPx3YGaU3XCtnpK1YH4Zp6HZLhjJEU9VWUVr3JdlCC2IVBAmNT1DyiZyZwKKaCOzu5oQyvkRmtEVwWrdYQmuChp4i2Cj88EtjcgspPRydAbohAsChgSKdf4DrVA4Ru7PLAbtNxaXn2v7oQoAD5QA+TykF5MVOvss6afTw1+xHJQ0s6h8H2rDMEg04xMsh9h+Q2NM1gLxcESKuszYxA91z1FpvFI67k0XB0iTNOQ6PHMKVqQC8XeWmTM=
2023-05-16T02:22:47.573 INFO:teuthology.kill:2023-05-16 02:22:47,572.572 INFO:teuthology.nuke:Checking targets against current locks
2023-05-16T02:22:47.630 INFO:teuthology.kill:2023-05-16 02:22:47,630.630 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-16T02:22:47.652 INFO:teuthology.kill:2023-05-16 02:22:47,652.652 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-16T02:22:47.704 INFO:teuthology.kill:2023-05-16 02:22:47,704.704 INFO:teuthology.orchestra.console:Power off smithi176
2023-05-16T02:22:47.744 INFO:teuthology.kill:2023-05-16 02:22:47,744.744 INFO:teuthology.orchestra.console:Power off smithi186
2023-05-16T02:22:56.074 INFO:teuthology.kill:2023-05-16 02:22:56,074.074 INFO:teuthology.orchestra.console:Power off for smithi176 completed
2023-05-16T02:22:56.227 INFO:teuthology.kill:2023-05-16 02:22:56,226.226 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com
2023-05-16T02:23:00.218 INFO:teuthology.kill:2023-05-16 02:23:00,217.217 INFO:teuthology.orchestra.console:Power off for smithi186 completed
2023-05-16T02:23:00.377 INFO:teuthology.kill:2023-05-16 02:23:00,377.377 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com
2023-05-16T02:25:00.719 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-05-16T02:25:00.833 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi176 but it was locked by another job: /home/teuthworker/archive/dis-2023-05-15_22:29:47-rbd-wip-dis-testing-distro-default-smithi/7275284
2023-05-16T02:25:00.833 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi186 but it was locked by another job: /home/teuthworker/archive/dis-2023-05-15_22:29:47-rbd-wip-dis-testing-distro-default-smithi/7275283