2023-05-15T14:16:53.452 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-05-15T14:16:53.618 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2023-05-15T14:16:53.619 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2023-05-15T14:16:53.620 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2023-05-15T14:16:53.644 INFO:teuthology.lock.ops:Node 'smithi037.front.sepia.ceph.com' reimaging is complete
2023-05-15T14:16:53.644 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2023-05-15T14:16:53.645 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2023-05-15T14:16:53.645 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-05-15T14:16:53.669 INFO:teuthology.lock.ops:Node 'smithi102.front.sepia.ceph.com' reimaging is complete
2023-05-15T14:16:53.807 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream
2023-05-15T14:16:53.834 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.stream
2023-05-15T14:16:54.037 INFO:teuthology.orchestra.console:Power off smithi102
2023-05-15T14:16:54.054 INFO:teuthology.orchestra.console:Power off smithi037
2023-05-15T14:16:54.187 INFO:teuthology.orchestra.console:Power off for smithi102 completed
2023-05-15T14:16:54.200 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2023-05-15T14:16:54.288 INFO:teuthology.orchestra.console:Power on smithi102
2023-05-15T14:16:54.301 INFO:teuthology.orchestra.console:Power on smithi037
2023-05-15T14:16:58.556 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2023-05-15T14:16:58.657 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2023-05-15T14:17:02.656 INFO:teuthology.orchestra.console:Power on for smithi102 completed
2023-05-15T14:17:02.758 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2023-05-15T14:19:47.696 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-05-15T14:19:56.752 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-05-15T14:20:05.808 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-05-15T14:20:33.793 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: Authentication timeout.
2023-05-15T14:20:43.497 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-15T14:21:03.463 INFO:teuthology.provision.fog.smithi037:Node is ready
2023-05-15T14:21:03.489 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2023-05-15T14:21:03.556 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2023-05-15T14:21:03.945 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2023-05-15T14:21:34.797 WARNING:teuthology.provision.fog:timed out
2023-05-15T14:21:41.094 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-15T14:21:41.396 INFO:teuthology.provision.fog.smithi102:Node is ready
2023-05-15T14:21:41.417 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2023-05-15T14:21:41.479 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2023-05-15T14:21:41.854 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2023-05-15T14:21:42.009 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2023-05-15T14:21:42.009 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-15T14:21:42.035 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2023-05-15T14:21:42.035 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-15T14:21:42.052 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2023-05-15T14:21:42.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2023-05-15T14:21:42.320 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2023-05-15T14:21:42.378 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2023-05-15T14:21:42.379 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8"
2023-05-15T14:21:42.379 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2023-05-15T14:21:42.379 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2023-05-15T14:21:42.379 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8"
2023-05-15T14:21:42.379 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2023-05-15T14:21:42.380 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-15T14:21:42.380 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2023-05-15T14:21:42.380 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-15T14:21:42.380 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2023-05-15T14:21:42.380 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-15T14:21:42.380 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-15T14:21:42.380 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-15T14:21:42.381 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2023-05-15T14:21:42.409 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2023-05-15T14:21:42.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-05-15T14:21:42.605 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2023-05-15T14:21:42.664 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2023-05-15T14:21:42.664 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8"
2023-05-15T14:21:42.664 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2023-05-15T14:21:42.667 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2023-05-15T14:21:42.667 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8"
2023-05-15T14:21:42.667 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8"
2023-05-15T14:21:42.667 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-15T14:21:42.667 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2023-05-15T14:21:42.667 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-15T14:21:42.668 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2023-05-15T14:21:42.668 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-15T14:21:42.668 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-15T14:21:42.668 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-15T14:21:42.669 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2023-05-15T14:21:42.800 INFO:teuthology.dispatcher.supervisor:Running job 7274114
2023-05-15T14:21:42.801 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274114 --name gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274114/orig.config.yaml
2023-05-15T14:21:42.804 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274114
2023-05-15T14:21:42.805 INFO:teuthology.dispatcher.supervisor:Job PID: 6916
2023-05-15T14:21:42.805 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-05-15T14:22:22.832 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-05-16T02:22:43.844 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-05-16T02:22:43.990 INFO:teuthology.kill:Killing Pids: {6916}
2023-05-16T02:22:44.815 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2023-05-16T02:22:44.816 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2023-05-16T02:22:44.817 INFO:teuthology.misc:Compressing logs...
2023-05-16T02:22:44.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2023-05-16T02:22:45.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2023-05-16T02:22:45.246 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2023-05-16T02:23:00.096 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-05-16T02:23:00.097 ERROR:paramiko.transport:Traceback (most recent call last):
2023-05-16T02:23:00.098 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-05-16T02:23:00.098 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-05-16T02:23:00.099 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-05-16T02:23:00.099 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-05-16T02:23:00.099 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 622, in _read_timeout
2023-05-16T02:23:00.100 ERROR:paramiko.transport:    raise socket.timeout()
2023-05-16T02:23:00.100 ERROR:paramiko.transport:socket.timeout
2023-05-16T02:23:00.101 ERROR:paramiko.transport:
2023-05-16T02:23:00.101 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-05-16T02:23:00.102 ERROR:paramiko.transport:
2023-05-16T02:23:00.102 ERROR:paramiko.transport:Traceback (most recent call last):
2023-05-16T02:23:00.103 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-05-16T02:23:00.103 ERROR:paramiko.transport:    self._check_banner()
2023-05-16T02:23:00.103 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-05-16T02:23:00.104 ERROR:paramiko.transport:    raise SSHException(
2023-05-16T02:23:00.104 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-05-16T02:23:00.104 ERROR:paramiko.transport:
2023-05-16T02:23:00.105 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/dispatcher/supervisor.py", line 313, in run_with_watchdog
    transfer_archives(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/dispatcher/supervisor.py", line 378, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/misc.py", line 1368, in compress_logs
    ctx.cluster.run(
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/remote.py", line 524, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi102
2023-05-16T02:23:00.151 INFO:teuthology.kill:No teuthology processes running
2023-05-16T02:23:00.914 INFO:teuthology.kill:Nuking machines: ['smithi037', 'smithi102']
2023-05-16T02:23:01.491 INFO:teuthology.kill:2023-05-16 02:23:01,491.491 INFO:teuthology.nuke:targets:
2023-05-16T02:23:01.492 INFO:teuthology.kill:  smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGLINMPqp9V78YUSUHQjATFP7ERURAzo+tKgFvAgjIPreZqN0r3yocTx8FFBcGL/q79C2X13x24R9A2gbxUeXCI=
2023-05-16T02:23:01.492 INFO:teuthology.kill:  smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZOEbItfKcdYI2dax362ZBfW2rfeEb9iZOZABZhKgFRy0Q71lKdIeG603CambPvsC0EOZxvgjVik+5fJTO1JTU=
2023-05-16T02:23:01.493 INFO:teuthology.kill:2023-05-16 02:23:01,491.491 INFO:teuthology.nuke:Checking targets against current locks
2023-05-16T02:23:01.544 INFO:teuthology.kill:2023-05-16 02:23:01,544.544 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-16T02:23:01.573 INFO:teuthology.kill:2023-05-16 02:23:01,573.573 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-16T02:23:01.625 INFO:teuthology.kill:2023-05-16 02:23:01,625.625 INFO:teuthology.orchestra.console:Power off smithi037
2023-05-16T02:23:01.645 INFO:teuthology.kill:2023-05-16 02:23:01,644.644 INFO:teuthology.orchestra.console:Power off smithi102
2023-05-16T02:23:10.004 INFO:teuthology.kill:2023-05-16 02:23:10,004.004 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2023-05-16T02:23:10.010 INFO:teuthology.kill:2023-05-16 02:23:10,010.010 INFO:teuthology.orchestra.console:Power off for smithi102 completed
2023-05-16T02:23:10.159 INFO:teuthology.kill:2023-05-16 02:23:10,159.159 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com
2023-05-16T02:23:10.167 INFO:teuthology.kill:2023-05-16 02:23:10,167.167 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com
2023-05-16T02:25:10.525 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-05-16T02:25:10.615 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi037 but it was locked by another job: /home/teuthworker/archive/dis-2023-05-15_22:29:47-rbd-wip-dis-testing-distro-default-smithi/7275284
2023-05-16T02:25:10.616 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi102 but it was locked by another job: /home/teuthworker/archive/dis-2023-05-15_22:29:47-rbd-wip-dis-testing-distro-default-smithi/7275284