2023-05-15T15:02:54.778 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-05-15T15:02:54.946 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2023-05-15T15:02:54.948 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2023-05-15T15:02:54.948 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-05-15T15:02:54.973 INFO:teuthology.lock.ops:Node 'smithi114.front.sepia.ceph.com' reimaging is complete
2023-05-15T15:02:54.974 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging
2023-05-15T15:02:54.974 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server
2023-05-15T15:02:54.974 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2023-05-15T15:02:54.998 INFO:teuthology.lock.ops:Node 'smithi139.front.sepia.ceph.com' reimaging is complete
2023-05-15T15:02:55.127 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.stream
2023-05-15T15:02:55.163 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 8.stream
2023-05-15T15:02:55.345 INFO:teuthology.orchestra.console:Power off smithi114
2023-05-15T15:02:55.360 INFO:teuthology.orchestra.console:Power off smithi139
2023-05-15T15:03:03.727 INFO:teuthology.orchestra.console:Power off for smithi139 completed
2023-05-15T15:03:03.829 INFO:teuthology.orchestra.console:Power on smithi139
2023-05-15T15:03:07.833 INFO:teuthology.orchestra.console:Power off for smithi114 completed
2023-05-15T15:03:07.934 INFO:teuthology.orchestra.console:Power on smithi114
2023-05-15T15:03:12.191 INFO:teuthology.orchestra.console:Power on for smithi114 completed
2023-05-15T15:03:12.200 INFO:teuthology.orchestra.console:Power on for smithi139 completed
2023-05-15T15:03:12.293 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2023-05-15T15:03:12.301 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish
2023-05-15T15:06:01.232 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-05-15T15:06:01.233 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-05-15T15:06:10.288 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-05-15T15:06:10.289 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-05-15T15:06:19.344 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-05-15T15:06:19.345 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-05-15T15:06:28.400 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-05-15T15:06:28.401 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-05-15T15:06:37.461 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-05-15T15:06:37.462 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-05-15T15:06:46.544 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-05-15T15:06:46.545 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-05-15T15:06:55.600 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-05-15T15:07:52.600 WARNING:teuthology.provision.fog:timed out
2023-05-15T15:07:58.837 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-15T15:07:59.114 INFO:teuthology.provision.fog.smithi139:Node is ready
2023-05-15T15:07:59.134 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com
2023-05-15T15:07:59.193 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139
2023-05-15T15:07:59.527 INFO:teuthology.provision.fog.smithi139:Deploy complete!
2023-05-15T15:08:01.608 WARNING:teuthology.provision.fog:timed out
2023-05-15T15:08:07.941 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-05-15T15:08:08.201 INFO:teuthology.provision.fog.smithi114:Node is ready
2023-05-15T15:08:08.220 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com
2023-05-15T15:08:08.280 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2023-05-15T15:08:08.634 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2023-05-15T15:08:08.821 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2023-05-15T15:08:08.821 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-15T15:08:08.850 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com
2023-05-15T15:08:08.850 INFO:teuthology.lock.ops:New key found. Updating...
2023-05-15T15:08:08.876 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2023-05-15T15:08:08.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2023-05-15T15:08:09.067 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2023-05-15T15:08:09.125 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2023-05-15T15:08:09.125 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8"
2023-05-15T15:08:09.125 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2023-05-15T15:08:09.125 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2023-05-15T15:08:09.126 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8"
2023-05-15T15:08:09.126 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2023-05-15T15:08:09.126 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-15T15:08:09.126 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2023-05-15T15:08:09.126 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-15T15:08:09.126 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2023-05-15T15:08:09.126 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-15T15:08:09.126 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-15T15:08:09.127 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-15T15:08:09.127 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-05-15T15:08:09.151 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server
2023-05-15T15:08:09.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-05-15T15:08:09.350 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64
2023-05-15T15:08:09.410 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream"
2023-05-15T15:08:09.411 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8"
2023-05-15T15:08:09.411 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos"
2023-05-15T15:08:09.411 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora"
2023-05-15T15:08:09.411 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8"
2023-05-15T15:08:09.411 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8"
2023-05-15T15:08:09.411 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8"
2023-05-15T15:08:09.412 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31"
2023-05-15T15:08:09.412 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-05-15T15:08:09.412 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/"
2023-05-15T15:08:09.412 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-05-15T15:08:09.412 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-05-15T15:08:09.412 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-05-15T15:08:09.413 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2023-05-15T15:08:09.533 INFO:teuthology.dispatcher.supervisor:Running job 7274150
2023-05-15T15:08:09.533 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274150 --name gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274150/orig.config.yaml
2023-05-15T15:08:09.536 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-05-15_12:49:24-orch:cephadm-wip-guits-testing-4-2023-05-15-1111-distro-default-smithi/7274150
2023-05-15T15:08:09.537 INFO:teuthology.dispatcher.supervisor:Job PID: 1206
2023-05-15T15:08:09.538 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-05-16T03:09:11.324 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-05-16T03:09:11.477 INFO:teuthology.kill:Killing Pids: {1206}
2023-05-16T03:09:12.305 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2023-05-16T03:09:12.306 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2023-05-16T03:09:12.306 INFO:teuthology.misc:Compressing logs...
2023-05-16T03:09:12.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2023-05-16T03:09:12.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-05-16T03:09:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2023-05-16T03:09:27.565 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-05-16T03:09:27.568 ERROR:paramiko.transport:Traceback (most recent call last):
2023-05-16T03:09:27.569 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-05-16T03:09:27.569 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-05-16T03:09:27.569 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-05-16T03:09:27.569 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-05-16T03:09:27.570 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 622, in _read_timeout
2023-05-16T03:09:27.570 ERROR:paramiko.transport:    raise socket.timeout()
2023-05-16T03:09:27.570 ERROR:paramiko.transport:socket.timeout
2023-05-16T03:09:27.570 ERROR:paramiko.transport:
2023-05-16T03:09:27.571 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-05-16T03:09:27.571 ERROR:paramiko.transport:
2023-05-16T03:09:27.571 ERROR:paramiko.transport:Traceback (most recent call last):
2023-05-16T03:09:27.571 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-05-16T03:09:27.571 ERROR:paramiko.transport:    self._check_banner()
2023-05-16T03:09:27.572 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-05-16T03:09:27.572 ERROR:paramiko.transport:    raise SSHException(
2023-05-16T03:09:27.572 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-05-16T03:09:27.573 ERROR:paramiko.transport:
2023-05-16T03:09:27.573 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/dispatcher/supervisor.py", line 313, in run_with_watchdog
    transfer_archives(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/dispatcher/supervisor.py", line 378, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/misc.py", line 1368, in compress_logs
    ctx.cluster.run(
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/cluster.py", line 85, in run
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/cluster.py", line 85, in <listcomp>
    procs = [remote.run(**kwargs, wait=_wait) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/remote.py", line 524, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi139
2023-05-16T03:09:27.633 INFO:teuthology.kill:No teuthology processes running
2023-05-16T03:09:28.458 INFO:teuthology.kill:Nuking machines: ['smithi114', 'smithi139']
2023-05-16T03:09:29.066 INFO:teuthology.kill:2023-05-16 03:09:29,065.065 INFO:teuthology.nuke:targets:
2023-05-16T03:09:29.067 INFO:teuthology.kill:  smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDCWoTC83gDiTutdJy8+wg30JGfO7GukJql6G82IHF8LVPofE00WQsqM0egae7qedct67UbIV5jzvrNL+fTOmTs=
2023-05-16T03:09:29.067 INFO:teuthology.kill:  smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfo2xUkbl7m0Glf28IMKEoZzJQG+1hvFEKVBwVBHaZ+fJN+zFfdTC5/uiyVHe42umf6NQD8QoLSDJpB4IPQcAs=
2023-05-16T03:09:29.067 INFO:teuthology.kill:2023-05-16 03:09:29,065.065 INFO:teuthology.nuke:Checking targets against current locks
2023-05-16T03:09:29.123 INFO:teuthology.kill:2023-05-16 03:09:29,123.123 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-16T03:09:29.143 INFO:teuthology.kill:2023-05-16 03:09:29,143.143 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-05-16T03:09:29.199 INFO:teuthology.kill:2023-05-16 03:09:29,199.199 INFO:teuthology.orchestra.console:Power off smithi114
2023-05-16T03:09:29.234 INFO:teuthology.kill:2023-05-16 03:09:29,234.234 INFO:teuthology.orchestra.console:Power off smithi139
2023-05-16T03:09:37.601 INFO:teuthology.kill:2023-05-16 03:09:37,600.600 INFO:teuthology.orchestra.console:Power off for smithi139 completed
2023-05-16T03:09:37.754 INFO:teuthology.kill:2023-05-16 03:09:37,754.754 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com
2023-05-16T03:09:41.683 INFO:teuthology.kill:2023-05-16 03:09:41,683.683 INFO:teuthology.orchestra.console:Power off for smithi114 completed
2023-05-16T03:09:41.840 INFO:teuthology.kill:2023-05-16 03:09:41,839.839 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com
2023-05-16T03:11:42.195 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-05-16T03:11:42.293 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi114 but it was locked by another job: /home/teuthworker/archive/dis-2023-05-15_22:29:47-rbd-wip-dis-testing-distro-default-smithi/7275319
2023-05-16T03:11:42.294 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi139 but it was locked by another job: /home/teuthworker/archive/dis-2023-05-15_22:29:47-rbd-wip-dis-testing-distro-default-smithi/7275318