2022-05-19T16:54:58.454 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01
2022-05-19T16:54:58.606 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2022-05-19T16:54:58.608 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2022-05-19T16:54:58.608 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2022-05-19T16:54:58.632 INFO:teuthology.lock.ops:Node 'smithi045.front.sepia.ceph.com' reimaging is complete
2022-05-19T16:54:58.633 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging
2022-05-19T16:54:58.633 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server
2022-05-19T16:54:58.634 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2022-05-19T16:54:58.658 INFO:teuthology.lock.ops:Node 'smithi090.front.sepia.ceph.com' reimaging is complete
2022-05-19T16:54:58.855 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of ubuntu 18.04
2022-05-19T16:54:58.890 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of ubuntu 18.04
2022-05-19T16:54:59.289 INFO:teuthology.orchestra.console:Power off smithi045
2022-05-19T16:54:59.400 INFO:teuthology.orchestra.console:Power off smithi090
2022-05-19T16:55:07.703 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2022-05-19T16:55:08.706 INFO:teuthology.orchestra.console:Power on smithi045
2022-05-19T16:55:12.826 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2022-05-19T16:55:12.929 INFO:teuthology.orchestra.console:Power on smithi090
2022-05-19T16:55:17.135 INFO:teuthology.orchestra.console:Power on for smithi045 completed
2022-05-19T16:55:17.204 INFO:teuthology.orchestra.console:Power on for smithi090 completed
2022-05-19T16:55:17.237 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2022-05-19T16:55:17.306 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2022-05-19T16:57:48.725 ERROR:teuthology.orchestra.connection:Error authenticating with smithi045.front.sepia.ceph.com: Authentication failed.
2022-05-19T16:59:31.962 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner[Errno 104] Connection reset by peer
2022-05-19T16:59:31.965 ERROR:paramiko.transport:Traceback (most recent call last):
2022-05-19T16:59:31.966 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2278, in _check_banner
2022-05-19T16:59:31.966 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2022-05-19T16:59:31.966 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2022-05-19T16:59:31.967 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2022-05-19T16:59:31.967 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 607, in _read_timeout
2022-05-19T16:59:31.967 ERROR:paramiko.transport:    x = self.__socket.recv(128)
2022-05-19T16:59:31.968 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/gevent/_socketcommon.py", line 657, in recv
2022-05-19T16:59:31.968 ERROR:paramiko.transport:    return self._sock.recv(*args)
2022-05-19T16:59:31.968 ERROR:paramiko.transport:ConnectionResetError: [Errno 104] Connection reset by peer
2022-05-19T16:59:31.969 ERROR:paramiko.transport:
2022-05-19T16:59:31.969 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2022-05-19T16:59:31.969 ERROR:paramiko.transport:
2022-05-19T16:59:31.970 ERROR:paramiko.transport:Traceback (most recent call last):
2022-05-19T16:59:31.971 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2101, in run
2022-05-19T16:59:31.971 ERROR:paramiko.transport:    self._check_banner()
2022-05-19T16:59:31.971 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2283, in _check_banner
2022-05-19T16:59:31.971 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2022-05-19T16:59:31.972 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner[Errno 104] Connection reset by peer
2022-05-19T16:59:31.972 ERROR:paramiko.transport:
2022-05-19T16:59:38.107 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-19T16:59:38.355 INFO:teuthology.provision.fog.smithi045:Node is ready
2022-05-19T16:59:38.405 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2022-05-19T16:59:38.455 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2022-05-19T16:59:38.740 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2022-05-19T17:01:01.611 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2022-05-19T17:01:07.712 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-05-19T17:01:07.979 INFO:teuthology.provision.fog.smithi090:Node is ready
2022-05-19T17:01:08.029 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2022-05-19T17:01:08.078 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2022-05-19T17:01:08.390 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2022-05-19T17:01:08.591 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2022-05-19T17:01:08.592 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-19T17:01:08.616 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2022-05-19T17:01:08.617 INFO:teuthology.lock.ops:New key found. Updating...
2022-05-19T17:01:08.642 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2022-05-19T17:01:08.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2022-05-19T17:01:08.983 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2022-05-19T17:01:09.032 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu"
2022-05-19T17:01:09.032 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-05-19T17:01:09.033 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu
2022-05-19T17:01:09.033 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian
2022-05-19T17:01:09.033 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-05-19T17:01:09.034 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="18.04"
2022-05-19T17:01:09.034 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/"
2022-05-19T17:01:09.034 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-05-19T17:01:09.035 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-05-19T17:01:09.035 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-05-19T17:01:09.035 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=bionic
2022-05-19T17:01:09.036 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=bionic
2022-05-19T17:01:09.038 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2022-05-19T17:01:09.064 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2022-05-19T17:01:09.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2022-05-19T17:01:09.350 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2022-05-19T17:01:09.398 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu"
2022-05-19T17:01:09.398 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="18.04.6 LTS (Bionic Beaver)"
2022-05-19T17:01:09.398 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu
2022-05-19T17:01:09.399 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian
2022-05-19T17:01:09.399 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS"
2022-05-19T17:01:09.399 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="18.04"
2022-05-19T17:01:09.399 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/"
2022-05-19T17:01:09.399 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-05-19T17:01:09.400 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-05-19T17:01:09.400 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-05-19T17:01:09.400 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=bionic
2022-05-19T17:01:09.400 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=bionic
2022-05-19T17:01:09.401 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2022-05-19T17:01:09.503 INFO:teuthology.dispatcher.supervisor:Running job 6841411
2022-05-19T17:01:09.504 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-05-19_16:47:41-rados:cephadm:osds-wip-lrc-fix-pacific-distro-default-smithi/6841411 --name lflores-2022-05-19_16:47:41-rados:cephadm:osds-wip-lrc-fix-pacific-distro-default-smithi --description rados:cephadm:osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} -- /home/teuthworker/archive/lflores-2022-05-19_16:47:41-rados:cephadm:osds-wip-lrc-fix-pacific-distro-default-smithi/6841411/orig.config.yaml
2022-05-19T17:01:09.511 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-05-19_16:47:41-rados:cephadm:osds-wip-lrc-fix-pacific-distro-default-smithi/6841411
2022-05-19T17:01:09.512 INFO:teuthology.dispatcher.supervisor:Job PID: 18014
2022-05-19T17:01:09.512 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-05-19T23:31:22.821 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-05-19T23:31:22.932 INFO:teuthology.kill:Killing Pids: {18014}
2022-05-19T23:31:24.456 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['host.a', 'client.0']
2022-05-19T23:31:24.457 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['host.b', 'client.1']
2022-05-19T23:31:24.458 INFO:teuthology.misc:Compressing logs...
2022-05-19T23:31:24.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2022-05-19T23:31:24.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2022-05-19T23:31:24.730 INFO:teuthology.orchestra.run.smithi045.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-05-19T23:31:25.080 INFO:teuthology.orchestra.run.smithi090.stderr:find: '/var/lib/ceph/crash': No such file or directory
2022-05-19T23:31:25.102 INFO:teuthology.orchestra.run.smithi045.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-05-19T23:31:25.103 INFO:teuthology.orchestra.run.smithi045.stderr:tar: Error is not recoverable: exiting now
2022-05-19T23:31:25.139 INFO:teuthology.orchestra.run.smithi090.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-05-19T23:31:25.140 INFO:teuthology.orchestra.run.smithi090.stderr:tar: Error is not recoverable: exiting now
2022-05-19T23:31:25.144 INFO:teuthology.misc:Compressing logs...
2022-05-19T23:31:25.374 INFO:teuthology.misc:Compressing logs...
2022-05-19T23:31:27.176 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2022-05-19T23:31:28.893 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2022-05-19T23:31:32.340 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-mon.smithi090.log: file size changed while zipping
2022-05-19T23:31:34.267 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-05-19T23:31:35.467 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-mon.smithi045.log: file size changed while zipping
2022-05-19T23:31:36.058 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2022-05-19T23:31:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2022-05-19T23:31:39.882 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2022-05-19T23:31:41.790 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2022-05-19T23:31:44.098 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/ebf59d98-d795-11ec-be40-001a4aab830c/ceph-mgr.smithi045.suzfkn.log: file size changed while zipping
2022-05-19T23:31:50.216 INFO:teuthology.kill:No teuthology processes running
2022-05-19T23:31:51.885 INFO:teuthology.kill:Nuking machines: ['smithi045', 'smithi090']
2022-05-19T23:31:53.134 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-05-19T23:31:53.135 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-05-19T23:31:53.135 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-05-19T23:31:53.135 INFO:teuthology.kill:  "class": algorithms.Blowfish,
2022-05-19T23:31:53.135 INFO:teuthology.kill:2022-05-19 23:31:53,133.133 INFO:teuthology.nuke:targets:
2022-05-19T23:31:53.136 INFO:teuthology.kill:  smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyzPRXqJED7gOTW7rjSzp3zFSKKbYj+GB4hnlegrUDhh4UhVTuDsP25FuktqhtRE2lhtQuvxXFsK2UGjj6STTzYDPKNVLAgOK2PlJZaIFWtZN4FDYwkRPB+d73OUcJfJvg6fvSXrCwlQ3mXcWgIFNSVlcNzfP261I7CUvt1KsfsrZqWYjS6J3X7Ov9CvO1YYc+nU0IY+baoS1WzUMdFSfxMC4lIvBuTx5dGS5E8rcYAqzZxg3tf/Aa/FHrafHw70FnPmZdUoXGo2gb2HgcTu+fgGXI7bMTg2ZDu9eS2QkinfqrD6o435IoyAVrsGSaHjdsTW4+Phu40UXT44P4GmG7
2022-05-19T23:31:53.136 INFO:teuthology.kill:  smithi090.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxwO2g6QztTs6f7uI6y/vSYOIa+1Ht2RHR1JuEgOpR3FmxBiseVpNyMmxHAhXqmSGIycKoiNCbDyZXxXzl6BORjtpw//VRpjJ9SlGyFDOPBbAJjP9i4BCwzdQWHVO8fcCGD/mq3ImKis/zx32eDAZZwmfZgdnX6TU5TWsYw5iadgkaT8AKYi/bs036qGEkOkef/rGjz4TVFUe6kWwYhICFwc/8C5D+CsPlTrQA4WMPnXFsRDZyPMTpfcot3M+Hr9g6m1C5wrm9sH/n+QUBthK+QravnNHWt7lm+MTRZEIHlD1+tu8ELjGjmsa9Dak9CDov8OKth89kS/c0pkaTMrY5
2022-05-19T23:31:53.165 INFO:teuthology.kill:2022-05-19 23:31:53,165.165 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-19T23:31:53.169 INFO:teuthology.kill:2022-05-19 23:31:53,169.169 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-05-19T23:31:53.259 INFO:teuthology.kill:2022-05-19 23:31:53,259.259 INFO:teuthology.orchestra.console:Power off smithi045
2022-05-19T23:31:53.277 INFO:teuthology.kill:2022-05-19 23:31:53,277.277 INFO:teuthology.orchestra.console:Power off smithi090
2022-05-19T23:32:01.649 INFO:teuthology.kill:2022-05-19 23:32:01,648.648 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2022-05-19T23:32:01.650 INFO:teuthology.kill:2022-05-19 23:32:01,650.650 INFO:teuthology.orchestra.console:Power off for smithi090 completed
2022-05-19T23:32:01.817 INFO:teuthology.kill:2022-05-19 23:32:01,815.815 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2022-05-19T23:32:01.819 INFO:teuthology.kill:2022-05-19 23:32:01,819.819 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com
2022-05-19T23:34:02.110 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-05-19T23:34:02.207 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi045 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-18_12:17:03-powercycle-pacific-distro-default-smithi/6839609
2022-05-19T23:34:02.208 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi090 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-18_12:17:03-powercycle-pacific-distro-default-smithi/6839609