2022-12-15T15:37:15.699 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-15T15:37:20.805 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2022-12-15T15:37:20.805 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2022-12-15T15:37:20.806 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2022-12-15T15:37:25.830 INFO:teuthology.lock.ops:Node 'smithi098.front.sepia.ceph.com' reimaging is complete 2022-12-15T15:37:52.358 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.6 2022-12-15T15:38:12.744 INFO:teuthology.orchestra.console:Power off smithi098 2022-12-15T15:38:12.888 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2022-12-15T15:38:12.989 INFO:teuthology.orchestra.console:Power on smithi098 2022-12-15T15:38:17.245 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2022-12-15T15:38:17.346 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2022-12-15T15:38:29.951 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98 2022-12-15T15:38:40.319 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98 2022-12-15T15:38:49.375 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98 2022-12-15T15:39:01.984 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98 2022-12-15T15:39:16.067 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98 2022-12-15T15:39:45.599 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98 2022-12-15T15:39:53.215 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.98 2022-12-15T15:40:04.322 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:40:10.423 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:40:16.486 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:40:21.610 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:40:27.617 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2022-12-15T15:40:27.619 ERROR:paramiko.transport:Traceback (most recent call last): 2022-12-15T15:40:27.619 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2022-12-15T15:40:27.619 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2022-12-15T15:40:27.619 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2022-12-15T15:40:27.619 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2022-12-15T15:40:27.619 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2022-12-15T15:40:27.619 ERROR:paramiko.transport: raise EOFError() 2022-12-15T15:40:27.619 ERROR:paramiko.transport:EOFError 2022-12-15T15:40:27.619 ERROR:paramiko.transport: 2022-12-15T15:40:27.620 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2022-12-15T15:40:27.620 ERROR:paramiko.transport: 2022-12-15T15:40:27.620 ERROR:paramiko.transport:Traceback (most recent call last): 2022-12-15T15:40:27.620 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2022-12-15T15:40:27.620 ERROR:paramiko.transport: self._check_banner() 2022-12-15T15:40:27.620 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2022-12-15T15:40:27.620 ERROR:paramiko.transport: raise SSHException( 2022-12-15T15:40:27.620 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2022-12-15T15:40:27.620 ERROR:paramiko.transport: 2022-12-15T15:40:27.620 WARNING:teuthology.provision.fog:Error reading SSH protocol banner 2022-12-15T15:40:38.724 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:40:39.824 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:40:40.920 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:40:46.925 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2022-12-15T15:40:46.926 ERROR:paramiko.transport:Traceback (most recent call last): 2022-12-15T15:40:46.926 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2022-12-15T15:40:46.926 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2022-12-15T15:40:46.926 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2022-12-15T15:40:46.926 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2022-12-15T15:40:46.926 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2022-12-15T15:40:46.926 ERROR:paramiko.transport: raise EOFError() 2022-12-15T15:40:46.926 ERROR:paramiko.transport:EOFError 2022-12-15T15:40:46.926 ERROR:paramiko.transport: 2022-12-15T15:40:46.926 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2022-12-15T15:40:46.927 ERROR:paramiko.transport: 2022-12-15T15:40:46.927 ERROR:paramiko.transport:Traceback (most recent call last): 2022-12-15T15:40:46.927 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2022-12-15T15:40:46.927 ERROR:paramiko.transport: self._check_banner() 2022-12-15T15:40:46.927 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2022-12-15T15:40:46.927 ERROR:paramiko.transport: raise SSHException( 2022-12-15T15:40:46.927 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2022-12-15T15:40:46.927 ERROR:paramiko.transport: 2022-12-15T15:40:46.927 WARNING:teuthology.provision.fog:Error reading SSH protocol banner 2022-12-15T15:40:58.028 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:41:04.128 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:41:07.609 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:41:08.612 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2022-12-15T15:41:08.612 ERROR:paramiko.transport:Traceback (most recent call last): 2022-12-15T15:41:08.612 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2022-12-15T15:41:08.612 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2022-12-15T15:41:08.613 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2022-12-15T15:41:08.613 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2022-12-15T15:41:08.613 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2022-12-15T15:41:08.613 ERROR:paramiko.transport: raise EOFError() 2022-12-15T15:41:08.613 ERROR:paramiko.transport:EOFError 2022-12-15T15:41:08.613 ERROR:paramiko.transport: 2022-12-15T15:41:08.613 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2022-12-15T15:41:08.613 ERROR:paramiko.transport: 2022-12-15T15:41:08.613 ERROR:paramiko.transport:Traceback (most recent call last): 2022-12-15T15:41:08.613 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2022-12-15T15:41:08.613 ERROR:paramiko.transport: self._check_banner() 2022-12-15T15:41:08.613 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2022-12-15T15:41:08.614 ERROR:paramiko.transport: raise SSHException( 2022-12-15T15:41:08.614 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2022-12-15T15:41:08.614 ERROR:paramiko.transport: 2022-12-15T15:41:08.614 WARNING:teuthology.provision.fog:Error reading SSH protocol banner 2022-12-15T15:41:19.719 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:41:25.726 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2022-12-15T15:41:25.726 ERROR:paramiko.transport:Traceback (most recent call last): 2022-12-15T15:41:25.726 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2022-12-15T15:41:25.726 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2022-12-15T15:41:25.726 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2022-12-15T15:41:25.727 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2022-12-15T15:41:25.727 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2022-12-15T15:41:25.727 ERROR:paramiko.transport: raise EOFError() 2022-12-15T15:41:25.727 ERROR:paramiko.transport:EOFError 2022-12-15T15:41:25.727 ERROR:paramiko.transport: 2022-12-15T15:41:25.727 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2022-12-15T15:41:25.727 ERROR:paramiko.transport: 2022-12-15T15:41:25.727 ERROR:paramiko.transport:Traceback (most recent call last): 2022-12-15T15:41:25.727 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2022-12-15T15:41:25.727 ERROR:paramiko.transport: self._check_banner() 2022-12-15T15:41:25.728 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2022-12-15T15:41:25.728 ERROR:paramiko.transport: raise SSHException( 2022-12-15T15:41:25.728 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2022-12-15T15:41:25.728 ERROR:paramiko.transport: 2022-12-15T15:41:25.728 WARNING:teuthology.provision.fog:Error reading SSH protocol banner 2022-12-15T15:41:36.832 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:41:42.931 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:41:49.032 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:41:50.332 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2022-12-15T15:42:56.048 WARNING:teuthology.provision.fog:timed out 2022-12-15T15:43:26.244 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-15T15:43:51.760 INFO:teuthology.provision.fog.smithi098:Node is ready 2022-12-15T15:43:51.779 INFO:teuthology.orchestra.run.smithi098.stdout:smithi055 2022-12-15T15:43:51.985 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2022-12-15T15:44:22.235 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2022-12-15T15:44:22.236 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-15T15:44:23.534 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2022-12-15T15:44:23.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2022-12-15T15:44:27.376 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2022-12-15T15:44:27.435 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2022-12-15T15:44:27.436 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)" 2022-12-15T15:44:27.436 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2022-12-15T15:44:27.436 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2022-12-15T15:44:27.436 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6" 2022-12-15T15:44:27.436 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2022-12-15T15:44:27.437 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-15T15:44:27.437 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2022-12-15T15:44:27.437 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-15T15:44:27.437 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2022-12-15T15:44:27.438 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-15T15:44:27.438 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-15T15:44:27.438 INFO:teuthology.orchestra.run.smithi098.stdout: 2022-12-15T15:44:27.438 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-15T15:44:27.438 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-15T15:44:27.438 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-15T15:44:27.439 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-15T15:44:27.441 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2022-12-15T15:44:37.558 INFO:teuthology.dispatcher.supervisor:Running job 7118846 2022-12-15T15:44:37.558 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2022-12-15_13:01:22-rbd-wip-dis-testing-distro-default-smithi/7118846 --name dis-2022-12-15_13:01:22-rbd-wip-dis-testing-distro-default-smithi --description rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} -- /home/teuthworker/archive/dis-2022-12-15_13:01:22-rbd-wip-dis-testing-distro-default-smithi/7118846/orig.config.yaml 2022-12-15T15:44:37.562 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2022-12-15_13:01:22-rbd-wip-dis-testing-distro-default-smithi/7118846 2022-12-15T15:44:37.562 INFO:teuthology.dispatcher.supervisor:Job PID: 17368 2022-12-15T15:44:37.563 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-12-15T15:48:47.704 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1