2023-06-22T13:04:48.863 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T13:04:48.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:04:48.865 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:04:49.023 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4f501d9550>, signals=[15]) 2023-06-22T13:04:49.025 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-06-22T13:04:49.025 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:04:49.025 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-06-22T13:04:49.052 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-06-22T13:04:49.053 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:04:49.053 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-06-22T13:04:49.054 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-06-22T13:04:49.077 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-06-22T13:04:49.142 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-22T13:04:49.149 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-22T13:04:49.194 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-22T13:04:49.195 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 5} 2023-06-22T13:04:49.203 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-22T13:04:49.204 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 5} 2023-06-22T13:04:49.236 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2023-06-22T13:04:49.236 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:04:49.249 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-06-22T13:04:49.249 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:04:49.295 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:04:49.298 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:04:49.330 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-06-22T13:04:49.335 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-06-22T13:04:49.384 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:04:49.401 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:04:49.480 INFO:teuthology.orchestra.console:Power off smithi190 2023-06-22T13:04:49.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:04:49.499 INFO:teuthology.orchestra.console:Power off smithi172 2023-06-22T13:04:49.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:04:49.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:04:49.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:04:49.633 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-06-22T13:04:49.640 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-06-22T13:04:49.734 INFO:teuthology.orchestra.console:Power on smithi190 2023-06-22T13:04:49.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:04:49.742 INFO:teuthology.orchestra.console:Power on smithi172 2023-06-22T13:04:49.743 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:04:49.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:04:49.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:04:53.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:04:53.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:04:53.995 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2023-06-22T13:04:54.097 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-06-22T13:04:54.097 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:04:57.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:04:58.097 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2023-06-22T13:04:58.198 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-06-22T13:04:58.199 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:05:09.172 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:05:13.264 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:05:24.240 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:05:28.324 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:05:39.305 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:05:43.392 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:05:54.380 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:05:58.456 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:06:09.452 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:06:13.520 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:06:24.528 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:06:28.584 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:06:39.596 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:06:43.649 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:06:54.661 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:06:58.724 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:07:09.736 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:07:13.789 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:07:24.802 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:07:28.853 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:07:39.877 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-06-22T13:07:39.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:07:39.938 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T13:07:39.940 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T13:07:39.940 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T13:07:39.941 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T13:07:39.941 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T13:07:39.941 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T13:07:39.941 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T13:07:39.942 ERROR:paramiko.transport: raise EOFError() 2023-06-22T13:07:39.942 ERROR:paramiko.transport:EOFError 2023-06-22T13:07:39.942 ERROR:paramiko.transport: 2023-06-22T13:07:39.942 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T13:07:39.942 ERROR:paramiko.transport: 2023-06-22T13:07:39.943 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T13:07:39.943 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T13:07:39.943 ERROR:paramiko.transport: self._check_banner() 2023-06-22T13:07:39.943 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T13:07:39.943 ERROR:paramiko.transport: raise SSHException( 2023-06-22T13:07:39.944 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T13:07:39.944 ERROR:paramiko.transport: 2023-06-22T13:07:39.944 WARNING:teuthology.provision.fog.smithi172:Error reading SSH protocol banner 2023-06-22T13:07:43.916 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-06-22T13:07:43.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:07:45.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:08:02.292 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-22T13:08:08.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:08:11.376 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-22T13:08:17.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:08:20.432 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-22T13:08:26.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:08:29.488 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-22T13:08:35.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:08:45.956 WARNING:teuthology.provision.fog.smithi172:timed out 2023-06-22T13:08:51.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:08:54.000 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-22T13:09:00.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:09:03.060 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-06-22T13:09:09.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:09:11.240 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:09:11.241 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:09:11.514 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-06-22T13:09:11.514 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-06-22T13:09:11.530 INFO:teuthology.orchestra.run.smithi190.stdout:smithi022 2023-06-22T13:09:11.530 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi022 /etc/hosts 2023-06-22T13:09:11.586 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-06-22T13:09:11.587 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-06-22T13:09:11.693 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi022/smithi190/g' /etc/hosts 2023-06-22T13:09:11.720 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.22/172.21.15.190/g' /etc/hosts 2023-06-22T13:09:11.786 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi022/smithi190/g' /etc/hostname 2023-06-22T13:09:11.852 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-06-22T13:09:11.918 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-06-22T13:09:11.974 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:09:11.975 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:09:11.975 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-06-22T13:09:11.975 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-06-22T13:09:11.975 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-06-22T13:09:11.975 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:09:11.975 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:09:11.976 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-06-22T13:09:11.976 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:09:11.976 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:09:11.976 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:09:11.976 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:09:11.977 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-06-22T13:09:11.977 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:09:11.977 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:09:11.977 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:09:11.977 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:09:11.978 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-06-22T13:09:11.979 DEBUG:teuthology.parallel:result is None 2023-06-22T13:09:52.001 WARNING:teuthology.provision.fog.smithi172:timed out 2023-06-22T13:09:58.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:09:58.074 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:09:58.075 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:09:58.141 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-06-22T13:09:58.141 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-06-22T13:09:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172 2023-06-22T13:09:58.198 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172 /etc/hosts 2023-06-22T13:09:58.254 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172 smithi172 2023-06-22T13:09:58.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-06-22T13:09:58.321 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hosts 2023-06-22T13:09:58.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-06-22T13:09:58.455 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hostname 2023-06-22T13:09:58.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-06-22T13:09:58.589 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-06-22T13:09:58.645 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:09:58.645 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:09:58.645 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-06-22T13:09:58.645 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-06-22T13:09:58.645 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-06-22T13:09:58.646 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:09:58.646 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:09:58.646 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-06-22T13:09:58.646 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:09:58.646 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:09:58.646 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:09:58.646 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:09:58.647 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-06-22T13:09:58.647 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:09:58.647 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:09:58.647 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:09:58.647 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:09:58.647 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-06-22T13:09:58.648 DEBUG:teuthology.parallel:result is None 2023-06-22T13:09:58.807 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-06-22T13:09:58.808 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-06-22T13:09:58.808 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T13:09:58.834 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:09:58.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-06-22T13:09:58.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:09:58.901 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-06-22T13:09:58.922 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-06-22T13:09:58.980 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-06-22T13:09:58.980 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-06-22T13:09:59.036 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:09:59.036 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:09:59.036 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-06-22T13:09:59.037 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-06-22T13:09:59.037 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-06-22T13:09:59.037 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:09:59.037 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:09:59.037 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-06-22T13:09:59.038 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:09:59.038 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:09:59.038 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:09:59.038 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:09:59.038 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-06-22T13:09:59.039 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:09:59.039 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:09:59.039 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:09:59.039 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:09:59.039 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-06-22T13:09:59.066 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:09:59.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-06-22T13:09:59.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:09:59.133 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-06-22T13:09:59.226 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-06-22T13:09:59.283 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-06-22T13:09:59.284 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-06-22T13:09:59.341 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:09:59.341 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:09:59.342 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-06-22T13:09:59.342 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-06-22T13:09:59.342 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-06-22T13:09:59.343 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:09:59.343 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:09:59.343 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-06-22T13:09:59.343 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:09:59.343 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:09:59.343 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:09:59.343 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:09:59.344 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-06-22T13:09:59.344 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:09:59.344 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:09:59.344 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:09:59.344 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:09:59.345 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-06-22T13:09:59.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:09:59.375 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:09:59.477 INFO:teuthology.dispatcher.supervisor:Running job 7311687 2023-06-22T13:09:59.478 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2023-06-22_12:38:55-fs-main-distro-default-smithi/7311687 --name amathuri-2023-06-22_12:38:55-fs-main-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} -- /home/teuthworker/archive/amathuri-2023-06-22_12:38:55-fs-main-distro-default-smithi/7311687/orig.config.yaml 2023-06-22T13:09:59.482 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2023-06-22_12:38:55-fs-main-distro-default-smithi/7311687 2023-06-22T13:09:59.483 INFO:teuthology.dispatcher.supervisor:Job PID: 30287 2023-06-22T13:09:59.483 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-22T13:11:59.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:11:59.584 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:13:59.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:13:59.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:15:59.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:15:59.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:18:00.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:18:00.110 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:20:00.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:20:00.278 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:22:00.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:22:00.462 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:24:00.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:24:00.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:26:00.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:26:00.828 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:26:00.897 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-22T13:26:01.068 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-22T13:26:01.069 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T13:26:01.118 DEBUG:teuthology.nuke:shortname: smithi172 2023-06-22T13:26:01.119 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T13:26:01.138 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-06-22_12:38:55-fs-main-distro-default-smithi/7311687', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:04:48.036090', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-22T13:26:01.152 DEBUG:teuthology.nuke:shortname: smithi190 2023-06-22T13:26:01.152 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T13:26:01.176 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-06-22_12:38:55-fs-main-distro-default-smithi/7311687', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:04:48.037602', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-22T13:26:01.190 INFO:teuthology.orchestra.console:Power off smithi172 2023-06-22T13:26:01.191 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:26:01.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:26:01.233 INFO:teuthology.orchestra.console:Power off smithi190 2023-06-22T13:26:01.234 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:26:01.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:26:01.345 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-06-22T13:26:01.378 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-06-22T13:26:01.504 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com 2023-06-22T13:26:01.531 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com