2023-06-22T17:19:23.145 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T17:19:23.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:19:23.147 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:19:23.306 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d5f6b78b0>, signals=[15]) 2023-06-22T17:19:23.307 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2023-06-22T17:19:23.308 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T17:19:23.308 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-06-22T17:19:23.329 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-06-22T17:19:23.330 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T17:19:23.330 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-06-22T17:19:23.331 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"} 2023-06-22T17:19:23.354 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-06-22T17:19:23.407 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-22T17:19:23.427 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-22T17:19:23.454 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-22T17:19:23.454 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 7} 2023-06-22T17:19:23.471 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-22T17:19:23.471 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 7} 2023-06-22T17:19:23.504 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of rhel 8.4 2023-06-22T17:19:23.505 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:19:23.514 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.4 2023-06-22T17:19:23.514 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:19:23.580 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T17:19:23.583 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T17:19:23.617 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1} 2023-06-22T17:19:23.621 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-06-22T17:19:23.679 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:19:23.681 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:19:23.779 INFO:teuthology.orchestra.console:Power off smithi120 2023-06-22T17:19:23.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T17:19:23.794 INFO:teuthology.orchestra.console:Power off smithi139 2023-06-22T17:19:23.795 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T17:19:23.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:19:23.815 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:19:23.925 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2023-06-22T17:19:23.937 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-06-22T17:19:24.026 INFO:teuthology.orchestra.console:Power on smithi120 2023-06-22T17:19:24.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T17:19:24.038 INFO:teuthology.orchestra.console:Power on smithi139 2023-06-22T17:19:24.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T17:19:24.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:19:24.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:19:28.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:19:28.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:19:32.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:19:32.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:19:32.400 INFO:teuthology.orchestra.console:Power on for smithi120 completed 2023-06-22T17:19:32.407 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-06-22T17:19:32.501 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2023-06-22T17:19:32.502 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:19:32.508 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-06-22T17:19:32.508 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:19:47.581 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:19:47.583 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:20:02.664 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:20:02.665 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:20:17.764 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:20:17.765 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:20:32.848 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:20:32.849 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:20:47.928 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:20:47.930 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:21:03.012 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:21:03.014 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:21:18.086 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:21:18.087 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:21:33.156 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:21:33.157 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:21:48.224 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:21:48.225 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:22:03.294 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:22:03.295 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:22:18.356 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-22T17:22:18.358 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-06-22T17:22:18.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:22:18.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:22:36.784 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-22T17:22:36.785 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-22T17:22:42.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:22:42.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:22:45.872 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-22T17:22:45.873 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-22T17:22:51.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:22:51.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:22:54.928 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-22T17:22:54.929 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-22T17:23:00.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:23:00.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:23:04.020 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-22T17:23:04.021 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-22T17:23:10.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:23:10.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:23:13.104 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-06-22T17:23:19.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:23:28.500 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-22T17:23:34.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:23:37.584 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-22T17:23:43.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:23:46.640 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-22T17:23:52.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:23:53.463 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T17:23:53.465 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T17:24:09.651 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-06-22T17:24:09.651 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-06-22T17:24:09.667 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-06-22T17:24:09.668 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-06-22T17:24:09.722 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-06-22T17:24:09.723 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-06-22T17:24:09.874 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-06-22T17:24:09.899 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-06-22T17:24:09.963 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-06-22T17:24:10.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-06-22T17:24:10.090 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-06-22T17:24:10.143 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T17:24:10.144 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.4 (Ootpa)" 2023-06-22T17:24:10.144 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-06-22T17:24:10.144 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-06-22T17:24:10.144 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.4" 2023-06-22T17:24:10.144 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-06-22T17:24:10.144 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-22T17:24:10.144 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-06-22T17:24:10.145 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-22T17:24:10.145 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T17:24:10.145 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T17:24:10.145 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T17:24:10.145 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-06-22T17:24:10.145 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T17:24:10.145 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-22T17:24:10.146 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T17:24:10.146 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-22T17:24:10.146 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-06-22T17:24:10.148 DEBUG:teuthology.parallel:result is None 2023-06-22T17:24:19.117 WARNING:teuthology.provision.fog.smithi120:timed out 2023-06-22T17:24:25.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:24:25.400 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T17:24:25.400 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T17:24:25.672 INFO:teuthology.provision.fog.smithi120:Node is ready 2023-06-22T17:24:25.672 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2023-06-22T17:24:25.687 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2023-06-22T17:24:25.687 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2023-06-22T17:24:25.741 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2023-06-22T17:24:25.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-06-22T17:24:25.872 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2023-06-22T17:24:25.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2023-06-22T17:24:25.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2023-06-22T17:24:26.027 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-06-22T17:24:26.089 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-06-22T17:24:26.143 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T17:24:26.143 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.4 (Ootpa)" 2023-06-22T17:24:26.143 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2023-06-22T17:24:26.144 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2023-06-22T17:24:26.144 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.4" 2023-06-22T17:24:26.144 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-06-22T17:24:26.144 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-22T17:24:26.144 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-06-22T17:24:26.144 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-22T17:24:26.144 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T17:24:26.145 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T17:24:26.145 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T17:24:26.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-06-22T17:24:26.145 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T17:24:26.145 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-22T17:24:26.145 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T17:24:26.145 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-22T17:24:26.146 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2023-06-22T17:24:26.146 DEBUG:teuthology.parallel:result is None 2023-06-22T17:24:26.304 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2023-06-22T17:24:26.305 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T17:24:26.335 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-06-22T17:24:26.336 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T17:24:26.361 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2023-06-22T17:24:26.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-06-22T17:24:26.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:24:26.427 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-06-22T17:24:26.493 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-06-22T17:24:26.546 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-06-22T17:24:26.546 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-06-22T17:24:26.598 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T17:24:26.599 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.4 (Ootpa)" 2023-06-22T17:24:26.599 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2023-06-22T17:24:26.599 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2023-06-22T17:24:26.599 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.4" 2023-06-22T17:24:26.599 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-06-22T17:24:26.599 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-22T17:24:26.599 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-06-22T17:24:26.600 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-22T17:24:26.600 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T17:24:26.600 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T17:24:26.600 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T17:24:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-06-22T17:24:26.600 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T17:24:26.600 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-22T17:24:26.601 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T17:24:26.601 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-22T17:24:26.601 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-06-22T17:24:26.627 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-06-22T17:24:26.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-06-22T17:24:26.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T17:24:26.694 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-06-22T17:24:26.810 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-06-22T17:24:26.864 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-06-22T17:24:26.865 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-06-22T17:24:26.918 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T17:24:26.918 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.4 (Ootpa)" 2023-06-22T17:24:26.918 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-06-22T17:24:26.918 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-06-22T17:24:26.919 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.4" 2023-06-22T17:24:26.919 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-06-22T17:24:26.919 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-22T17:24:26.919 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-06-22T17:24:26.919 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-22T17:24:26.919 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T17:24:26.919 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T17:24:26.920 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T17:24:26.920 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-06-22T17:24:26.920 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T17:24:26.920 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-22T17:24:26.920 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T17:24:26.920 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-22T17:24:26.921 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-06-22T17:24:26.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:24:26.944 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:24:27.032 INFO:teuthology.dispatcher.supervisor:Running job 7311839 2023-06-22T17:24:27.033 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311839 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311839/orig.config.yaml 2023-06-22T17:24:27.036 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311839 2023-06-22T17:24:27.037 INFO:teuthology.dispatcher.supervisor:Job PID: 13914 2023-06-22T17:24:27.037 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-22T17:26:27.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:26:27.137 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:28:27.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:28:27.337 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:30:27.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:30:27.514 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:32:27.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:32:27.681 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:34:27.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:34:27.848 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:36:28.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:36:28.014 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:38:28.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:38:28.186 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:40:28.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:40:28.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:42:28.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:42:28.535 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:44:28.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T17:44:28.918 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T17:44:28.991 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-22T17:44:29.097 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-22T17:44:29.098 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T17:44:29.143 DEBUG:teuthology.nuke:shortname: smithi120 2023-06-22T17:44:29.144 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T17:44:29.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 17:19:22.337471', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxFLTLHWwJrOQ6Cz5bDe7eS5pFg/nAEnX9lMuaqbPqz/Nqo9fgIUeEgTrq1aDy7W0j/SmyNcR/OGDcsdXjoNcg='} 2023-06-22T17:44:29.175 DEBUG:teuthology.nuke:shortname: smithi139 2023-06-22T17:44:29.175 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T17:44:29.200 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 17:19:22.339546', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDpuPeyGh8IWXM3T2Vm/RLbm03pBBePhy7M2HaBtn3bC5A2dhk6N5pXdiNj8ISS+UJwsbNoICsnoaBeFMMHtXiTYX328eUTo1L4jeInzqdL+QStKsO4CwrvzRY2s6gTOUhr5PStMAEF9NWyPzmZU4CvVX82fqJPWggFxtAt2Co1/RQ31b7thXCcwxsfy5wVsrNzYRW4WsZOuS2Ms4oORvB+3aeY39kMRNJGKoGpOumW/8RlA32o6+IX00iaIAGCfF+Q/O81itooznEvvDZGbZ/EE6ULNcQlBIrG6dE5ZF6BucdoD3lnw5QBBMRYd6EItafSc6gN4uPFVaY1vceJ3UqUVg2g3apeVqNVbolKN9xehf7K7d95g/ugfRm34qcyq0xFg8A9vI0eQN9K08PtokP6rz3fADlpIXPWpSYOmpB90J0hH6iLnszALcWD0dfY0FAYs/hkAyS5Vebs2PpJSXLjhJ7lzdXFqIu6pyadkQDQD/CZY4625WM0C6iAC9WrCoE='} 2023-06-22T17:44:29.224 INFO:teuthology.orchestra.console:Power off smithi120 2023-06-22T17:44:29.225 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T17:44:29.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:44:29.272 INFO:teuthology.orchestra.console:Power off smithi139 2023-06-22T17:44:29.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T17:44:29.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T17:44:29.382 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2023-06-22T17:44:29.415 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-06-22T17:44:29.531 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com 2023-06-22T17:44:29.565 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com