2023-06-23T00:41:47.762 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T00:41:47.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:41:47.764 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:41:47.937 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc2fd8428b0>, signals=[15]) 2023-06-23T00:41:47.939 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2023-06-23T00:41:47.939 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T00:41:47.940 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-06-23T00:41:47.961 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-06-23T00:41:47.961 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T00:41:47.962 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-06-23T00:41:47.963 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /host {"name": "smithi039"} 2023-06-23T00:41:47.986 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-06-23T00:41:48.034 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-23T00:41:48.050 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-23T00:41:48.069 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-23T00:41:48.069 DEBUG:teuthology.provision.fog.smithi039:FOG request: PUT /host/144 {"imageID": 7} 2023-06-23T00:41:48.090 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-23T00:41:48.090 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 7} 2023-06-23T00:41:48.114 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of rhel 8.4 2023-06-23T00:41:48.114 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:41:48.130 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.4 2023-06-23T00:41:48.130 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:41:48.178 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T00:41:48.187 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T00:41:48.213 DEBUG:teuthology.provision.fog.smithi039:FOG request: POST /host/144/task {"taskTypeID": 1} 2023-06-23T00:41:48.226 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-06-23T00:41:48.270 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:41:48.278 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:41:48.372 INFO:teuthology.orchestra.console:Power off smithi039 2023-06-23T00:41:48.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:41:48.389 INFO:teuthology.orchestra.console:Power off smithi073 2023-06-23T00:41:48.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:41:48.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:41:48.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:41:48.522 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2023-06-23T00:41:48.535 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-06-23T00:41:48.624 INFO:teuthology.orchestra.console:Power on smithi039 2023-06-23T00:41:48.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T00:41:48.637 INFO:teuthology.orchestra.console:Power on smithi073 2023-06-23T00:41:48.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T00:41:48.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:41:48.661 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:41:52.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:41:52.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:41:52.896 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2023-06-23T00:41:52.997 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-06-23T00:41:52.998 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:41:56.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:41:56.999 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2023-06-23T00:41:57.100 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2023-06-23T00:41:57.101 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:42:08.076 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:42:12.168 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:42:23.168 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:42:27.250 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:42:38.256 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:42:42.328 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:42:53.344 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:42:57.412 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:43:08.420 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:43:12.493 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:43:23.512 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:43:27.576 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:43:38.600 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:43:42.652 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:43:53.687 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:43:57.739 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:44:08.788 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:44:12.832 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:44:23.872 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:44:27.913 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:44:38.956 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-23T00:44:39.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:44:42.996 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:44:57.585 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-23T00:44:58.069 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:45:03.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:06.676 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-23T00:45:12.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:13.139 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-06-23T00:45:13.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:15.760 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-23T00:45:21.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:24.820 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-23T00:45:30.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:31.632 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-06-23T00:45:33.904 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-23T00:45:37.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:39.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:40.688 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-06-23T00:45:46.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:49.744 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-06-23T00:45:55.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:45:58.804 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-06-23T00:46:04.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:46:07.888 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-06-23T00:46:13.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:46:16.944 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-06-23T00:46:22.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:46:26.000 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-06-23T00:46:32.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:46:39.916 WARNING:teuthology.provision.fog.smithi073:timed out 2023-06-23T00:46:45.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:46:46.306 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T00:46:46.307 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T00:46:46.602 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-06-23T00:46:46.603 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-06-23T00:46:46.619 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 2023-06-23T00:46:46.620 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073 /etc/hosts 2023-06-23T00:46:46.675 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-06-23T00:46:46.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-06-23T00:46:46.788 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073/smithi073/g' /etc/hosts 2023-06-23T00:46:46.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2023-06-23T00:46:46.882 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073/smithi073/g' /etc/hostname 2023-06-23T00:46:46.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-06-23T00:46:47.011 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-06-23T00:46:47.066 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:46:47.066 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:46:47.066 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-06-23T00:46:47.066 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-06-23T00:46:47.067 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.4" 2023-06-23T00:46:47.067 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:46:47.067 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:46:47.067 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-06-23T00:46:47.067 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:46:47.067 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:46:47.067 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:46:47.067 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:46:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-06-23T00:46:47.068 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:46:47.068 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:46:47.068 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:46:47.068 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:46:47.069 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-06-23T00:46:47.070 DEBUG:teuthology.parallel:result is None 2023-06-23T00:47:32.052 WARNING:teuthology.provision.fog.smithi039:timed out 2023-06-23T00:47:38.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:47:38.381 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T00:47:38.381 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T00:47:38.659 INFO:teuthology.provision.fog.smithi039:Node is ready 2023-06-23T00:47:38.660 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2023-06-23T00:47:38.677 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2023-06-23T00:47:38.678 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2023-06-23T00:47:38.734 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2023-06-23T00:47:38.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-06-23T00:47:38.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2023-06-23T00:47:38.885 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2023-06-23T00:47:38.952 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2023-06-23T00:47:39.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-06-23T00:47:39.081 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-06-23T00:47:39.136 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:47:39.136 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:47:39.136 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel" 2023-06-23T00:47:39.137 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora" 2023-06-23T00:47:39.137 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.4" 2023-06-23T00:47:39.137 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:47:39.137 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:47:39.137 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-06-23T00:47:39.137 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:47:39.137 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:47:39.138 INFO:teuthology.orchestra.run.smithi039.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:47:39.138 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:47:39.138 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-06-23T00:47:39.138 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:47:39.138 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:47:39.138 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:47:39.138 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:47:39.139 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2023-06-23T00:47:39.139 DEBUG:teuthology.parallel:result is None 2023-06-23T00:47:39.294 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2023-06-23T00:47:39.295 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T00:47:39.319 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-06-23T00:47:39.319 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T00:47:39.345 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2023-06-23T00:47:39.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-06-23T00:47:39.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:47:39.410 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-06-23T00:47:39.479 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2023-06-23T00:47:39.532 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-06-23T00:47:39.533 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-06-23T00:47:39.588 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:47:39.588 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:47:39.588 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel" 2023-06-23T00:47:39.589 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora" 2023-06-23T00:47:39.589 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.4" 2023-06-23T00:47:39.589 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:47:39.589 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:47:39.589 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-06-23T00:47:39.589 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:47:39.589 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:47:39.590 INFO:teuthology.orchestra.run.smithi039.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:47:39.590 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:47:39.590 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-06-23T00:47:39.590 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:47:39.590 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:47:39.590 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:47:39.590 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:47:39.591 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-06-23T00:47:39.611 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-06-23T00:47:39.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-06-23T00:47:39.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:47:39.685 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-06-23T00:47:39.803 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-06-23T00:47:39.857 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-06-23T00:47:39.857 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-06-23T00:47:39.912 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:47:39.912 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:47:39.912 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-06-23T00:47:39.912 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-06-23T00:47:39.912 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.4" 2023-06-23T00:47:39.913 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:47:39.913 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:47:39.913 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-06-23T00:47:39.913 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:47:39.913 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:47:39.913 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:47:39.913 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:47:39.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-06-23T00:47:39.914 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:47:39.914 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:47:39.914 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:47:39.914 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:47:39.915 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-06-23T00:47:39.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:47:39.936 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:47:40.039 INFO:teuthology.dispatcher.supervisor:Running job 7311920 2023-06-23T00:47:40.039 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311920 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311920/orig.config.yaml 2023-06-23T00:47:40.042 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311920 2023-06-23T00:47:40.044 INFO:teuthology.dispatcher.supervisor:Job PID: 29622 2023-06-23T00:47:40.044 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-23T00:49:40.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:49:40.145 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:51:40.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:51:40.326 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:53:40.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:53:40.498 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:55:40.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:55:40.682 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:57:40.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:57:40.876 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:59:41.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:59:41.062 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:01:41.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:01:41.238 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:03:41.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:03:41.405 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:05:41.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:05:41.582 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:07:41.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:07:41.758 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:09:41.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:09:41.929 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T01:09:42.005 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-23T01:09:42.119 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-23T01:09:42.120 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T01:09:42.171 DEBUG:teuthology.nuke:shortname: smithi039 2023-06-23T01:09:42.172 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T01:09:42.195 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311920', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:41:46.876679', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+FEBb0lM2JOjErPpPnTaufA95sbkevpUNdZRQxeWME9cdgBhMzKCyPEvUN+ik/0QBSqca9d17MEbfEIIxoqNw='} 2023-06-23T01:09:42.200 DEBUG:teuthology.nuke:shortname: smithi073 2023-06-23T01:09:42.201 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T01:09:42.226 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311920', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:41:46.878554', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiGlkx9VorGvQLNcRASuoLUUj4Sv96vdo3OTdVFt9DQkbdF27RlK8Tj2JUas2bUAA8yZ89j7Io0YejSM2nYka4iKTaGqgBVxa4tHUZ+d4PT8GrVn3U/U91xQCGU2+8rgcNAWMPYAC+e4xor6VjopW1+k6DKiC2tc0pL+tMD5EpPA1VVUciLB6I3gSD0Y9Dcjf2mNIzaxnDl+CW6oUcyfq/TGw6tsluKyr14CE6ZELMn1kvUM/zH/P5uQKUiQyhYKzy5JnUzlawpMUQvpCvN1AlqlY1lVyPEogq6bCRl7Rkn+61H4uA85igg/9l29bMuHi4uVHnB+Q02Em6+aVr4/PUnOOyOdvQopTeZm/ZBHYnP5gSo3I+Kk6gr+VGT+lG7F8lBaqzvCCBOWQzLXyuEAuZRwhM5+S2MNEbU5xXPMr3XGp3GrPvCZbzZDmJMqypLlRB7f26kRXilC26fl5ODcmPEK3ecNT+JMwjUxGJCmWiz/BYXrPBZCR4LdJl0OqDqEM='} 2023-06-23T01:09:42.260 INFO:teuthology.orchestra.console:Power off smithi039 2023-06-23T01:09:42.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T01:09:42.283 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:09:42.304 INFO:teuthology.orchestra.console:Power off smithi073 2023-06-23T01:09:42.305 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T01:09:42.327 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:09:42.416 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2023-06-23T01:09:42.450 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-06-23T01:09:42.569 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com 2023-06-23T01:09:42.594 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com