2023-07-13T03:38:58.063 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T03:38:58.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T03:38:58.065 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T03:38:58.243 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6f66883790>, signals=[15]) 2023-07-13T03:38:58.244 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-07-13T03:38:58.245 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T03:38:58.245 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-07-13T03:38:58.265 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-07-13T03:38:58.266 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T03:38:58.266 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-13T03:38:58.267 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /host {"name": "smithi043"} 2023-07-13T03:38:58.290 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-07-13T03:38:58.290 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T03:38:58.291 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-07-13T03:38:58.292 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-07-13T03:38:58.315 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-07-13T03:38:58.335 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T03:38:58.361 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T03:38:58.376 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T03:38:58.376 DEBUG:teuthology.provision.fog.smithi043:FOG request: PUT /host/148 {"imageID": 3} 2023-07-13T03:38:58.379 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T03:38:58.402 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T03:38:58.402 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 3} 2023-07-13T03:38:58.415 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T03:38:58.416 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 3} 2023-07-13T03:38:58.423 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 8.stream 2023-07-13T03:38:58.423 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:38:58.445 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 8.stream 2023-07-13T03:38:58.445 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:38:58.455 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.stream 2023-07-13T03:38:58.455 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:38:58.499 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T03:38:58.532 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T03:38:58.536 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T03:38:58.539 DEBUG:teuthology.provision.fog.smithi043:FOG request: POST /host/148/task {"taskTypeID": 1} 2023-07-13T03:38:58.563 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-07-13T03:38:58.575 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-07-13T03:38:58.587 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:38:58.621 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:38:58.631 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:38:58.712 INFO:teuthology.orchestra.console:Power off smithi043 2023-07-13T03:38:58.713 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T03:38:58.732 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-13T03:38:58.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T03:38:58.743 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:38:58.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:38:58.771 INFO:teuthology.orchestra.console:Power off smithi158 2023-07-13T03:38:58.771 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T03:38:58.790 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:38:58.865 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2023-07-13T03:38:58.910 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-07-13T03:38:58.966 INFO:teuthology.orchestra.console:Power on smithi043 2023-07-13T03:38:58.967 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T03:38:58.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:38:59.011 INFO:teuthology.orchestra.console:Power on smithi158 2023-07-13T03:38:59.011 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T03:38:59.031 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:39:02.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:39:03.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:39:03.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:39:03.220 INFO:teuthology.orchestra.console:Power on for smithi043 completed 2023-07-13T03:39:03.262 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2023-07-13T03:39:03.322 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-07-13T03:39:03.323 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:39:03.363 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-07-13T03:39:03.364 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:39:06.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:39:07.107 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-13T03:39:07.208 INFO:teuthology.orchestra.console:Power on smithi093 2023-07-13T03:39:07.208 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T03:39:07.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:39:11.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:39:15.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T03:39:15.578 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2023-07-13T03:39:15.679 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-07-13T03:39:15.680 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:39:18.444 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:39:18.514 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:39:31.157 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:39:33.686 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:39:33.758 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:39:46.349 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:39:48.913 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:39:48.999 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:40:01.668 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:40:04.155 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:40:04.302 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:40:16.900 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:40:19.384 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:40:19.523 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:40:32.116 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:40:34.604 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:40:34.741 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:40:47.366 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:40:49.899 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:40:50.032 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:41:02.784 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:41:05.225 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:41:05.413 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:41:18.134 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:41:20.502 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:41:20.642 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:41:33.503 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:41:35.805 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-13T03:41:35.983 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:41:36.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:41:48.895 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:41:51.358 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:41:54.672 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-13T03:42:00.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:42:03.760 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-13T03:42:04.203 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:42:06.939 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:42:09.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:42:12.816 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-13T03:42:18.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:42:19.552 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:42:21.904 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-13T03:42:22.233 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:42:27.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:42:34.828 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:42:37.452 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:42:50.160 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:42:52.748 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:43:05.752 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:43:08.032 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:43:21.192 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:43:23.402 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:43:27.917 WARNING:teuthology.provision.fog.smithi043:timed out 2023-07-13T03:43:33.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:43:34.166 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T03:43:34.167 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T03:43:34.417 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-07-13T03:43:34.417 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2023-07-13T03:43:34.437 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2023-07-13T03:43:34.437 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2023-07-13T03:43:34.497 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2023-07-13T03:43:34.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-07-13T03:43:34.604 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2023-07-13T03:43:34.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2023-07-13T03:43:34.703 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2023-07-13T03:43:34.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-07-13T03:43:34.839 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-07-13T03:43:34.897 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-07-13T03:43:34.898 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2023-07-13T03:43:34.898 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-07-13T03:43:34.898 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-07-13T03:43:34.898 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2023-07-13T03:43:34.898 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-07-13T03:43:34.898 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T03:43:34.899 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-07-13T03:43:34.899 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T03:43:34.899 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-07-13T03:43:34.899 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T03:43:34.899 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T03:43:34.899 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T03:43:34.900 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-07-13T03:43:34.901 DEBUG:teuthology.parallel:result is None 2023-07-13T03:43:36.559 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:43:38.627 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:43:51.927 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:43:54.183 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:44:07.247 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:44:09.590 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:44:22.644 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:44:25.248 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:44:37.944 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:44:40.577 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:44:53.282 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:44:56.000 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:45:08.620 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:45:11.500 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:45:23.944 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:45:26.844 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:45:39.252 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:45:42.183 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:45:54.424 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:45:57.506 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:46:09.680 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:46:12.924 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:46:24.993 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:46:28.272 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:46:40.288 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:46:43.620 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:46:55.580 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:46:58.936 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:47:10.776 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:47:14.244 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:47:25.962 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:47:29.504 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:47:41.236 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:47:44.760 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:47:56.500 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:48:00.012 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:48:11.744 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:48:15.256 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:48:26.980 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:48:30.476 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:48:42.209 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:48:45.684 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:48:57.452 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:49:00.880 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:49:12.660 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:49:16.080 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:49:27.876 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:49:31.276 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:49:43.088 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:49:46.480 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:49:58.271 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:50:01.696 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:50:13.464 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:50:16.900 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:50:28.636 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:50:32.061 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:50:43.808 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-13T03:50:43.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:50:47.000 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-13T03:50:47.225 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:50:53.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:50:56.080 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-13T03:51:02.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:51:02.365 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:51:05.136 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-13T03:51:11.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:51:14.192 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-13T03:51:17.513 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:51:20.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:51:23.248 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-13T03:51:29.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:51:32.304 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-13T03:51:32.622 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:51:38.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:51:47.747 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:52:02.873 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:52:17.984 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:52:33.096 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:52:38.314 WARNING:teuthology.provision.fog.smithi093:timed out 2023-07-13T03:52:44.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:52:44.533 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T03:52:44.534 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T03:52:44.812 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-07-13T03:52:44.813 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-07-13T03:52:44.834 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2023-07-13T03:52:44.834 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts 2023-07-13T03:52:44.896 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-07-13T03:52:44.896 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-13T03:52:45.010 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts 2023-07-13T03:52:45.045 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-07-13T03:52:45.120 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname 2023-07-13T03:52:45.194 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-13T03:52:45.269 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-13T03:52:45.331 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-13T03:52:45.331 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8" 2023-07-13T03:52:45.331 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-13T03:52:45.331 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-13T03:52:45.331 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8" 2023-07-13T03:52:45.332 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-13T03:52:45.332 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T03:52:45.332 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-13T03:52:45.332 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T03:52:45.332 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-13T03:52:45.332 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T03:52:45.333 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T03:52:45.333 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T03:52:45.334 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-07-13T03:52:45.334 DEBUG:teuthology.parallel:result is None 2023-07-13T03:52:48.198 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:53:03.270 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:53:18.349 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:53:33.414 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:53:48.480 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:54:03.542 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:54:18.607 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-13T03:54:18.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:54:21.716 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:54:27.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:54:30.772 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:54:36.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:54:39.824 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:54:45.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:54:48.880 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:54:54.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:54:57.936 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:55:03.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:55:06.992 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:55:12.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:55:16.048 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:55:22.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:55:25.104 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:55:31.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:55:34.160 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-13T03:55:40.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:56:40.163 WARNING:teuthology.provision.fog.smithi158:timed out 2023-07-13T03:56:46.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:56:46.419 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T03:56:46.419 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T03:56:46.703 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-07-13T03:56:46.703 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-07-13T03:56:46.723 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-07-13T03:56:46.723 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2023-07-13T03:56:46.783 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-07-13T03:56:46.784 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-07-13T03:56:46.892 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2023-07-13T03:56:46.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-07-13T03:56:46.994 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2023-07-13T03:56:47.063 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-07-13T03:56:47.132 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-07-13T03:56:47.190 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-07-13T03:56:47.190 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-07-13T03:56:47.190 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-07-13T03:56:47.191 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-07-13T03:56:47.191 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-07-13T03:56:47.191 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-07-13T03:56:47.191 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T03:56:47.191 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-07-13T03:56:47.191 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T03:56:47.192 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-07-13T03:56:47.192 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T03:56:47.192 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T03:56:47.192 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T03:56:47.192 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-07-13T03:56:47.193 DEBUG:teuthology.parallel:result is None 2023-07-13T03:56:47.392 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-07-13T03:56:47.394 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T03:56:47.430 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-07-13T03:56:47.430 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T03:56:47.455 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-07-13T03:56:47.455 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T03:56:47.473 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-07-13T03:56:47.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-07-13T03:56:47.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:56:47.545 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-07-13T03:56:47.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-07-13T03:56:47.642 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-07-13T03:56:47.706 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-07-13T03:56:47.706 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-07-13T03:56:47.766 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-07-13T03:56:47.766 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2023-07-13T03:56:47.766 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-07-13T03:56:47.767 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-07-13T03:56:47.767 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2023-07-13T03:56:47.767 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-07-13T03:56:47.768 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T03:56:47.768 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-07-13T03:56:47.768 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T03:56:47.768 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-07-13T03:56:47.769 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T03:56:47.769 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T03:56:47.769 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T03:56:47.770 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-07-13T03:56:47.831 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-07-13T03:56:47.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-13T03:56:47.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:56:47.942 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-13T03:56:48.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-13T03:56:48.016 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-07-13T03:56:48.076 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-07-13T03:56:48.078 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-13T03:56:48.140 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-13T03:56:48.141 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8" 2023-07-13T03:56:48.141 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-13T03:56:48.141 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-13T03:56:48.141 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8" 2023-07-13T03:56:48.141 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-13T03:56:48.142 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T03:56:48.142 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-13T03:56:48.142 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T03:56:48.142 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-13T03:56:48.143 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T03:56:48.143 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T03:56:48.143 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T03:56:48.144 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-13T03:56:48.172 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-07-13T03:56:48.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-13T03:56:48.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T03:56:48.240 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-07-13T03:56:48.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-13T03:56:48.313 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-07-13T03:56:48.372 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-07-13T03:56:48.372 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-07-13T03:56:48.431 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-07-13T03:56:48.432 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-07-13T03:56:48.432 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-07-13T03:56:48.432 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-07-13T03:56:48.432 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-07-13T03:56:48.432 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-07-13T03:56:48.433 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T03:56:48.433 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-07-13T03:56:48.433 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T03:56:48.433 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-07-13T03:56:48.433 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T03:56:48.433 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T03:56:48.433 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T03:56:48.434 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-07-13T03:56:48.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T03:56:48.523 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T03:56:48.632 INFO:teuthology.dispatcher.supervisor:Running job 7335703 2023-07-13T03:56:48.633 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335703 --name adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi --description orch:cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} -- /home/teuthworker/archive/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335703/orig.config.yaml 2023-07-13T03:56:48.640 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335703 2023-07-13T03:56:48.641 INFO:teuthology.dispatcher.supervisor:Job PID: 20225 2023-07-13T03:56:48.641 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T03:58:48.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T03:58:48.743 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:00:48.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:00:48.966 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:02:49.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:02:49.145 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:04:49.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:04:49.346 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:06:49.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:06:49.534 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:08:49.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:08:49.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:10:49.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:10:49.895 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:12:50.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:12:50.082 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:14:50.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:14:50.249 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:16:50.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:16:50.415 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:18:50.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:18:50.590 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:20:50.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T04:20:50.767 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T04:20:50.838 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T04:20:50.965 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T04:20:50.966 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T04:20:51.009 DEBUG:teuthology.nuke:shortname: smithi043 2023-07-13T04:20:51.009 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T04:20:51.031 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 03:38:57.219457', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIdjNdvaPo0oBWiRqwLwl3nKWDUXYlR8WFD01E7BjTWuHBcCe0mbNWKhMUvckORxQc0U4Oi+p+G+8giIv95PXP5L9wzhCYa+TtW3c/QAEoTy6HVoXxXcHEYLODWJ/nVxVNh9Z4vK1CYaxJ6ugn9ShTceZMkC0L/SqdvrYbjO6gLYxgZBInY75UdAWEc3k87uG2k4DAxruA7p9s9VZERpbSU5S57TVFCiITMsIsJwZ/KfMqwH6bsfUvEBzet52zQQpwLE2OvYZqULcJOOF7VUqOrVjhjU6om/9VMs102EwtlPXhAZQ381xTeowTs5ME8OCtVPBMI/xhoqifJOPo8BHeEMUd4A1q9L0YFR3BykDrqyMujSXrst9rjPYrFrqmkzhM6Zg8IpAOvrlhDUFgUEHSMvcm5qcRDlo025KAsENY6nByfhyfeFHWro2CofGyk07dKF0+kyHCICNESFrRAtSdiD702mj6L6pKuXabA40kCQZxEpHapJ+ePmA7kxX86/U='} 2023-07-13T04:20:51.038 DEBUG:teuthology.nuke:shortname: smithi093 2023-07-13T04:20:51.038 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T04:20:51.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 03:38:57.220851', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM36FzRgOMS/Z+6aO0SNhk5t+fcdAnt07SIZc9/VDa0VPuPnapb2+NvMPJbT+4niK+6GDaKf1q5vZ+W/oaBZdd3MtLVupOg429/l2dLriR5RmtCtMy3Q/1wsjO3T4Cqng/gVIszaVEku4vtdufPH+abdRfbBsjTggiP9hHjHwqLadxpfNOgpV7g/jbfRrkyxuLEQk+UgXdWIrU4tdvWf/isbzMm9WEvH65QZCJwx9bck6X9feZNGfdrl21qoXb+WvvnqEyFm6Hr4sPCB8l/DA/2IqEeBJD3R3gd0621oZ+REbbNqgMwuBCiIMw44uSforgcsDvCFk9tdOyx4QtlOEVEszqaa/UWn9j64jnW5tpbmuyjHS0Yd0awUUEAJP4flX4FAqxm+EksxFKMrYphU9eljyNeOe/6DunUDtblFzzS/tPFnzmcJh3zpnvO6InunwT0GMrdemShcc12wY/unI+Gu3+1g0IULnxaJOxMzAKA3Kt+5XYSWZmszfDtuW4FPs='} 2023-07-13T04:20:51.061 DEBUG:teuthology.nuke:shortname: smithi158 2023-07-13T04:20:51.062 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T04:20:51.080 INFO:teuthology.orchestra.console:Power off smithi043 2023-07-13T04:20:51.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T04:20:51.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-13_03:37:58-orch:cephadm-wip-adk2-testing-2023-07-12-1752-pacific-distro-default-smithi/7335703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 03:38:57.217990', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8QfjR8YnqxeGHwFw4PxSWqAa7jVkkYiRcDe+/wB3/rVfPXT4vQg9400v6/RQHvB+3rNvkDVSMRv5EphT2auyNYPFuOqgmdTPAA+kK+MUl088gYa3LA4cSdXKvqK9aTDTUDcJZ+oOv5H75T8SoDLlNIin+WbryDBPmR03S7o/daTw1tYv0t/gPnbz9W385fsSYyOAcOU+RxV6ZC/NRJqsgbFLcXmgmNnUOjy+u7Fb7Bz+I5rQ2P4O6wmpuaUW38Wb2aZVkmJ+pIqm27qOH+oqDjrITRzzUhQFoh1B5c7Bb6Zne7uzOL5FYR9s88TpLprtVw/gpUgJaYd5eljuUQHwXIL2d+bdF0kFbslaDBkvHqHS9MKDyztB6IjnvCIcW3Gwe2gg9PCFHEBF0iHelRROcFSC/CCX/Sh6j1o97jAAvw0nSTjmZaMWvLHDicee915jpv0BYa+vEY2LK+qM81SruYUS6jilX5w2yLjq6B8VsduOYnPxKdP57rx5mWVa3KtE='} 2023-07-13T04:20:51.101 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T04:20:51.119 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-13T04:20:51.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T04:20:51.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T04:20:51.163 INFO:teuthology.orchestra.console:Power off smithi158 2023-07-13T04:20:51.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T04:20:51.182 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T04:20:51.234 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2023-07-13T04:20:51.273 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-13T04:20:51.303 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-07-13T04:20:51.387 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2023-07-13T04:20:51.429 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-07-13T04:20:51.456 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com