2023-07-08T00:22:35.611 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-08T00:22:35.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:22:35.613 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:22:35.836 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f190df41ee0>, signals=[15]) 2023-07-08T00:22:35.839 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2023-07-08T00:22:35.839 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T00:22:35.840 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-07-08T00:22:35.869 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-07-08T00:22:35.869 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T00:22:35.870 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-07-08T00:22:35.871 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"} 2023-07-08T00:22:35.893 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-07-08T00:22:35.947 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-08T00:22:35.964 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-08T00:22:35.998 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_8.stream (ID 3) 2023-07-08T00:22:35.998 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 3} 2023-07-08T00:22:36.003 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_8.stream (ID 3) 2023-07-08T00:22:36.003 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 3} 2023-07-08T00:22:36.054 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream 2023-07-08T00:22:36.054 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:22:36.057 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.stream 2023-07-08T00:22:36.057 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:22:36.331 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T00:22:36.376 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1} 2023-07-08T00:22:36.386 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T00:22:36.430 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-07-08T00:22:36.441 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:22:36.502 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:22:36.823 INFO:teuthology.orchestra.console:Power off smithi050 2023-07-08T00:22:36.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:22:36.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:36.897 INFO:teuthology.orchestra.console:Power off smithi195 2023-07-08T00:22:36.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:22:36.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:40.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:40.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:44.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:45.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:45.260 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-07-08T00:22:45.361 INFO:teuthology.orchestra.console:Power on smithi195 2023-07-08T00:22:45.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T00:22:45.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:49.105 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:49.316 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2023-07-08T00:22:49.402 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:49.417 INFO:teuthology.orchestra.console:Power on smithi050 2023-07-08T00:22:49.418 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T00:22:49.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:53.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:53.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:53.672 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2023-07-08T00:22:53.724 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2023-07-08T00:22:53.773 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2023-07-08T00:22:53.774 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:22:53.825 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-07-08T00:22:53.826 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:23:09.080 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:23:09.104 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:23:24.364 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:23:24.368 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:23:39.652 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:23:39.653 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:23:54.900 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:23:54.924 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:24:10.248 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:24:10.249 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:24:25.712 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:24:25.722 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:24:41.188 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:24:41.354 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:24:57.180 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:24:57.182 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:25:14.090 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:25:14.562 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:25:29.723 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:25:30.187 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:25:45.260 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:25:45.581 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:26:00.880 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:26:01.069 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:26:16.481 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:26:16.580 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:26:32.243 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:26:32.256 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:26:47.745 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:26:47.754 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:27:03.104 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:27:03.107 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:27:18.552 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:27:18.562 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:27:34.296 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:27:34.298 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:27:49.856 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-08T00:27:49.858 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:27:50.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:27:53.584 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-08T00:27:59.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:28:02.640 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-08T00:28:05.643 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:28:08.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:28:11.700 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-08T00:28:17.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:28:20.784 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-08T00:28:21.162 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:28:26.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:28:29.840 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-08T00:28:35.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:28:36.806 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:28:52.156 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:29:07.570 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:29:22.920 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:29:35.856 WARNING:teuthology.provision.fog.smithi050:timed out 2023-07-08T00:29:38.252 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:29:41.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:29:42.058 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T00:29:42.058 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T00:29:42.319 INFO:teuthology.provision.fog.smithi050:Node is ready 2023-07-08T00:29:42.319 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2023-07-08T00:29:42.339 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2023-07-08T00:29:42.340 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2023-07-08T00:29:42.400 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2023-07-08T00:29:42.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-07-08T00:29:42.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2023-07-08T00:29:42.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2023-07-08T00:29:42.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2023-07-08T00:29:42.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-07-08T00:29:42.744 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-07-08T00:29:42.803 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-07-08T00:29:42.803 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2023-07-08T00:29:42.804 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-07-08T00:29:42.804 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-07-08T00:29:42.804 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2023-07-08T00:29:42.804 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:29:42.804 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T00:29:42.804 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-07-08T00:29:42.805 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T00:29:42.805 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-07-08T00:29:42.805 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:29:42.805 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:29:42.805 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T00:29:42.806 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2023-07-08T00:29:42.807 DEBUG:teuthology.parallel:result is None 2023-07-08T00:29:53.555 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:30:08.896 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:30:24.200 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:30:39.475 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:30:54.744 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:31:10.028 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:31:25.291 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:31:40.546 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:31:55.779 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:32:11.024 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:32:26.240 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:32:41.484 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:32:56.718 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:33:11.948 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:33:27.128 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:33:42.352 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:33:57.536 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:34:12.708 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:34:27.892 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:34:43.052 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:34:58.206 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:35:13.348 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:35:28.496 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:35:43.634 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:35:58.768 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:36:13.864 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:36:28.960 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:36:44.052 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:36:59.160 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:37:14.268 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:37:29.364 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-07-08T00:37:29.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:37:32.500 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-08T00:37:38.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:37:41.584 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-08T00:37:47.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:37:50.672 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-08T00:37:56.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:37:59.728 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-08T00:38:05.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:08.788 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-08T00:38:14.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:33.328 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-08T00:38:39.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:42.420 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-08T00:38:48.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:51.508 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-08T00:38:57.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:57.723 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T00:38:57.724 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T00:39:17.569 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-07-08T00:39:17.569 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-07-08T00:39:17.594 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-07-08T00:39:17.595 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-07-08T00:39:17.655 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-07-08T00:39:17.656 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-07-08T00:39:17.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-07-08T00:39:17.813 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-07-08T00:39:17.883 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-07-08T00:39:17.953 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-07-08T00:39:18.021 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-07-08T00:39:18.083 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-07-08T00:39:18.083 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2023-07-08T00:39:18.083 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-07-08T00:39:18.083 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-07-08T00:39:18.084 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2023-07-08T00:39:18.084 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:39:18.084 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T00:39:18.084 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-07-08T00:39:18.084 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T00:39:18.084 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-07-08T00:39:18.084 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:39:18.085 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:39:18.085 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T00:39:18.085 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-07-08T00:39:18.086 DEBUG:teuthology.parallel:result is None 2023-07-08T00:39:18.265 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2023-07-08T00:39:18.266 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T00:39:18.322 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-07-08T00:39:18.323 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T00:39:18.353 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2023-07-08T00:39:18.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-08T00:39:18.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:39:18.481 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-07-08T00:39:18.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-08T00:39:18.630 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-07-08T00:39:18.692 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-07-08T00:39:18.692 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-07-08T00:39:18.752 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-07-08T00:39:18.753 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2023-07-08T00:39:18.753 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-07-08T00:39:18.753 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-07-08T00:39:18.754 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2023-07-08T00:39:18.754 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:39:18.754 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T00:39:18.754 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-07-08T00:39:18.755 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T00:39:18.755 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-07-08T00:39:18.755 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:39:18.755 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:39:18.756 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T00:39:18.757 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-07-08T00:39:18.788 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-07-08T00:39:18.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-08T00:39:18.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:39:18.908 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-07-08T00:39:18.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-08T00:39:18.978 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-07-08T00:39:19.042 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-07-08T00:39:19.042 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-07-08T00:39:19.102 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-07-08T00:39:19.103 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8" 2023-07-08T00:39:19.103 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-07-08T00:39:19.103 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-07-08T00:39:19.103 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8" 2023-07-08T00:39:19.103 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:39:19.103 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T00:39:19.104 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-07-08T00:39:19.104 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T00:39:19.104 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-07-08T00:39:19.104 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:39:19.104 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:39:19.104 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T00:39:19.105 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-07-08T00:39:19.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:39:19.139 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:39:19.259 INFO:teuthology.dispatcher.supervisor:Running job 7328582 2023-07-08T00:39:19.260 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328582 --name adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi --description orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328582/orig.config.yaml 2023-07-08T00:39:19.271 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328582 2023-07-08T00:39:19.276 INFO:teuthology.dispatcher.supervisor:Job PID: 2060 2023-07-08T00:39:19.284 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-08T00:41:19.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:41:19.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:43:19.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:43:19.571 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:45:19.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:45:19.753 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:47:19.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:47:19.952 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:49:20.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:49:20.155 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:51:20.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:51:20.337 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:53:20.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:53:20.514 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:53:20.578 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-08T00:53:20.661 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-08T00:53:20.662 INFO:teuthology.nuke:Checking targets against current locks 2023-07-08T00:53:20.709 DEBUG:teuthology.nuke:shortname: smithi050 2023-07-08T00:53:20.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T00:53:20.731 DEBUG:teuthology.nuke:shortname: smithi195 2023-07-08T00:53:20.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T00:53:20.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328582', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 00:22:34.815186', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDluBxS9wFZr7Ccn3O3trkDnvmuSl/FnkB8m9rtzy757dU0vlM0/5gIKKTlJ9wXqxl7TS1e89L02oEmz5twD/tGy2fHCRchsvhrgbi1XTLxw9YNrW5FiKgZb1dk6+d6dPWQZC/Yp3lq2Ee6pHZTEmKQ1R9NmYf0q0cbUJ8j4GiV/owfxCR97dzT730aPZ8yhkmRDatmsrQLVojus1BFgFFarpO4UMcjE3yFLmILjJYMD5HK/1pcmwZ0kTAbFFzekn+o3A6sbpDy/gdQ8WfFY80IoKO0qwOs84JaKWqPxonu1HF/ZAoxbq+9XAIL2v6uRbGFkgzhOIs2OBhGXIY9AdknmNIWmA4xqGguWsSta/UGFFKmYw/5lBlJp+h7hPxWOwRaVRKG2RSvPJXEOiAujxF4vtt1e8JwpwSRGxYvGLZSpYavkyfq+Vyk0KL2rNtlQvSyS3yRfwcldQsQvd+q/oZE9n4fH/2XB5HpCN72Mc5WDhqTL7DOLmnZHpxV8+LqZc8='} 2023-07-08T00:53:20.751 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328582', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 00:22:34.813867', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmoXNTOTAa/Ryocwd5qGv0opJfPmZtEiwdYPSQNHNsKI/qJyH55ts+k70qNc0OpJ55br551Uw443Hv2jZDkhGc7DodNU3PrGRHB5IqwPJq8OG7adHM/XT9XYTY90iUPq/9n4ilcvcDjG+p945sPsm83lHwrJD6lQU9SIxcAyid6H40Lxja4wJVkfKm3BYumqzmYAN/eUm/U2jDtP6LvsjnV5XbKKlmGUdwJXPAYuRikHXxdboehCmfk/Qo0ZTDio/laMRgkrSyIHuyCuTix2yyj1ta6uQYpSO+NCXdkCwYDYQW2KUoQ+EutJ8uaP1OUq67gYOVAonlJpFJCDUag6w4saEFx2ux7gJmOrsNVtWKlU+ATCgehwwhgk6RBFQxx833i1Cx9lftzvc6ju2jY1UCvtk87L1xMwrr4E34K4+hN7lIPpQEdgJPX5eielC0qll2+Fd2gIt/SUqpja483Kyq/OVyfW1XJBFw8REPx5o2SPUIU8NT6Hv0u8D9bt/XwEM='} 2023-07-08T00:53:20.783 INFO:teuthology.orchestra.console:Power off smithi050 2023-07-08T00:53:20.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:53:20.802 INFO:teuthology.orchestra.console:Power off smithi195 2023-07-08T00:53:20.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:53:20.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:53:20.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:53:20.934 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2023-07-08T00:53:20.946 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-07-08T00:53:21.095 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2023-07-08T00:53:21.103 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com