2023-06-20T17:36:16.994 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T17:36:16.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:36:16.996 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:36:17.155 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc0b3a568b0>, signals=[15]) 2023-06-20T17:36:17.156 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-06-20T17:36:17.157 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T17:36:17.157 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-06-20T17:36:17.179 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-06-20T17:36:17.179 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T17:36:17.179 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-06-20T17:36:17.181 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"} 2023-06-20T17:36:17.204 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-06-20T17:36:17.260 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-20T17:36:17.273 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-20T17:36:17.305 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_8.stream (ID 3) 2023-06-20T17:36:17.305 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 3} 2023-06-20T17:36:17.319 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_centos_8.stream (ID 3) 2023-06-20T17:36:17.319 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 3} 2023-06-20T17:36:17.344 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 8.stream 2023-06-20T17:36:17.345 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:36:17.371 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of centos 8.stream 2023-06-20T17:36:17.371 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:36:17.411 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T17:36:17.423 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T17:36:17.449 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1} 2023-06-20T17:36:17.457 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-06-20T17:36:17.495 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:36:17.518 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:36:17.598 INFO:teuthology.orchestra.console:Power off smithi110 2023-06-20T17:36:17.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T17:36:17.618 INFO:teuthology.orchestra.console:Power off smithi178 2023-06-20T17:36:17.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T17:36:17.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:17.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:21.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:21.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:25.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:25.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:29.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:29.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:30.100 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-06-20T17:36:30.109 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-06-20T17:36:30.201 INFO:teuthology.orchestra.console:Power on smithi110 2023-06-20T17:36:30.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T17:36:30.211 INFO:teuthology.orchestra.console:Power on smithi178 2023-06-20T17:36:30.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T17:36:30.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:30.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:34.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:34.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:34.458 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2023-06-20T17:36:34.559 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-06-20T17:36:34.560 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:36:38.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:36:38.578 INFO:teuthology.orchestra.console:Power on for smithi178 completed 2023-06-20T17:36:38.679 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-06-20T17:36:38.679 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:36:49.632 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:36:53.740 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:37:04.712 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:37:08.812 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:37:19.780 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:37:23.880 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:37:34.860 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:37:38.952 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:37:49.956 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:37:54.028 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:38:05.052 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:38:09.106 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:38:20.124 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:38:24.177 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:38:35.194 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:38:39.252 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:38:50.268 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:38:54.324 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:39:05.340 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:39:09.412 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:39:20.420 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-20T17:39:20.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:39:23.572 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-20T17:39:24.472 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:39:29.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:39:32.656 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-20T17:39:38.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:39:39.552 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-06-20T17:39:39.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:39:41.712 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-20T17:39:42.708 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-20T17:39:47.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:39:48.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:39:50.768 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-20T17:39:51.792 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-20T17:39:56.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:39:57.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:39:59.824 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-20T17:40:00.852 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-20T17:40:05.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:40:06.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:40:10.032 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-20T17:40:16.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:40:19.088 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-20T17:40:25.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:40:28.148 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-20T17:40:34.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:40:37.232 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-20T17:40:43.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:40:46.292 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-06-20T17:40:52.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:41:05.841 WARNING:teuthology.provision.fog.smithi110:timed out 2023-06-20T17:41:11.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:41:12.057 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T17:41:12.058 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T17:41:12.334 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-06-20T17:41:12.335 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-06-20T17:41:12.355 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-06-20T17:41:12.355 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2023-06-20T17:41:12.414 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-06-20T17:41:12.414 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-06-20T17:41:12.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2023-06-20T17:41:12.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-06-20T17:41:12.608 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2023-06-20T17:41:12.676 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-06-20T17:41:12.744 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-06-20T17:41:12.803 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-06-20T17:41:12.804 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2023-06-20T17:41:12.804 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-06-20T17:41:12.804 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:41:12.805 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2023-06-20T17:41:12.805 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:41:12.805 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:41:12.805 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-06-20T17:41:12.805 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:41:12.806 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:41:12.806 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:41:12.806 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:41:12.806 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:41:12.807 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-06-20T17:41:12.808 DEBUG:teuthology.parallel:result is None 2023-06-20T17:41:52.336 WARNING:teuthology.provision.fog.smithi178:timed out 2023-06-20T17:41:58.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:41:58.556 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T17:41:58.557 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T17:41:58.861 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-06-20T17:41:58.862 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2023-06-20T17:41:58.881 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-06-20T17:41:58.882 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2023-06-20T17:41:58.941 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-06-20T17:41:58.942 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-06-20T17:41:59.057 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2023-06-20T17:41:59.087 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2023-06-20T17:41:59.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2023-06-20T17:41:59.225 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-06-20T17:41:59.292 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-06-20T17:41:59.350 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2023-06-20T17:41:59.351 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8" 2023-06-20T17:41:59.351 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2023-06-20T17:41:59.351 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:41:59.352 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8" 2023-06-20T17:41:59.352 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:41:59.352 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:41:59.353 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-06-20T17:41:59.353 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:41:59.353 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:41:59.353 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:41:59.354 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:41:59.354 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:41:59.355 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-06-20T17:41:59.355 DEBUG:teuthology.parallel:result is None 2023-06-20T17:41:59.514 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-06-20T17:41:59.515 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T17:41:59.541 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-06-20T17:41:59.541 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T17:41:59.567 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-06-20T17:41:59.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-06-20T17:41:59.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:41:59.635 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-06-20T17:41:59.771 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-06-20T17:41:59.830 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-06-20T17:41:59.831 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-06-20T17:41:59.889 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2023-06-20T17:41:59.889 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8" 2023-06-20T17:41:59.890 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2023-06-20T17:41:59.890 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:41:59.890 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8" 2023-06-20T17:41:59.890 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:41:59.890 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:41:59.890 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-06-20T17:41:59.891 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:41:59.891 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:41:59.891 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:41:59.891 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:41:59.891 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:41:59.892 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-06-20T17:41:59.917 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-06-20T17:41:59.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-06-20T17:41:59.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:41:59.985 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-06-20T17:42:00.055 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-06-20T17:42:00.113 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-06-20T17:42:00.114 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-06-20T17:42:00.172 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2023-06-20T17:42:00.173 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8" 2023-06-20T17:42:00.173 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2023-06-20T17:42:00.173 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:42:00.174 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8" 2023-06-20T17:42:00.174 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:42:00.174 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:42:00.174 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-06-20T17:42:00.175 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:42:00.175 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:42:00.175 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:42:00.175 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:42:00.175 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:42:00.176 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-06-20T17:42:00.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:42:00.200 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:42:00.307 INFO:teuthology.dispatcher.supervisor:Running job 7309194 2023-06-20T17:42:00.307 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_bcs-ceph@teuthology --archive /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309194 --name bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309194/orig.config.yaml 2023-06-20T17:42:00.311 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309194 2023-06-20T17:42:00.312 INFO:teuthology.dispatcher.supervisor:Job PID: 13184 2023-06-20T17:42:00.312 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T17:44:00.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:44:00.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:46:00.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:46:00.604 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:48:00.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:48:00.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:50:00.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:50:00.975 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:52:01.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:52:01.151 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:54:01.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:54:01.325 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:56:01.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:56:01.495 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:58:01.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:58:01.667 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:00:01.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:00:01.850 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:02:02.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:02:02.028 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:04:02.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:04:02.202 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:06:02.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:06:02.379 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:06:02.458 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T18:06:02.573 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-20T18:06:02.574 INFO:teuthology.nuke:Checking targets against current locks 2023-06-20T18:06:02.625 DEBUG:teuthology.nuke:shortname: smithi110 2023-06-20T18:06:02.625 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T18:06:02.645 DEBUG:teuthology.nuke:shortname: smithi178 2023-06-20T18:06:02.646 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T18:06:02.648 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 17:36:16.172217', 'locked_by': 'scheduled_bcs-ceph@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0LlwuU/TPWprlLY/TH7l3Nlau9SFslL3ns2skGZ7UuhVLiRfTVW0bK5iZ1Yy+uZZV8icMLJKBzwMOBZ4eNPgXTrwYStuMZiw2qdfcQ34V461IXax3oKF0d1aEhATDW3W45C5XyHGUzJrxdMlo6mDMkNggMu+K2TvKqCjuWC5avQX9PttLKWMM2PcC73srwVnTjgLrjSSLy1+Ofc0x2Lf2wqwrwd/C60ARuS+gEYxIxqzNpjJdQ+46j4EWvlgvgYb/z2nZS6U2q0/1m7d0SpEOL4PP9+3csNN9sH4LSy7ju0i9K9r7u8bzmODkMoNL9uf4qlZ7d+VKPpt+OOSrIpXTQknPvz3kHhT0yqpA9wzkL1loXiBo1glj2+7yapxWJWxMfbcqqem0nuV0RvhwShdVSV9Zoq7PdNLmXvKL9mmUYa+T3TsiY5HlH8jiPsRe9zUDBsURvjkdPYCd6v/ByafF8j6Gb9K9X+qiLpsn6mF4NrZWqrWtQJhuMLF6gOFHgMU='} 2023-06-20T18:06:02.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 17:36:16.170143', 'locked_by': 'scheduled_bcs-ceph@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMatlT6o1phFXC/wzoh0psjvcdd3IYC3xYhHEMJY/p2fZQgRM6yq1r9aA0W2L5qdrEKhfIUxrYwlt0cRNzo4YkU='} 2023-06-20T18:06:02.699 INFO:teuthology.orchestra.console:Power off smithi110 2023-06-20T18:06:02.700 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T18:06:02.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:06:02.738 INFO:teuthology.orchestra.console:Power off smithi178 2023-06-20T18:06:02.738 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T18:06:02.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:06:02.848 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-06-20T18:06:02.880 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-06-20T18:06:03.008 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-06-20T18:06:03.032 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com