2023-07-14T11:43:58.995 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T11:43:58.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T11:43:58.997 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T11:43:59.158 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f58f053ae50>, signals=[15]) 2023-07-14T11:43:59.160 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-07-14T11:43:59.160 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T11:43:59.161 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-14T11:43:59.184 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-07-14T11:43:59.184 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T11:43:59.185 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-14T11:43:59.186 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-07-14T11:43:59.209 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-07-14T11:43:59.263 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T11:43:59.278 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T11:43:59.306 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T11:43:59.306 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 3} 2023-07-14T11:43:59.317 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T11:43:59.318 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3} 2023-07-14T11:43:59.346 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 8.stream 2023-07-14T11:43:59.346 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:43:59.359 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream 2023-07-14T11:43:59.360 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:43:59.397 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T11:43:59.411 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T11:43:59.435 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-07-14T11:43:59.444 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-07-14T11:43:59.493 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:43:59.510 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:43:59.585 INFO:teuthology.orchestra.console:Power off smithi072 2023-07-14T11:43:59.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T11:43:59.600 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-14T11:43:59.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T11:43:59.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:43:59.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:03.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:03.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:07.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:07.774 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:07.977 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-07-14T11:44:08.078 INFO:teuthology.orchestra.console:Power on smithi072 2023-07-14T11:44:08.079 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T11:44:08.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:11.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:12.104 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-14T11:44:12.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:12.205 INFO:teuthology.orchestra.console:Power on smithi203 2023-07-14T11:44:12.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T11:44:12.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:16.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:16.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T11:44:16.451 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2023-07-14T11:44:16.484 INFO:teuthology.orchestra.console:Power on for smithi203 completed 2023-07-14T11:44:16.552 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-07-14T11:44:16.553 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:44:16.586 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-07-14T11:44:16.587 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:44:31.624 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:44:31.639 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:44:46.698 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:44:46.700 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:45:01.775 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:45:01.776 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:45:16.848 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:45:16.850 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:45:31.928 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:45:31.929 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:45:47.016 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:45:47.017 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:46:02.104 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:46:02.105 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:46:17.184 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:46:17.185 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:46:32.268 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:46:32.269 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:46:47.354 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:46:47.355 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:47:02.432 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:47:02.433 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-14T11:47:02.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:05.552 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-14T11:47:11.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:14.612 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-14T11:47:17.505 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:47:20.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:23.696 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-14T11:47:29.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:32.569 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-14T11:47:32.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:32.752 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-14T11:47:35.696 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T11:47:38.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:41.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:41.808 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-14T11:47:44.756 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T11:47:47.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:50.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:50.864 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-14T11:47:53.840 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T11:47:56.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:59.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:47:59.924 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-14T11:48:02.896 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T11:48:05.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:48:08.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:48:11.952 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-14T11:48:17.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:49:05.979 WARNING:teuthology.provision.fog.smithi203:timed out 2023-07-14T11:49:11.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:49:12.194 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T11:49:12.195 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T11:49:12.460 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-07-14T11:49:12.460 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-07-14T11:49:12.479 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-07-14T11:49:12.479 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-07-14T11:49:12.538 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-07-14T11:49:12.539 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-14T11:49:12.650 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-07-14T11:49:12.680 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-07-14T11:49:12.748 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-07-14T11:49:12.817 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-14T11:49:12.884 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-14T11:49:12.942 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-14T11:49:12.942 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-07-14T11:49:12.943 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-14T11:49:12.943 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-14T11:49:12.943 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-07-14T11:49:12.944 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-14T11:49:12.944 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T11:49:12.944 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-14T11:49:12.944 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T11:49:12.945 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-14T11:49:12.945 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T11:49:12.945 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T11:49:12.945 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T11:49:12.946 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-07-14T11:49:12.948 DEBUG:teuthology.parallel:result is None 2023-07-14T11:49:17.964 WARNING:teuthology.provision.fog.smithi072:timed out 2023-07-14T11:49:23.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:49:24.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T11:49:24.232 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T11:49:24.491 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-07-14T11:49:24.492 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-07-14T11:49:24.511 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-07-14T11:49:24.511 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-07-14T11:49:24.571 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-07-14T11:49:24.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-07-14T11:49:24.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-07-14T11:49:24.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-07-14T11:49:24.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-07-14T11:49:24.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-07-14T11:49:24.945 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-07-14T11:49:25.004 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-07-14T11:49:25.004 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2023-07-14T11:49:25.005 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-07-14T11:49:25.005 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-07-14T11:49:25.005 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2023-07-14T11:49:25.006 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-07-14T11:49:25.006 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T11:49:25.006 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-07-14T11:49:25.006 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T11:49:25.007 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-07-14T11:49:25.007 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T11:49:25.007 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T11:49:25.007 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T11:49:25.008 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-07-14T11:49:25.009 DEBUG:teuthology.parallel:result is None 2023-07-14T11:49:25.203 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-07-14T11:49:25.204 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T11:49:25.229 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-07-14T11:49:25.230 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T11:49:25.256 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-07-14T11:49:25.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-14T11:49:25.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:49:25.324 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-07-14T11:49:25.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-14T11:49:25.391 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-07-14T11:49:25.448 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-07-14T11:49:25.449 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-07-14T11:49:25.506 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-07-14T11:49:25.507 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2023-07-14T11:49:25.507 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-07-14T11:49:25.507 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-07-14T11:49:25.508 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2023-07-14T11:49:25.508 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-07-14T11:49:25.508 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T11:49:25.509 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-07-14T11:49:25.509 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T11:49:25.509 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-07-14T11:49:25.509 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T11:49:25.510 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T11:49:25.510 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T11:49:25.511 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-14T11:49:25.538 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-07-14T11:49:25.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-14T11:49:25.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T11:49:25.604 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-14T11:49:25.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-14T11:49:25.694 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-07-14T11:49:25.753 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-07-14T11:49:25.754 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-14T11:49:25.812 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-07-14T11:49:25.813 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8" 2023-07-14T11:49:25.813 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-07-14T11:49:25.813 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-07-14T11:49:25.813 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8" 2023-07-14T11:49:25.813 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-14T11:49:25.814 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-14T11:49:25.814 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-14T11:49:25.814 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-14T11:49:25.814 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-07-14T11:49:25.814 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T11:49:25.814 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T11:49:25.814 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T11:49:25.815 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-14T11:49:25.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T11:49:25.839 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T11:49:25.937 INFO:teuthology.dispatcher.supervisor:Running job 7337630 2023-07-14T11:49:25.937 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-07-14_11:31:52-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7337630 --name prsrivas-2023-07-14_11:31:52-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/prsrivas-2023-07-14_11:31:52-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7337630/orig.config.yaml 2023-07-14T11:49:25.940 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-07-14_11:31:52-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7337630 2023-07-14T11:49:25.941 INFO:teuthology.dispatcher.supervisor:Job PID: 8904 2023-07-14T11:49:25.941 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-14T11:51:26.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T11:51:26.038 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T11:53:26.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T11:53:26.217 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T11:55:26.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T11:55:26.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T11:57:26.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T11:57:26.561 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T11:59:26.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T11:59:26.733 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T12:01:26.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:01:26.912 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T12:03:27.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:03:27.083 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T12:05:27.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:05:27.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T12:07:27.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:07:27.450 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T12:09:27.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:09:27.654 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T12:11:27.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:11:27.841 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T12:13:28.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:13:28.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T12:13:28.114 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-14T12:13:28.306 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-14T12:13:28.306 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T12:13:28.364 DEBUG:teuthology.nuke:shortname: smithi072 2023-07-14T12:13:28.365 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T12:13:28.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-14_11:31:52-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7337630', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 11:43:58.188497', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRCI0NawoaKRtlhVx1Yl6L2PW5/nUr/SJkLTYVQuclXtd4Hk3kOWUBQWZY9bVn9yocUHExPCX2IV7lQYUbRsXjZddPQ3KNu6OdNHuLJky5Ilf4V7PLblItW7zAFIo3+u6Px5riInrRI3aiOX9LWL9EYY3aniit7z/tvvp3M/7PQtzL02gDzKYCIjIzEjG2bDCqaptYOHa4wf+64VD2qirWkOO/sDIxqPZ4BSclCFx0WwhZQl/iQO1ytsglFKU5WPsFDP4Fr0xtVX71a7hxEUFyZvuh17/mKKYiXzLWbPHK1QDNRetZe/+3DCyaBs39Jov0gLSzyRUv01lYRkqJslm72oj+CTOTvW2RC5Ds9xVwUczIqeocsKkN+2tHvEgprPKD2jaKCSVbM14X9asuiLn40rSgoOcdmKTKTL11dGwNM4kAR8hqVOPVYEoePg62EBgwCW/o6MEq64gJWuSSyKMGXQnQIyzV+gn+zB3riGyO/c+ZXy7bbKM/cyzZY5m1/68='} 2023-07-14T12:13:28.393 DEBUG:teuthology.nuke:shortname: smithi203 2023-07-14T12:13:28.394 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T12:13:28.422 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-14_11:31:52-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7337630', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 11:43:58.190071', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCezsVZVfzCAbNPSOAF6S5Ln4J13lShYhhvPqce6968YKrrRhm7zOPHV8FGJzOm99r8B1FZhwWK6RvE5HrYNPFMCW9/o81FX1NVlnS63JQepjb+hcu26XakoefbmzZJYS008uAGRlusKaCaoRilLCHcRDtemG2kUs1yACDuFGSDqmwDa+0m4nSyBMdmImONsDfbiTWlLv0WWYXQsgD0XA+vtzCkpLHRKkOZDOxfsXn6ud+A5dOpRze188afDqXHHUTFZ2/nq82/wwgIzFivagYXhWGSzxVqhzMGJsgRmjJ9dR1yy6aqY41kqx1ZaHq7n218DVLRZnW1EMfb8H+yKaGrCyuj44fVsbyMipbeBmcVpJz0VDyrLHIGQmqG9nBtM36tUIHQJlZ1q7aWXpNDN0DUAQmkkmslg28yUXRt4O85IsukOO4qhfHVF+ESuyZskSRCiHhsx4ViLOOuvt5ah4VZonLNMwFeaTIPT0gWUb6LPcG4zaGaifrrEcnDowxTkes='} 2023-07-14T12:13:28.457 INFO:teuthology.orchestra.console:Power off smithi072 2023-07-14T12:13:28.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T12:13:28.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T12:13:28.499 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-14T12:13:28.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T12:13:28.524 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T12:13:28.612 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2023-07-14T12:13:28.647 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-14T12:13:28.771 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-07-14T12:13:28.798 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com