2023-07-04T04:06:02.800 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-04T04:06:02.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:06:02.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:06:02.960 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6005628d30>, signals=[15]) 2023-07-04T04:06:02.961 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-07-04T04:06:02.962 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-07-04T04:06:02.962 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-04T04:06:02.987 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-04T04:06:02.987 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-04T04:06:02.987 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-04T04:06:02.989 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"} 2023-07-04T04:06:03.012 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-04T04:06:03.066 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-04T04:06:03.080 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-04T04:06:03.109 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_8.stream (ID 3) 2023-07-04T04:06:03.110 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 3} 2023-07-04T04:06:03.129 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_8.stream (ID 3) 2023-07-04T04:06:03.129 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 3} 2023-07-04T04:06:03.161 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream 2023-07-04T04:06:03.162 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:06:03.172 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 8.stream 2023-07-04T04:06:03.172 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:06:03.206 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"} 2023-07-04T04:06:03.217 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-04T04:06:03.249 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1} 2023-07-04T04:06:03.253 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-04T04:06:03.322 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:06:03.325 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:06:03.412 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-04T04:06:03.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T04:06:03.431 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-04T04:06:03.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T04:06:03.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:03.454 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:07.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:07.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:11.589 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:11.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:11.800 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-04T04:06:11.808 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-04T04:06:11.902 INFO:teuthology.orchestra.console:Power on smithi026 2023-07-04T04:06:11.903 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-04T04:06:11.912 INFO:teuthology.orchestra.console:Power on smithi008 2023-07-04T04:06:11.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-04T04:06:11.927 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:11.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:15.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:15.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:16.164 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-07-04T04:06:16.266 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-04T04:06:16.266 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:06:20.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:06:20.282 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2023-07-04T04:06:20.383 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-07-04T04:06:20.384 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:06:31.332 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:06:35.440 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:06:46.396 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:06:50.492 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:07:01.456 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:07:05.544 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:07:16.516 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:07:20.596 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:07:31.572 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:07:35.644 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:07:46.629 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:07:50.696 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:08:01.704 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:08:05.760 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:08:16.772 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:08:20.836 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:08:31.836 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:08:35.893 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:08:46.900 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-04T04:08:46.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:08:50.032 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-04T04:08:50.953 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-04T04:08:51.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:08:54.064 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-04T04:08:56.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:08:59.088 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-04T04:09:00.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:09:03.124 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-04T04:09:05.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:09:08.144 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-04T04:09:09.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:09:12.208 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-04T04:09:14.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:09:17.200 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-04T04:09:18.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:09:21.264 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-04T04:09:23.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:09:27.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:09:30.320 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-04T04:09:36.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:09:39.408 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-04T04:09:45.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:10:23.240 WARNING:teuthology.provision.fog.smithi026:timed out 2023-07-04T04:10:29.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:10:29.469 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-04T04:10:29.470 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-04T04:10:29.746 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-04T04:10:29.747 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-04T04:10:29.766 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-07-04T04:10:29.767 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-07-04T04:10:29.826 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-07-04T04:10:29.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-04T04:10:29.932 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-07-04T04:10:29.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-07-04T04:10:30.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-07-04T04:10:30.101 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-04T04:10:30.170 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-04T04:10:30.228 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-07-04T04:10:30.228 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-07-04T04:10:30.228 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-07-04T04:10:30.229 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-07-04T04:10:30.229 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-07-04T04:10:30.229 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-04T04:10:30.229 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T04:10:30.229 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-04T04:10:30.229 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T04:10:30.229 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-07-04T04:10:30.229 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T04:10:30.230 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T04:10:30.230 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T04:10:30.230 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-04T04:10:30.232 DEBUG:teuthology.parallel:result is None 2023-07-04T04:10:45.428 WARNING:teuthology.provision.fog.smithi008:timed out 2023-07-04T04:10:51.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:10:51.659 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-04T04:10:51.660 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-04T04:10:51.877 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-07-04T04:10:51.878 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-07-04T04:10:51.897 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-07-04T04:10:51.898 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-07-04T04:10:51.957 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-07-04T04:10:51.958 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-04T04:10:52.068 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-07-04T04:10:52.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-07-04T04:10:52.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-07-04T04:10:52.239 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-04T04:10:52.308 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-04T04:10:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-07-04T04:10:52.367 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-07-04T04:10:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-07-04T04:10:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-07-04T04:10:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-07-04T04:10:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-07-04T04:10:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T04:10:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-04T04:10:52.368 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T04:10:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-07-04T04:10:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T04:10:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T04:10:52.369 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T04:10:52.369 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-07-04T04:10:52.370 DEBUG:teuthology.parallel:result is None 2023-07-04T04:10:52.560 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-07-04T04:10:52.561 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-04T04:10:52.598 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-07-04T04:10:52.598 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-04T04:10:52.626 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-07-04T04:10:52.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-04T04:10:52.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:10:52.695 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-07-04T04:10:52.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-04T04:10:52.768 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-07-04T04:10:52.827 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-07-04T04:10:52.828 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-04T04:10:52.887 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-07-04T04:10:52.887 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-07-04T04:10:52.887 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-07-04T04:10:52.888 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-07-04T04:10:52.888 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-07-04T04:10:52.888 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-07-04T04:10:52.889 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T04:10:52.889 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-04T04:10:52.889 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T04:10:52.889 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-07-04T04:10:52.889 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T04:10:52.890 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T04:10:52.890 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T04:10:52.891 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-04T04:10:52.923 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-07-04T04:10:52.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-04T04:10:52.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:10:52.990 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-07-04T04:10:53.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-04T04:10:53.130 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-07-04T04:10:53.190 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-07-04T04:10:53.191 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-04T04:10:53.251 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-07-04T04:10:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-07-04T04:10:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-07-04T04:10:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-07-04T04:10:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-07-04T04:10:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-04T04:10:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T04:10:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-04T04:10:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T04:10:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-07-04T04:10:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T04:10:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T04:10:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T04:10:53.254 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-04T04:10:53.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:10:53.281 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:10:53.387 INFO:teuthology.dispatcher.supervisor:Running job 7325929 2023-07-04T04:10:53.387 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325929 --name prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325929/orig.config.yaml 2023-07-04T04:10:53.391 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325929 2023-07-04T04:10:53.392 INFO:teuthology.dispatcher.supervisor:Job PID: 25239 2023-07-04T04:10:53.393 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-04T04:12:53.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:12:53.494 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:14:53.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:14:53.673 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:16:53.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:16:53.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:18:54.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:18:54.027 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:20:54.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:20:54.210 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:22:54.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:22:54.404 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:24:54.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:24:54.598 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:26:54.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:26:54.779 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:28:54.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:28:54.963 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:30:55.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:30:55.146 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:32:55.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:32:55.325 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:34:55.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:34:55.586 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:36:55.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:36:55.755 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:38:55.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:38:55.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:40:56.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:40:56.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:42:56.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:42:56.239 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:44:56.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:44:56.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:46:56.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:46:56.633 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:48:56.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:48:56.809 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:50:56.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:50:56.979 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:52:57.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:52:57.157 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:54:57.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:54:57.330 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:56:57.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:56:57.506 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:58:57.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:58:57.681 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T05:00:57.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T05:00:57.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T05:02:58.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T05:02:58.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T05:04:58.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T05:04:58.198 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T05:04:58.269 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-04T05:04:58.427 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-04T05:04:58.428 INFO:teuthology.nuke:Checking targets against current locks 2023-07-04T05:04:58.483 DEBUG:teuthology.nuke:shortname: smithi008 2023-07-04T05:04:58.483 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-04T05:04:58.513 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-04T05:04:58.514 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-04T05:04:58.515 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325929', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 04:06:01.969761', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVYB9vZXK34BlPAXHFytwSZiDDRAgn8EjWnqPPux7u5TPw/RpWWTusW4M2gTfnyqb1UpaBYqt7Erk3cS+8bnlMdKazoNZGD1Ghn1LFZgUg5EARu6Rs8zCDmstgol7M0J33dtkU6T1g1Ci/Eh2o9VDQvmIoTM8pyviEW07+Am2rNEROIJzkO2/yE9zJWBJ1doUymycPz2Qc44hLKtuSuLLkBXYyo2Rgg7iZlFLIuGXs8jDxPujlJaFhdus88gX18YFAnke5n2594p2CFmukZp1aASPXbU8VaWvk7CNa0MxfXmWCUqcIDhU+JtO8mWbF8C5Y9qQUoA0ojMZvBb9+jnFmVrRIfLzLLt/4apGvCCLnE71fXYyUsYEmcwdzZZKiBjji/A5nux8tet+8sDmFGA+uNcoqO3V3k2+tcReWxQy7RE5f1Um6w0GW1WnvNVae6ONT9oaWbyuQzM9d0dtQClwteAcUwXwDCAQuvSAz9XSFLhbIU0gOg3Vhd1g30IQGTfU='} 2023-07-04T05:04:58.543 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325929', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 04:06:01.971931', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNqD9EvievOKA2qMf8BMwqbGcvHv69Sd9oTqfjjkU3guWSU3JVMjbgFtjI3xpUlG9qMYU5rEFBl7o5AHmjOzksk='} 2023-07-04T05:04:58.578 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-04T05:04:58.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T05:04:58.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T05:04:58.624 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-04T05:04:58.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T05:04:58.651 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T05:04:58.736 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-04T05:04:58.774 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-04T05:04:58.910 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2023-07-04T05:04:58.926 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com