2023-07-12T12:12:56.981 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T12:12:56.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:12:56.983 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:12:57.130 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffac11da8b0>, signals=[15]) 2023-07-12T12:12:57.132 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-07-12T12:12:57.132 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T12:12:57.133 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-07-12T12:12:57.162 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-07-12T12:12:57.163 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T12:12:57.163 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-07-12T12:12:57.164 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-07-12T12:12:57.187 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-07-12T12:12:57.236 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-12T12:12:57.259 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-12T12:12:57.278 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_8.stream (ID 3) 2023-07-12T12:12:57.278 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 3} 2023-07-12T12:12:57.312 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_8.stream (ID 3) 2023-07-12T12:12:57.313 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 3} 2023-07-12T12:12:57.329 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 8.stream 2023-07-12T12:12:57.330 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:12:57.359 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.stream 2023-07-12T12:12:57.360 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:12:57.377 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T12:12:57.406 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T12:12:57.411 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-07-12T12:12:57.441 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-07-12T12:12:57.457 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:12:57.495 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:12:57.544 INFO:teuthology.orchestra.console:Power off smithi033 2023-07-12T12:12:57.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:12:57.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:12:57.587 INFO:teuthology.orchestra.console:Power off smithi158 2023-07-12T12:12:57.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:12:57.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:01.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:01.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:05.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:05.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:05.954 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-07-12T12:13:06.055 INFO:teuthology.orchestra.console:Power on smithi158 2023-07-12T12:13:06.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T12:13:06.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:09.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:10.035 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-07-12T12:13:10.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:10.137 INFO:teuthology.orchestra.console:Power on smithi033 2023-07-12T12:13:10.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T12:13:10.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:14.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:14.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:14.430 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2023-07-12T12:13:14.531 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-07-12T12:13:14.531 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:13:18.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:18.513 INFO:teuthology.orchestra.console:Power on for smithi033 completed 2023-07-12T12:13:18.616 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-07-12T12:13:18.617 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:13:29.604 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:13:33.684 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:13:44.664 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:13:48.752 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:13:59.741 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:14:03.812 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:14:14.814 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:14:18.872 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:14:29.889 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:14:33.940 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:14:44.960 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:14:49.012 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:15:00.040 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:15:04.079 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:15:15.121 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:15:19.158 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:15:30.200 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:15:34.228 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-12T12:15:34.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:15:34.589 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: Authentication failed. 2023-07-12T12:15:34.591 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T12:15:34.592 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T12:15:34.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-12T12:15:35.597 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-12T12:15:36.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-12T12:15:45.270 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:16:00.350 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:16:15.410 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-07-12T12:16:15.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:18.544 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:16:24.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:27.604 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:16:33.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:36.656 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:16:42.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:45.712 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:16:51.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:54.768 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:17:00.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:17:03.824 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:17:09.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:17:12.880 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:17:18.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:17:21.936 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:17:27.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:17:30.992 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:17:35.348 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-12T12:17:35.350 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi033 2023-07-12T12:17:36.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:17:40.048 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-07-12T12:17:44.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-07-12T12:17:44.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:17:44.568 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-07-12T12:17:44.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-07-12T12:17:44.842 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T12:17:44.842 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T12:17:44.861 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-07-12T12:17:44.861 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-07-12T12:17:44.921 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-07-12T12:17:44.921 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-07-12T12:17:44.981 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-07-12T12:17:44.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-07-12T12:17:45.093 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-07-12T12:17:45.124 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-07-12T12:17:45.194 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-07-12T12:17:45.264 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-07-12T12:17:45.332 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-07-12T12:17:45.391 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-07-12T12:17:45.391 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2023-07-12T12:17:45.391 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-07-12T12:17:45.392 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-07-12T12:17:45.392 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2023-07-12T12:17:45.392 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:17:45.392 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T12:17:45.392 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-07-12T12:17:45.393 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T12:17:45.393 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-07-12T12:17:45.393 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:17:45.393 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:17:45.394 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T12:17:45.394 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-07-12T12:17:45.396 DEBUG:teuthology.parallel:result is None 2023-07-12T12:17:46.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:18:46.108 WARNING:teuthology.provision.fog.smithi158:timed out 2023-07-12T12:18:52.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:18:52.417 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T12:18:52.418 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T12:18:52.685 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-07-12T12:18:52.685 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-07-12T12:18:52.705 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-07-12T12:18:52.706 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2023-07-12T12:18:52.764 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-07-12T12:18:52.764 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-07-12T12:18:52.874 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2023-07-12T12:18:52.905 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-07-12T12:18:52.974 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2023-07-12T12:18:53.042 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-07-12T12:18:53.109 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-07-12T12:18:53.168 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-07-12T12:18:53.169 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-07-12T12:18:53.169 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-07-12T12:18:53.169 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-07-12T12:18:53.169 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-07-12T12:18:53.170 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:18:53.170 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T12:18:53.170 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-07-12T12:18:53.170 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T12:18:53.170 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-07-12T12:18:53.170 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:18:53.171 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:18:53.171 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T12:18:53.171 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-07-12T12:18:53.172 DEBUG:teuthology.parallel:result is None 2023-07-12T12:18:53.332 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-07-12T12:18:53.333 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T12:18:53.355 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-07-12T12:18:53.355 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T12:18:53.373 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-07-12T12:18:53.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-07-12T12:18:53.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:18:53.442 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-07-12T12:18:53.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-07-12T12:18:53.581 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-07-12T12:18:53.642 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-07-12T12:18:53.642 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-07-12T12:18:53.702 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-07-12T12:18:53.703 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2023-07-12T12:18:53.703 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-07-12T12:18:53.703 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-07-12T12:18:53.703 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2023-07-12T12:18:53.703 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:18:53.703 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T12:18:53.704 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-07-12T12:18:53.704 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T12:18:53.704 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-07-12T12:18:53.704 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:18:53.705 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:18:53.705 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T12:18:53.705 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-07-12T12:18:53.733 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-07-12T12:18:53.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-12T12:18:53.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:18:53.799 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-07-12T12:18:53.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-07-12T12:18:53.874 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-07-12T12:18:53.932 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-07-12T12:18:53.932 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-07-12T12:18:53.990 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-07-12T12:18:53.990 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-07-12T12:18:53.990 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-07-12T12:18:53.990 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-07-12T12:18:53.991 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-07-12T12:18:53.991 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:18:53.991 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-12T12:18:53.991 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-07-12T12:18:53.991 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-12T12:18:53.991 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-07-12T12:18:53.991 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:18:53.992 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:18:53.992 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-12T12:18:53.992 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-07-12T12:18:54.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:18:54.032 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:18:54.149 INFO:teuthology.dispatcher.supervisor:Running job 7334953 2023-07-12T12:18:54.149 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_kkeithle@teuthology --archive /home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334953 --name kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334953/orig.config.yaml 2023-07-12T12:18:54.153 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334953 2023-07-12T12:18:54.154 INFO:teuthology.dispatcher.supervisor:Job PID: 11577 2023-07-12T12:18:54.154 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-12T12:20:54.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:20:54.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:22:54.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:22:54.427 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:24:54.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:24:54.599 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:26:54.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:26:54.778 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:28:54.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:28:54.950 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:30:55.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:30:55.126 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:32:55.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:32:55.302 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:34:55.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:34:55.471 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:36:55.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:36:55.638 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:36:55.707 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-12T12:36:55.851 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-12T12:36:55.852 INFO:teuthology.nuke:Checking targets against current locks 2023-07-12T12:36:55.905 DEBUG:teuthology.nuke:shortname: smithi033 2023-07-12T12:36:55.905 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T12:36:55.930 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 12:12:56.132592', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNLmrtzR4gPfPZAGS4LXpVwdZp/ruUr088fTY7B0USF9q3fR2btq0ZUI0jlipdFfxBcQrPPXeBGlT/eBi9JiI0LrGdtUD7ZmUo3PTU50Mh4tnzJ+76tRsGmXGF/QLXZ0vKzW1uSfhBfHXPHO04qy52Yf5nFZCUkrGMdAyLVeMyk4Ia/jhXk4MXouqBXpKXU3JVnv8WDEDroi6fPlTy1ntXroKtFcw7imzUuMdR/pu7jEeAvdHv1lPMPbJ0ZCH2/mKcx8aGyE5TIIWu5eGcj+9IughK52HBPrWB9P0NZ+q752v2Wvm6gq48NpC6ReQpAgqEwOMMQAf6/xJt1uBMyXKTiumX8LRcb1dy0RbWU3Y2zZsN4CrEvTFVs7sPSROoGwwDG2R209Pn5tFc2LH8w3OOUW4aT/JSavGK+TOLhAZTIcpbTGAwjeUN7xnmdObMdMxcKgf5/RG5YCSeAaLCpnc0WzuI4eKydCknRyD3QjEkI/fc0zJM6TAUi9CpvHFZtv8='} 2023-07-12T12:36:55.934 DEBUG:teuthology.nuke:shortname: smithi158 2023-07-12T12:36:55.935 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T12:36:55.961 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 12:12:56.133788', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkgjoWMeSLikqee2HICqlqu7ZCE67Te86N1Dn5UGqnG9jvgjhCottbxu6TfRlwayb5iHnfjYpcVTGFZhxNCLruPqXt5N+l5KruCRcJvFsG/ATZGB0PTRw694nqMx0qFO17RyQAhiZMzJXrYj9/D4OkFA8YGwoC3RXULV2Ut6mOo7QzrRb9HZv9gRDhflEe4LEDBFp9qWIoNsioiM1+QmQtQ9CWZtWKQMReSYtBdkmMyA+AAKvSyylokqu3YjJNFCNPODyT8hTnL0F7fmNecgRSKYOtG7qYDxtwg3484jdpZyoX9Ma8MRh9o+rE6RHej75YTzMFzsZYtX+UCR/4RsPFkJmT6no4tSOAfXrvGWsy0q5ThY2zY8mepGSVdyO+kvYjQq/lp+XdQnr4R34aiLIcUGGcxraPNM7f6Nj/V0LMS7l9LpBwmVbzLVInayxp+f4dokum3iXtA7AFStKmkzNkpXIAsSPt57iKKb+BAdKGJKM+o0ITlhMPOfj+Mveg4ak='} 2023-07-12T12:36:55.989 INFO:teuthology.orchestra.console:Power off smithi033 2023-07-12T12:36:55.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:36:56.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:36:56.039 INFO:teuthology.orchestra.console:Power off smithi158 2023-07-12T12:36:56.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:36:56.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:36:56.149 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-07-12T12:36:56.183 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2023-07-12T12:36:56.314 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-07-12T12:36:56.333 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com