2023-06-20T18:03:28.780 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T18:03:28.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:03:28.782 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:03:28.934 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fba4d8448b0>, signals=[15]) 2023-06-20T18:03:28.935 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-06-20T18:03:28.935 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T18:03:28.936 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-06-20T18:03:28.961 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-06-20T18:03:28.962 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T18:03:28.962 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-06-20T18:03:28.964 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-06-20T18:03:28.986 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-06-20T18:03:29.042 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-20T18:03:29.053 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-20T18:03:29.082 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_8.stream (ID 3) 2023-06-20T18:03:29.082 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 3} 2023-06-20T18:03:29.092 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_8.stream (ID 3) 2023-06-20T18:03:29.093 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 3} 2023-06-20T18:03:29.122 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.stream 2023-06-20T18:03:29.123 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:03:29.147 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 8.stream 2023-06-20T18:03:29.147 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:03:29.187 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T18:03:29.213 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T18:03:29.219 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-06-20T18:03:29.253 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-06-20T18:03:29.284 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:03:29.306 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:03:29.383 INFO:teuthology.orchestra.console:Power off smithi145 2023-06-20T18:03:29.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T18:03:29.402 INFO:teuthology.orchestra.console:Power off smithi188 2023-06-20T18:03:29.402 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T18:03:29.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:03:29.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:03:29.538 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-06-20T18:03:29.549 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-06-20T18:03:29.640 INFO:teuthology.orchestra.console:Power on smithi145 2023-06-20T18:03:29.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T18:03:29.650 INFO:teuthology.orchestra.console:Power on smithi188 2023-06-20T18:03:29.650 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T18:03:29.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:03:29.677 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:03:33.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:03:33.705 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:03:37.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:03:37.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:03:38.020 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2023-06-20T18:03:38.032 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2023-06-20T18:03:38.122 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-06-20T18:03:38.122 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:03:38.133 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-06-20T18:03:38.134 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:03:53.216 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:03:53.218 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:04:08.296 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:04:08.298 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:04:23.376 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:04:23.378 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:04:38.448 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:04:38.449 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:04:53.520 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:04:53.521 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:05:08.584 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:05:08.586 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:05:23.664 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:05:23.665 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:05:38.734 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:05:38.736 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:05:53.800 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:05:53.801 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:06:08.865 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-20T18:06:08.867 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:06:08.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:06:23.927 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-20T18:06:23.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:06:27.060 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-20T18:06:33.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:06:36.112 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-20T18:06:42.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:06:45.168 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-20T18:06:51.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:06:54.224 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-20T18:07:00.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:07:03.280 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-20T18:07:09.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:07:09.692 ERROR:teuthology.orchestra.connection:Error authenticating with smithi145.front.sepia.ceph.com: Authentication timeout. 2023-06-20T18:07:12.336 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-20T18:07:18.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:08:10.696 WARNING:teuthology.provision.fog.smithi145:timed out 2023-06-20T18:08:16.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:08:16.910 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T18:08:16.912 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T18:08:17.177 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-06-20T18:08:17.177 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-06-20T18:08:17.209 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-06-20T18:08:17.210 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-06-20T18:08:17.270 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-06-20T18:08:17.271 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-06-20T18:08:17.390 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-06-20T18:08:17.421 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-06-20T18:08:17.491 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-06-20T18:08:17.561 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-06-20T18:08:17.629 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-06-20T18:08:17.688 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-06-20T18:08:17.688 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-06-20T18:08:17.689 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-06-20T18:08:17.689 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-06-20T18:08:17.689 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-06-20T18:08:17.689 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-06-20T18:08:17.690 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T18:08:17.690 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-06-20T18:08:17.690 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T18:08:17.691 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-06-20T18:08:17.691 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T18:08:17.691 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T18:08:17.691 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T18:08:17.692 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-06-20T18:08:17.693 DEBUG:teuthology.parallel:result is None 2023-06-20T18:08:18.338 WARNING:teuthology.provision.fog.smithi188:timed out 2023-06-20T18:08:24.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:08:24.599 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T18:08:24.599 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T18:08:24.833 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-06-20T18:08:24.834 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-06-20T18:08:24.852 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-06-20T18:08:24.852 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-06-20T18:08:24.910 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-06-20T18:08:24.911 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-06-20T18:08:25.008 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-06-20T18:08:25.036 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-06-20T18:08:25.103 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-06-20T18:08:25.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-06-20T18:08:25.238 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-06-20T18:08:25.297 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-06-20T18:08:25.297 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8" 2023-06-20T18:08:25.297 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-06-20T18:08:25.298 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-06-20T18:08:25.298 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8" 2023-06-20T18:08:25.298 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-06-20T18:08:25.298 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T18:08:25.298 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-06-20T18:08:25.298 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T18:08:25.298 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-06-20T18:08:25.299 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T18:08:25.299 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T18:08:25.299 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T18:08:25.299 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-06-20T18:08:25.300 DEBUG:teuthology.parallel:result is None 2023-06-20T18:08:25.455 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-06-20T18:08:25.456 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T18:08:25.476 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-06-20T18:08:25.477 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T18:08:25.503 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-06-20T18:08:25.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-06-20T18:08:25.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:08:25.570 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-06-20T18:08:25.644 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-06-20T18:08:25.705 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-06-20T18:08:25.705 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-06-20T18:08:25.764 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2023-06-20T18:08:25.764 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8" 2023-06-20T18:08:25.764 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2023-06-20T18:08:25.764 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2023-06-20T18:08:25.765 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8" 2023-06-20T18:08:25.765 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-06-20T18:08:25.765 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T18:08:25.765 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-06-20T18:08:25.766 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T18:08:25.766 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2023-06-20T18:08:25.766 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T18:08:25.766 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T18:08:25.766 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T18:08:25.767 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-06-20T18:08:25.793 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-06-20T18:08:25.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-06-20T18:08:25.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T18:08:25.861 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-06-20T18:08:25.930 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-06-20T18:08:25.988 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-06-20T18:08:25.988 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-06-20T18:08:26.046 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-06-20T18:08:26.046 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8" 2023-06-20T18:08:26.046 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-06-20T18:08:26.046 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-06-20T18:08:26.046 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8" 2023-06-20T18:08:26.047 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-06-20T18:08:26.047 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T18:08:26.047 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-06-20T18:08:26.047 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T18:08:26.047 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-06-20T18:08:26.047 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T18:08:26.047 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T18:08:26.048 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T18:08:26.048 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-06-20T18:08:26.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:08:26.069 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:08:26.167 INFO:teuthology.dispatcher.supervisor:Running job 7309238 2023-06-20T18:08:26.167 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_bcs-ceph@teuthology --archive /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309238 --name bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309238/orig.config.yaml 2023-06-20T18:08:26.172 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309238 2023-06-20T18:08:26.172 INFO:teuthology.dispatcher.supervisor:Job PID: 675 2023-06-20T18:08:26.173 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T18:09:01.552 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-06-20T18:10:26.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:10:26.257 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:12:26.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:12:26.450 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:14:26.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:14:26.620 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:16:26.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:16:26.804 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:18:26.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:18:26.978 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:20:27.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:20:27.152 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:22:27.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:22:27.336 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:24:27.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:24:27.464 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:26:27.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:26:27.671 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:28:27.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:28:27.833 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:30:28.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:30:28.007 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:32:28.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:32:28.233 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:32:28.303 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T18:32:28.407 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-20T18:32:28.407 INFO:teuthology.nuke:Checking targets against current locks 2023-06-20T18:32:28.464 DEBUG:teuthology.nuke:shortname: smithi145 2023-06-20T18:32:28.465 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T18:32:28.482 DEBUG:teuthology.nuke:shortname: smithi188 2023-06-20T18:32:28.483 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T18:32:28.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309238', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 18:03:27.949370', 'locked_by': 'scheduled_bcs-ceph@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKl514QOOdtbyPbFGG8wtgKwHqit+Ygiisl6KSXHkNl26Khz3Q8d7OZtHk9v5gAkVC5RXTH+N2a4lEqY0TSjJw='} 2023-06-20T18:32:28.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309238', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 18:03:27.950826', 'locked_by': 'scheduled_bcs-ceph@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDb7BW+8cvjBOHN+3nEfYLoNbXp1Ryiz6WndP+90fWMKLPONHoAvVerVr2OxM+MbbNJJhwBK7ixtqgsQ0Hf9nrrovIYWWBOqEVxtMeSBB5NeodBLmUVYXnBYoj3bbUHhKNkxghVkwhKApboSq53ZcMJ8/iggBUVYPgyC9QTOyBrKTNXDlXBgFnHu6fO59YxgXaCaOpmr+Hdj44ziOKzFJx597kcEBRdHgM9rTj0Z00d8XeuKK5QV0reywUF55um7VpLWSFPaB6lQ95dDOVSVafPA2pdg//G2Jq2GDcpZqDpEL0pCEcr+10JPvovqrnNPTerhMKKzutvIuCQ8zr1pxgpQ4dj1OCoqLuTP0KTG1I0WmDMjK3X8+Q23iyuNI3BZIRspjHCMFqUob1hC6esWjXReHNvj9w2HM/8fotW25YSWHXjTg6cDAwRFJHYLnfN+pBSxNhM/cjEh4gCWLbdIf6QdNqS6ZB8AADXW+poymRiEWXOWVNjZIdnG743pQlWd2U='} 2023-06-20T18:32:28.539 INFO:teuthology.orchestra.console:Power off smithi145 2023-06-20T18:32:28.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T18:32:28.558 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:32:28.580 INFO:teuthology.orchestra.console:Power off smithi188 2023-06-20T18:32:28.581 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T18:32:28.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:32:28.690 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-06-20T18:32:28.719 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-06-20T18:32:28.842 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com 2023-06-20T18:32:28.867 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com