2023-06-20T17:51:28.552 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T17:51:28.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:51:28.555 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:51:28.734 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca6ffea8b0>, signals=[15]) 2023-06-20T17:51:28.735 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-06-20T17:51:28.736 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T17:51:28.736 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-06-20T17:51:28.762 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-06-20T17:51:28.763 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T17:51:28.763 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-06-20T17:51:28.764 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-06-20T17:51:28.786 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-06-20T17:51:28.833 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-20T17:51:28.848 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-20T17:51:28.885 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_centos_8.stream (ID 3) 2023-06-20T17:51:28.886 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 3} 2023-06-20T17:51:28.901 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_8.stream (ID 3) 2023-06-20T17:51:28.902 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 3} 2023-06-20T17:51:28.925 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.stream 2023-06-20T17:51:28.925 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:51:28.951 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream 2023-06-20T17:51:28.952 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:51:28.987 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T17:51:29.005 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T17:51:29.028 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-06-20T17:51:29.049 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-06-20T17:51:29.075 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:51:29.103 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:51:29.175 INFO:teuthology.orchestra.console:Power off smithi022 2023-06-20T17:51:29.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T17:51:29.193 INFO:teuthology.orchestra.console:Power off smithi073 2023-06-20T17:51:29.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T17:51:29.208 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:51:29.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:51:29.334 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2023-06-20T17:51:29.348 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-06-20T17:51:29.436 INFO:teuthology.orchestra.console:Power on smithi022 2023-06-20T17:51:29.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T17:51:29.449 INFO:teuthology.orchestra.console:Power on smithi073 2023-06-20T17:51:29.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T17:51:29.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:51:29.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:51:33.491 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:51:33.499 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:51:37.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:51:37.618 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T17:51:37.830 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2023-06-20T17:51:37.891 INFO:teuthology.orchestra.console:Power on for smithi022 completed 2023-06-20T17:51:37.932 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-06-20T17:51:37.932 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:51:37.992 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-06-20T17:51:37.992 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:51:53.025 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:51:53.050 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:52:08.112 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:52:08.116 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:52:23.192 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:52:23.194 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:52:38.288 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:52:38.290 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:52:53.376 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:52:53.378 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:53:08.456 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:53:08.457 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:53:23.540 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:53:23.542 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:53:38.625 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:53:38.626 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:53:53.724 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:53:53.725 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:54:08.809 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:54:08.810 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:54:23.892 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:54:23.894 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-20T17:54:23.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:54:27.028 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-20T17:54:33.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:54:36.112 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-20T17:54:38.968 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:54:42.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:54:45.172 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-20T17:54:51.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:54:54.033 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-06-20T17:54:54.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:54:54.256 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-20T17:54:57.172 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-06-20T17:55:00.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:55:03.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:55:03.316 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-20T17:55:06.260 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-06-20T17:55:09.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:55:12.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:55:12.404 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-20T17:55:15.312 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-06-20T17:55:18.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:55:21.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:55:24.368 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-06-20T17:55:30.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:55:33.424 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-06-20T17:55:39.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:56:18.437 WARNING:teuthology.provision.fog.smithi073:timed out 2023-06-20T17:56:24.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:56:24.689 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T17:56:24.690 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T17:56:24.933 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-06-20T17:56:24.933 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-06-20T17:56:24.951 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2023-06-20T17:56:24.952 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2023-06-20T17:56:25.010 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-06-20T17:56:25.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-06-20T17:56:25.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2023-06-20T17:56:25.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2023-06-20T17:56:25.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2023-06-20T17:56:25.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-06-20T17:56:25.351 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-06-20T17:56:25.409 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-06-20T17:56:25.409 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-06-20T17:56:25.410 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-06-20T17:56:25.410 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:56:25.410 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-06-20T17:56:25.410 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:56:25.410 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:56:25.410 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-06-20T17:56:25.410 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:56:25.411 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:56:25.411 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:56:25.411 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:56:25.411 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:56:25.412 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-06-20T17:56:25.413 DEBUG:teuthology.parallel:result is None 2023-06-20T17:56:39.444 WARNING:teuthology.provision.fog.smithi022:timed out 2023-06-20T17:56:45.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:56:45.665 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T17:56:45.666 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T17:56:45.923 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-06-20T17:56:45.924 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-06-20T17:56:45.944 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-06-20T17:56:45.944 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-06-20T17:56:46.004 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-06-20T17:56:46.005 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-06-20T17:56:46.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-06-20T17:56:46.138 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-06-20T17:56:46.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-06-20T17:56:46.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-06-20T17:56:46.345 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-06-20T17:56:46.404 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-06-20T17:56:46.404 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2023-06-20T17:56:46.404 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-06-20T17:56:46.404 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:56:46.404 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2023-06-20T17:56:46.404 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:56:46.405 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:56:46.405 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-06-20T17:56:46.405 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:56:46.405 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:56:46.405 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:56:46.405 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:56:46.405 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:56:46.406 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-06-20T17:56:46.406 DEBUG:teuthology.parallel:result is None 2023-06-20T17:56:46.558 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-06-20T17:56:46.559 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T17:56:46.590 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-06-20T17:56:46.590 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T17:56:46.616 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-06-20T17:56:46.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-06-20T17:56:46.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:56:46.681 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-06-20T17:56:46.750 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-06-20T17:56:46.807 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-06-20T17:56:46.807 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-06-20T17:56:46.865 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-06-20T17:56:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2023-06-20T17:56:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-06-20T17:56:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:56:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2023-06-20T17:56:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:56:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:56:46.867 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-06-20T17:56:46.867 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:56:46.867 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:56:46.867 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:56:46.867 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:56:46.867 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:56:46.868 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-06-20T17:56:46.889 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-06-20T17:56:46.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-06-20T17:56:46.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T17:56:46.958 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-06-20T17:56:47.091 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-06-20T17:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-06-20T17:56:47.150 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-06-20T17:56:47.208 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-06-20T17:56:47.209 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-06-20T17:56:47.209 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-06-20T17:56:47.209 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-06-20T17:56:47.209 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-06-20T17:56:47.209 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-06-20T17:56:47.210 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T17:56:47.210 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-06-20T17:56:47.210 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T17:56:47.210 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-06-20T17:56:47.210 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T17:56:47.210 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T17:56:47.210 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T17:56:47.211 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-06-20T17:56:47.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:56:47.232 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T17:56:47.328 INFO:teuthology.dispatcher.supervisor:Running job 7309217 2023-06-20T17:56:47.328 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_bcs-ceph@teuthology --archive /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309217 --name bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/filestore-xfs overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309217/orig.config.yaml 2023-06-20T17:56:47.333 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309217 2023-06-20T17:56:47.333 INFO:teuthology.dispatcher.supervisor:Job PID: 20725 2023-06-20T17:56:47.334 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T17:58:47.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T17:58:47.434 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:00:47.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:00:47.595 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:02:47.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:02:47.763 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:04:47.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:04:47.938 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:06:48.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:06:48.114 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:08:48.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:08:48.286 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:10:48.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:10:48.462 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:12:48.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:12:48.634 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:14:48.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:14:48.814 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:16:48.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:16:48.986 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:18:49.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:18:49.154 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:20:49.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:20:49.323 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:22:49.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T18:22:49.496 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T18:22:49.571 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T18:22:49.669 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-20T18:22:49.669 INFO:teuthology.nuke:Checking targets against current locks 2023-06-20T18:22:49.718 DEBUG:teuthology.nuke:shortname: smithi022 2023-06-20T18:22:49.718 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T18:22:49.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309217', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 17:51:27.655882', 'locked_by': 'scheduled_bcs-ceph@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCdOqUPPCy3U8ewQWG/B864QKMs3WwdIiAmjD3LIYDD+CzaL0nFvcwghP5Ezlhr49j4RnfnjfnXO0/IiimqThi8nL8W0Zq2vSPZJYhHl5UaDmixX6vPCTHQ66fXHzIyjCXy8wxEAMhRK2HAAlr5HOuIxth41EU+0zZ2HzMykKKkrGPPPg5MWCpiMbbJmX6dVge4y+h7iAub7xYgx7L70B3lYuX3hmV7bdwHe/isf8UpRWYIkjAZ5Rhak84XDhka9YQp+14ZCV1p2rSkE9NXYThSqvODDcQAWqp6ApP68xX7h2Y+0ALb89N85CWUoxJfqBRRtnEDAVupWgjm5KCNyiXV6MSWT1FTcUyNTUUsYI5504JOm6uhmc4WtrCOGMig8TljPB/XZNUPYzW+bAnXe5C4FXUo7fzk4g14qytsV+brMmFKUdmLHjsG/JZz+IxsOnjeg2TTdbVy5gXLTi+1YksCcA0Njqid/wbwH3wjHxZUKCcD8zQazHAFTTWj5vb4HTk='} 2023-06-20T18:22:49.741 DEBUG:teuthology.nuke:shortname: smithi073 2023-06-20T18:22:49.741 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T18:22:49.759 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bcs-ceph-2023-06-20_14:15:13-rgw-wip-kchheda3-copy-obj-testing-distro-default-smithi/7309217', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 17:51:27.657503', 'locked_by': 'scheduled_bcs-ceph@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiltPQ71sfCGSyb21qdMljl8EH/utgQk9Olc26xym1Ti/MLhf+heJl0iZlv5V6LpXHKnHtIW7f+bqSww9aizYRfFgfxRzTMTUlimiuAk6O1oPv5jEFI1xTYcEhAgJ5XbsgYjkY7aUGcff37w8vUZHIEBoJkUERtniV0aLcF4+VJYa/hcnMFf4S1q2rOxTo1MqLNryit5sKRP76SnPD/h5+CN/bmXI31GYyAPgn9YJnivK5WQbK7xWys9syQz6ef8LDlgDQN5g0ocYX6QONsBPhepJ+cW3f49ZwWCc2g5HtTSzMvRQdKBFPR5gSUDxuuxsQqcMImcfYfsGaRmgcOrrIKc+2zcJc+lz+N9IvgsM3aSJghLblTYRIu5Alwq8HzVPubJ/g1kKEQsB+KvgfBLUFRzU+a87o9hSvZCMPhJdA69y0pE9aRqlxc7G+SAWKsk75KM9oC+ZazrtF04arsGHAZyZnlhjel49SPoYeKrE/pOzx9/2gnDjBYtzUq8LUmpU='} 2023-06-20T18:22:49.789 INFO:teuthology.orchestra.console:Power off smithi022 2023-06-20T18:22:49.790 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T18:22:49.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:22:49.824 INFO:teuthology.orchestra.console:Power off smithi073 2023-06-20T18:22:49.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T18:22:49.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T18:22:49.934 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2023-06-20T18:22:49.968 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-06-20T18:22:50.088 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-06-20T18:22:50.112 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com