2023-07-21T19:51:53.161 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T19:51:53.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:51:53.163 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:51:53.324 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffaba6c08b0>, signals=[15]) 2023-07-21T19:51:53.326 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-07-21T19:51:53.326 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T19:51:53.326 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-07-21T19:51:53.355 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-07-21T19:51:53.355 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T19:51:53.356 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-07-21T19:51:53.358 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /host {"name": "smithi170"} 2023-07-21T19:51:53.379 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-07-21T19:51:53.438 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-21T19:51:53.447 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-21T19:51:53.482 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_9.stream (ID 10) 2023-07-21T19:51:53.482 DEBUG:teuthology.provision.fog.smithi170:FOG request: PUT /host/275 {"imageID": 10} 2023-07-21T19:51:53.490 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10) 2023-07-21T19:51:53.490 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 10} 2023-07-21T19:51:53.531 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 9.stream 2023-07-21T19:51:53.532 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:51:53.536 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream 2023-07-21T19:51:53.536 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:51:53.594 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T19:51:53.599 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T19:51:53.634 DEBUG:teuthology.provision.fog.smithi170:FOG request: POST /host/275/task {"taskTypeID": 1} 2023-07-21T19:51:53.640 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-07-21T19:51:53.692 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:51:53.726 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:51:53.790 INFO:teuthology.orchestra.console:Power off smithi170 2023-07-21T19:51:53.791 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T19:51:53.813 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:51:53.832 INFO:teuthology.orchestra.console:Power off smithi172 2023-07-21T19:51:53.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T19:51:53.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:51:57.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:51:57.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:01.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:01.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:02.198 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-07-21T19:52:02.299 INFO:teuthology.orchestra.console:Power on smithi172 2023-07-21T19:52:02.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T19:52:02.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:06.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:06.283 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2023-07-21T19:52:06.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:06.385 INFO:teuthology.orchestra.console:Power on smithi170 2023-07-21T19:52:06.386 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T19:52:06.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:10.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:10.454 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:10.665 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2023-07-21T19:52:10.766 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-07-21T19:52:10.767 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:52:14.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T19:52:14.762 INFO:teuthology.orchestra.console:Power on for smithi170 completed 2023-07-21T19:52:14.863 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-07-21T19:52:14.863 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:52:25.836 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:52:29.928 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:52:40.913 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:52:44.990 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:52:55.992 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:53:00.058 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:53:11.076 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:53:15.136 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:53:26.159 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:53:30.206 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:53:41.244 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:53:45.280 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:53:56.328 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:54:00.352 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:54:11.422 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:54:15.420 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:54:26.496 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:54:30.488 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:54:41.568 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:54:45.548 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-07-21T19:54:45.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:54:56.635 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-21T19:54:56.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:04.180 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-07-21T19:55:10.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:13.264 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-07-21T19:55:15.184 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-21T19:55:19.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:21.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:22.320 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-07-21T19:55:24.240 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-21T19:55:28.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:30.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:31.376 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-07-21T19:55:33.296 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-21T19:55:37.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:39.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:42.352 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-21T19:55:48.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:55:51.412 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-21T19:55:57.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:56:15.856 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-21T19:56:21.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:56:24.912 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-21T19:56:30.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:56:31.816 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T19:56:31.817 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T19:56:37.384 WARNING:teuthology.provision.fog.smithi170:timed out 2023-07-21T19:56:43.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:56:43.620 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T19:56:43.621 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T19:56:43.925 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-07-21T19:56:43.926 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-07-21T19:56:43.940 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2023-07-21T19:56:43.941 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2023-07-21T19:56:43.995 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2023-07-21T19:56:43.996 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-07-21T19:56:44.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2023-07-21T19:56:44.156 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-07-21T19:56:44.223 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2023-07-21T19:56:44.290 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-07-21T19:56:44.357 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-07-21T19:56:44.413 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2023-07-21T19:56:44.413 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2023-07-21T19:56:44.413 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2023-07-21T19:56:44.413 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2023-07-21T19:56:44.414 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2023-07-21T19:56:44.414 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2023-07-21T19:56:44.414 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T19:56:44.414 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-07-21T19:56:44.415 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2023-07-21T19:56:44.415 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T19:56:44.415 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2023-07-21T19:56:44.415 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T19:56:44.415 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T19:56:44.415 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T19:56:44.416 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-07-21T19:56:44.418 DEBUG:teuthology.parallel:result is None 2023-07-21T19:56:57.260 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-07-21T19:56:57.261 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-07-21T19:56:57.281 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2023-07-21T19:56:57.281 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2023-07-21T19:56:57.338 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-07-21T19:56:57.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-07-21T19:56:57.464 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2023-07-21T19:56:57.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-07-21T19:56:57.563 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2023-07-21T19:56:57.631 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-07-21T19:56:57.697 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-07-21T19:56:57.751 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-07-21T19:56:57.752 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2023-07-21T19:56:57.752 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-07-21T19:56:57.752 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-07-21T19:56:57.752 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2023-07-21T19:56:57.752 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2023-07-21T19:56:57.752 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T19:56:57.752 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-07-21T19:56:57.753 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2023-07-21T19:56:57.753 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T19:56:57.753 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-07-21T19:56:57.753 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T19:56:57.753 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T19:56:57.753 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T19:56:57.754 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-07-21T19:56:57.754 DEBUG:teuthology.parallel:result is None 2023-07-21T19:56:57.913 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-07-21T19:56:57.914 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T19:56:57.947 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-07-21T19:56:57.947 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T19:56:57.973 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-07-21T19:56:57.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-07-21T19:56:57.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:56:58.057 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-07-21T19:56:58.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-07-21T19:56:58.224 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-07-21T19:56:58.278 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-07-21T19:56:58.278 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-07-21T19:56:58.331 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2023-07-21T19:56:58.332 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2023-07-21T19:56:58.332 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2023-07-21T19:56:58.332 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2023-07-21T19:56:58.332 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2023-07-21T19:56:58.332 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2023-07-21T19:56:58.332 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T19:56:58.333 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-07-21T19:56:58.333 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2023-07-21T19:56:58.333 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T19:56:58.333 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2023-07-21T19:56:58.333 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T19:56:58.333 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T19:56:58.333 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T19:56:58.334 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-07-21T19:56:58.355 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-07-21T19:56:58.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-21T19:56:58.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T19:56:58.439 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-21T19:56:58.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-21T19:56:58.507 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-07-21T19:56:58.562 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-07-21T19:56:58.563 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-07-21T19:56:58.618 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-07-21T19:56:58.618 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2023-07-21T19:56:58.619 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-07-21T19:56:58.619 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-07-21T19:56:58.619 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2023-07-21T19:56:58.620 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2023-07-21T19:56:58.620 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T19:56:58.620 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-07-21T19:56:58.621 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2023-07-21T19:56:58.621 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T19:56:58.621 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-07-21T19:56:58.621 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T19:56:58.622 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T19:56:58.622 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T19:56:58.623 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-07-21T19:56:58.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:56:58.647 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:56:58.734 INFO:teuthology.dispatcher.supervisor:Running job 7347662 2023-07-21T19:56:58.735 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-07-21_18:36:50-rgw-wip-cbodley-testing-distro-default-smithi/7347662 --name cbodley-2023-07-21_18:36:50-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/upgrade/{1-install/pacific/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast objectstore/bluestore-bitmap overrides} -- /home/teuthworker/archive/cbodley-2023-07-21_18:36:50-rgw-wip-cbodley-testing-distro-default-smithi/7347662/orig.config.yaml 2023-07-21T19:56:58.740 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-07-21_18:36:50-rgw-wip-cbodley-testing-distro-default-smithi/7347662 2023-07-21T19:56:58.741 INFO:teuthology.dispatcher.supervisor:Job PID: 28397 2023-07-21T19:56:58.741 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T19:58:58.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:58:58.843 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:00:59.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T20:00:59.017 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:02:59.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T20:02:59.186 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:04:59.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T20:04:59.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:06:59.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T20:06:59.537 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:08:59.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T20:08:59.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:08:59.778 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T20:08:59.880 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T20:08:59.881 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T20:08:59.930 DEBUG:teuthology.nuke:shortname: smithi170 2023-07-21T20:08:59.930 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T20:08:59.943 DEBUG:teuthology.nuke:shortname: smithi172 2023-07-21T20:08:59.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T20:08:59.952 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-21_18:36:50-rgw-wip-cbodley-testing-distro-default-smithi/7347662', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 19:51:52.134840', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLioxHeL4q2fIFNF7u4jebIFboU2XLgP4RIA1CX9VJ27jtTHNPZJysveJwFTDrDBo48T9bioK3C591aymlVKwLM='} 2023-07-21T20:08:59.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-21_18:36:50-rgw-wip-cbodley-testing-distro-default-smithi/7347662', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 19:51:52.132808', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKQZK1uxsQXcgyCg+rFlE26Gbu8FKykZAWsv0wT4tggU+jws4WIKZMVhy5Y5Ftv90Um7/GS0RL55RbTt9/bp7EA='} 2023-07-21T20:09:00.006 INFO:teuthology.orchestra.console:Power off smithi170 2023-07-21T20:09:00.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T20:09:00.019 INFO:teuthology.orchestra.console:Power off smithi172 2023-07-21T20:09:00.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T20:09:00.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T20:09:00.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T20:09:00.151 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2023-07-21T20:09:00.159 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-07-21T20:09:00.300 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com 2023-07-21T20:09:00.318 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com