2023-06-22T13:49:41.023 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T13:49:41.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:49:41.025 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:49:41.189 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff31580b8b0>, signals=[15]) 2023-06-22T13:49:41.191 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-06-22T13:49:41.191 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:49:41.192 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-06-22T13:49:41.214 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-06-22T13:49:41.215 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:49:41.215 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-06-22T13:49:41.216 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /host {"name": "smithi084"} 2023-06-22T13:49:41.239 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-06-22T13:49:41.295 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-06-22T13:49:41.311 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-06-22T13:49:41.336 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10) 2023-06-22T13:49:41.337 DEBUG:teuthology.provision.fog.smithi084:FOG request: PUT /host/189 {"imageID": 10} 2023-06-22T13:49:41.354 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2023-06-22T13:49:41.354 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 10} 2023-06-22T13:49:41.378 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream 2023-06-22T13:49:41.379 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:49:41.406 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2023-06-22T13:49:41.407 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:49:41.428 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:49:41.450 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:49:41.471 DEBUG:teuthology.provision.fog.smithi084:FOG request: POST /host/189/task {"taskTypeID": 1} 2023-06-22T13:49:41.486 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-06-22T13:49:41.516 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:49:41.541 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:49:41.600 INFO:teuthology.orchestra.console:Power off smithi084 2023-06-22T13:49:41.602 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:49:41.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:49:41.644 INFO:teuthology.orchestra.console:Power off smithi112 2023-06-22T13:49:41.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:49:41.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:49:41.755 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2023-06-22T13:49:41.789 INFO:teuthology.orchestra.console:Power off for smithi112 completed 2023-06-22T13:49:41.857 INFO:teuthology.orchestra.console:Power on smithi084 2023-06-22T13:49:41.857 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:49:41.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:49:41.892 INFO:teuthology.orchestra.console:Power on smithi112 2023-06-22T13:49:41.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:49:41.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:49:45.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:49:45.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:49:46.121 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2023-06-22T13:49:46.222 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-06-22T13:49:46.223 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:49:50.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:49:50.267 INFO:teuthology.orchestra.console:Power on for smithi112 completed 2023-06-22T13:49:50.369 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-06-22T13:49:50.369 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:50:01.294 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:50:05.429 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:50:16.360 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:50:20.486 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:50:31.420 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:50:35.541 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:50:46.476 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:50:50.604 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:51:01.540 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:51:05.652 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:51:16.596 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:51:20.704 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:51:31.660 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:51:35.767 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:51:46.724 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:51:50.828 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:52:01.804 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:52:05.896 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:52:16.876 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:52:20.972 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-06-22T13:52:21.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:24.112 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-06-22T13:52:30.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:31.939 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-06-22T13:52:32.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:33.168 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-06-22T13:52:35.088 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-22T13:52:39.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:41.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:42.228 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-06-22T13:52:44.144 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-22T13:52:48.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:50.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:51.314 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-06-22T13:52:53.200 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-22T13:52:57.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:52:59.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:53:00.404 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-06-22T13:53:02.256 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-22T13:53:06.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:53:08.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:53:09.488 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-06-22T13:53:11.316 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-22T13:53:15.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:53:17.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:53:18.544 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-06-22T13:53:20.400 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-22T13:53:24.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:53:26.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:53:44.816 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-22T13:53:50.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:53:53.872 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-22T13:53:59.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:54:01.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:54:01.093 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:54:24.551 WARNING:teuthology.provision.fog.smithi112:timed out 2023-06-22T13:54:26.695 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-06-22T13:54:26.695 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-06-22T13:54:26.715 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2023-06-22T13:54:26.715 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2023-06-22T13:54:26.772 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-06-22T13:54:26.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-06-22T13:54:26.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2023-06-22T13:54:26.947 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-06-22T13:54:27.017 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2023-06-22T13:54:27.086 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-06-22T13:54:27.154 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-06-22T13:54:27.210 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-06-22T13:54:27.210 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2023-06-22T13:54:27.211 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-06-22T13:54:27.211 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-06-22T13:54:27.211 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2023-06-22T13:54:27.211 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2023-06-22T13:54:27.212 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-22T13:54:27.212 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-06-22T13:54:27.212 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2023-06-22T13:54:27.212 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-22T13:54:27.212 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-06-22T13:54:27.213 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:54:27.213 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-22T13:54:27.213 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T13:54:27.214 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-06-22T13:54:27.215 DEBUG:teuthology.parallel:result is None 2023-06-22T13:54:30.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:54:30.764 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:54:30.765 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:54:31.088 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-06-22T13:54:31.089 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-06-22T13:54:31.103 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-06-22T13:54:31.104 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-06-22T13:54:31.158 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-06-22T13:54:31.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-06-22T13:54:31.269 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-06-22T13:54:31.297 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-06-22T13:54:31.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-06-22T13:54:31.431 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-06-22T13:54:31.498 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-06-22T13:54:31.551 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-06-22T13:54:31.552 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-06-22T13:54:31.552 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-06-22T13:54:31.552 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-06-22T13:54:31.552 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-06-22T13:54:31.552 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-06-22T13:54:31.553 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-22T13:54:31.553 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-06-22T13:54:31.553 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-06-22T13:54:31.553 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-22T13:54:31.553 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-06-22T13:54:31.553 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:54:31.553 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-22T13:54:31.554 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T13:54:31.554 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-06-22T13:54:31.554 DEBUG:teuthology.parallel:result is None 2023-06-22T13:54:31.706 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2023-06-22T13:54:31.707 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T13:54:31.731 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-06-22T13:54:31.732 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T13:54:31.749 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:54:31.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-06-22T13:54:31.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:54:31.835 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-06-22T13:54:31.908 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-06-22T13:54:31.963 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-06-22T13:54:31.964 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-06-22T13:54:32.018 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-06-22T13:54:32.018 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2023-06-22T13:54:32.018 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-06-22T13:54:32.019 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-06-22T13:54:32.019 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2023-06-22T13:54:32.019 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2023-06-22T13:54:32.019 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-22T13:54:32.019 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-06-22T13:54:32.019 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2023-06-22T13:54:32.019 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-22T13:54:32.020 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-06-22T13:54:32.020 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:54:32.020 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-22T13:54:32.020 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T13:54:32.021 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-06-22T13:54:32.048 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:54:32.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-06-22T13:54:32.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:54:32.128 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-06-22T13:54:32.197 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-06-22T13:54:32.251 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-06-22T13:54:32.252 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-06-22T13:54:32.305 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-06-22T13:54:32.306 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-06-22T13:54:32.306 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-06-22T13:54:32.306 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-06-22T13:54:32.306 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-06-22T13:54:32.306 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-06-22T13:54:32.306 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-22T13:54:32.306 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-06-22T13:54:32.307 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-06-22T13:54:32.307 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-22T13:54:32.307 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-06-22T13:54:32.307 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:54:32.307 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-22T13:54:32.307 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T13:54:32.308 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-06-22T13:54:32.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:54:32.332 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:54:32.429 INFO:teuthology.dispatcher.supervisor:Running job 7311713 2023-06-22T13:54:32.429 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-06-22_13:47:42-rgw:verify-main-distro-default-smithi/7311713 --name cbodley-2023-06-22_13:47:42-rgw:verify-main-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/cbodley-2023-06-22_13:47:42-rgw:verify-main-distro-default-smithi/7311713/orig.config.yaml 2023-06-22T13:54:32.432 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-06-22_13:47:42-rgw:verify-main-distro-default-smithi/7311713 2023-06-22T13:54:32.433 INFO:teuthology.dispatcher.supervisor:Job PID: 26855 2023-06-22T13:54:32.433 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-22T13:56:32.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:56:32.535 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:58:32.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:58:32.710 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:00:32.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:00:32.889 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:02:33.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:02:33.215 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:04:33.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:04:33.390 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:06:33.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:06:33.565 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:06:33.632 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-22T14:06:33.740 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-22T14:06:33.741 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T14:06:33.790 DEBUG:teuthology.nuke:shortname: smithi084 2023-06-22T14:06:33.790 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T14:06:33.814 DEBUG:teuthology.nuke:shortname: smithi112 2023-06-22T14:06:33.814 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T14:06:33.818 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-06-22_13:47:42-rgw:verify-main-distro-default-smithi/7311713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:49:40.213909', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL17jLOUZbCVrya8qFfOCOXC0mFa/qhW/ajQa2zyVsDIxoPQa+Bq9qaPZEeNNn30NH8ZkaOKimqNXVZcYyORpiU='} 2023-06-22T14:06:33.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-06-22_13:47:42-rgw:verify-main-distro-default-smithi/7311713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:49:40.215489', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNktkvMcltqOePgrnE3SovvzdU6WzT/VXtC69+ISJIENk7HHMNC2ATCuTGruNX4z/RtztwChUQ4RwiYH8T29WI='} 2023-06-22T14:06:33.876 INFO:teuthology.orchestra.console:Power off smithi084 2023-06-22T14:06:33.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:06:33.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:06:33.923 INFO:teuthology.orchestra.console:Power off smithi112 2023-06-22T14:06:33.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:06:33.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:06:34.033 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2023-06-22T14:06:34.066 INFO:teuthology.orchestra.console:Power off for smithi112 completed 2023-06-22T14:06:34.188 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2023-06-22T14:06:34.213 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com