2023-06-29T19:22:15.501 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39 2023-06-29T19:22:15.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:22:15.504 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:22:15.703 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f093ba3d8b0>, signals=[15]) 2023-06-29T19:22:15.705 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-06-29T19:22:15.706 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T19:22:15.709 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-06-29T19:22:15.743 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-06-29T19:22:15.744 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T19:22:15.744 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-06-29T19:22:15.746 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-06-29T19:22:15.774 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-06-29T19:22:15.833 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-29T19:22:15.848 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-29T19:22:15.870 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-29T19:22:15.870 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 5} 2023-06-29T19:22:15.891 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-29T19:22:15.892 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 5} 2023-06-29T19:22:15.920 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6 2023-06-29T19:22:15.920 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:22:15.939 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.6 2023-06-29T19:22:15.940 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:22:15.982 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T19:22:15.994 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T19:22:16.018 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-06-29T19:22:16.036 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-06-29T19:22:16.076 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:22:16.083 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:22:16.182 INFO:teuthology.orchestra.console:Power off smithi195 2023-06-29T19:22:16.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:22:16.201 INFO:teuthology.orchestra.console:Power off smithi057 2023-06-29T19:22:16.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:22:16.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:16.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:20.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:20.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:24.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:24.370 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:24.581 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-06-29T19:22:24.682 INFO:teuthology.orchestra.console:Power on smithi057 2023-06-29T19:22:24.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T19:22:24.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:28.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:28.687 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-06-29T19:22:28.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:28.790 INFO:teuthology.orchestra.console:Power on smithi195 2023-06-29T19:22:28.791 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T19:22:28.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:32.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:32.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:22:33.056 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2023-06-29T19:22:33.102 INFO:teuthology.orchestra.console:Power on for smithi057 completed 2023-06-29T19:22:33.158 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-06-29T19:22:33.159 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:22:33.204 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-06-29T19:22:33.205 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:22:48.240 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:22:48.271 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:23:03.320 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:23:03.336 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:23:18.404 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:23:18.405 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:23:33.496 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:23:33.498 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:23:48.588 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:23:48.589 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:24:03.676 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:24:03.678 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:24:18.764 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:24:18.766 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:24:33.848 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:24:33.849 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:24:48.932 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:24:48.933 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:25:04.023 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:25:04.024 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:25:19.116 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-29T19:25:19.118 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-29T19:25:19.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:19.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:22.256 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-29T19:25:22.257 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-29T19:25:28.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:28.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:31.316 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-29T19:25:31.317 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-29T19:25:37.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:37.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:40.400 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-29T19:25:40.401 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-29T19:25:46.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:46.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:49.456 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-29T19:25:49.488 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-29T19:25:55.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:55.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:25:58.512 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-29T19:25:58.544 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-29T19:26:04.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:26:04.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:26:07.568 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-29T19:26:07.600 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-29T19:26:13.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:26:13.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:26:16.660 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-29T19:26:22.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:26:45.358 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T19:26:45.359 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T19:26:45.625 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-06-29T19:26:45.625 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-06-29T19:26:45.650 INFO:teuthology.orchestra.run.smithi195.stdout:smithi022 2023-06-29T19:26:45.650 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi022 /etc/hosts 2023-06-29T19:26:45.707 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-06-29T19:26:45.708 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-06-29T19:26:45.860 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi022/smithi195/g' /etc/hosts 2023-06-29T19:26:45.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.22/172.21.15.195/g' /etc/hosts 2023-06-29T19:26:45.957 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi022/smithi195/g' /etc/hostname 2023-06-29T19:26:46.025 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-06-29T19:26:46.093 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-06-29T19:26:46.149 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-06-29T19:26:46.150 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-06-29T19:26:46.150 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-06-29T19:26:46.150 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-06-29T19:26:46.150 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-06-29T19:26:46.150 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:26:46.151 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-29T19:26:46.151 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-06-29T19:26:46.151 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-29T19:26:46.151 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-06-29T19:26:46.151 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-29T19:26:46.151 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:26:46.151 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-06-29T19:26:46.152 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:26:46.152 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-29T19:26:46.152 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-29T19:26:46.152 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-29T19:26:46.153 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-06-29T19:26:46.154 DEBUG:teuthology.parallel:result is None 2023-06-29T19:27:22.704 WARNING:teuthology.provision.fog.smithi057:timed out 2023-06-29T19:27:28.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:27:28.941 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T19:27:28.942 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T19:27:29.397 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-06-29T19:27:29.398 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-06-29T19:27:29.417 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-06-29T19:27:29.418 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-06-29T19:27:29.476 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-06-29T19:27:29.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-06-29T19:27:29.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-06-29T19:27:29.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-06-29T19:27:29.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-06-29T19:27:29.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-06-29T19:27:29.838 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-06-29T19:27:29.896 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-06-29T19:27:29.897 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-06-29T19:27:29.897 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-06-29T19:27:29.897 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-06-29T19:27:29.897 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-06-29T19:27:29.897 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:27:29.897 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-29T19:27:29.898 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-06-29T19:27:29.898 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-29T19:27:29.898 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-06-29T19:27:29.898 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-29T19:27:29.899 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:27:29.899 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-06-29T19:27:29.899 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:27:29.899 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-29T19:27:29.899 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-29T19:27:29.899 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-29T19:27:29.900 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-06-29T19:27:29.900 DEBUG:teuthology.parallel:result is None 2023-06-29T19:27:30.066 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-06-29T19:27:30.067 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T19:27:30.096 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-06-29T19:27:30.096 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T19:27:30.122 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-06-29T19:27:30.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-06-29T19:27:30.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:27:30.191 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-06-29T19:27:30.258 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-06-29T19:27:30.316 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-06-29T19:27:30.317 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-06-29T19:27:30.374 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-06-29T19:27:30.374 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-06-29T19:27:30.374 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-06-29T19:27:30.374 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-06-29T19:27:30.374 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-06-29T19:27:30.375 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:27:30.375 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-29T19:27:30.375 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-06-29T19:27:30.375 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-29T19:27:30.375 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-06-29T19:27:30.375 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-29T19:27:30.375 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:27:30.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-06-29T19:27:30.376 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:27:30.376 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-29T19:27:30.376 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-29T19:27:30.376 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-29T19:27:30.377 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-06-29T19:27:30.403 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-06-29T19:27:30.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-06-29T19:27:30.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:27:30.471 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-06-29T19:27:30.610 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-06-29T19:27:30.667 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-06-29T19:27:30.668 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-06-29T19:27:30.725 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-06-29T19:27:30.726 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-06-29T19:27:30.726 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-06-29T19:27:30.726 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-06-29T19:27:30.726 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-06-29T19:27:30.726 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:27:30.727 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-29T19:27:30.727 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-06-29T19:27:30.727 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-29T19:27:30.727 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-06-29T19:27:30.727 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-29T19:27:30.727 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:27:30.728 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-06-29T19:27:30.728 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:27:30.728 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-29T19:27:30.728 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-29T19:27:30.728 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-29T19:27:30.729 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-06-29T19:27:30.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:27:30.755 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:27:30.856 INFO:teuthology.dispatcher.supervisor:Running job 7321525 2023-06-29T19:27:30.857 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321525 --name adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi --description orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} -- /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321525/orig.config.yaml 2023-06-29T19:27:30.861 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321525 2023-06-29T19:27:30.862 INFO:teuthology.dispatcher.supervisor:Job PID: 8463 2023-06-29T19:27:30.862 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-29T19:29:30.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:29:30.961 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:31:31.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:31:31.130 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:33:31.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:33:31.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:35:31.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:35:31.442 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:37:31.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:37:31.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:39:31.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:39:31.799 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:41:31.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:41:31.966 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:43:32.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:43:32.138 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:45:32.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:45:32.310 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:47:32.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:47:32.489 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:49:32.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:49:32.662 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:51:32.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:51:32.835 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:53:33.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:53:33.014 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:55:33.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:55:33.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:57:33.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:57:33.370 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:59:33.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:59:33.536 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:01:33.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:01:33.702 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:03:33.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:03:33.879 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:05:34.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:05:34.054 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:07:34.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:07:34.222 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:09:34.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:09:34.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:11:34.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:11:34.573 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:13:34.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:13:34.754 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:13:34.818 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-29T20:13:34.944 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-29T20:13:34.945 INFO:teuthology.nuke:Checking targets against current locks 2023-06-29T20:13:35.005 DEBUG:teuthology.nuke:shortname: smithi057 2023-06-29T20:13:35.006 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T20:13:35.034 DEBUG:teuthology.nuke:shortname: smithi195 2023-06-29T20:13:35.035 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T20:13:35.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321525', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:22:14.542246', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-29T20:13:35.058 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321525', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:22:14.541078', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-29T20:13:35.097 INFO:teuthology.orchestra.console:Power off smithi057 2023-06-29T20:13:35.098 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T20:13:35.114 INFO:teuthology.orchestra.console:Power off smithi195 2023-06-29T20:13:35.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T20:13:35.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T20:13:35.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T20:13:35.252 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-06-29T20:13:35.264 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-06-29T20:13:35.409 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-06-29T20:13:35.418 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com