2023-07-11T08:51:06.619 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T08:51:06.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:51:06.621 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:51:06.781 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb55ace8ca0>, signals=[15]) 2023-07-11T08:51:06.783 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-07-11T08:51:06.783 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T08:51:06.783 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-07-11T08:51:06.809 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-07-11T08:51:06.809 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T08:51:06.809 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-11T08:51:06.811 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-07-11T08:51:06.834 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-07-11T08:51:06.888 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-11T08:51:06.917 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-11T08:51:06.926 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-11T08:51:06.927 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 5} 2023-07-11T08:51:06.959 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-11T08:51:06.959 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 5} 2023-07-11T08:51:06.975 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6 2023-07-11T08:51:06.975 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:51:07.023 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.6 2023-07-11T08:51:07.024 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:51:07.032 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T08:51:07.083 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-07-11T08:51:07.093 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T08:51:07.135 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:51:07.137 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-07-11T08:51:07.200 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:51:07.230 INFO:teuthology.orchestra.console:Power off smithi079 2023-07-11T08:51:07.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:51:07.254 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:07.283 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-11T08:51:07.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:51:07.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:11.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:11.331 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:15.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:15.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:20.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:20.559 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:25.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:25.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:30.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:30.783 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:30.949 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2023-07-11T08:51:31.050 INFO:teuthology.orchestra.console:Power on smithi079 2023-07-11T08:51:31.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T08:51:31.075 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:35.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:35.311 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2023-07-11T08:51:35.412 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-07-11T08:51:35.413 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:51:35.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:41.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:46.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:50.476 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:51:53.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:51:58.906 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:52:04.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:52:08.864 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:52:09.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:52:09.339 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-11T08:52:09.440 INFO:teuthology.orchestra.console:Power on smithi145 2023-07-11T08:52:09.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T08:52:09.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:52:13.516 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:52:13.727 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2023-07-11T08:52:13.828 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-07-11T08:52:13.829 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:52:23.952 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:52:28.958 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:52:54.040 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:52:54.042 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:53:09.116 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:53:09.118 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:53:29.200 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:53:29.202 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:53:54.324 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:53:54.333 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:54:09.400 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:54:09.402 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-11T08:54:19.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:54:22.548 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-11T08:54:28.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:54:31.600 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-11T08:54:34.496 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:54:39.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:54:47.568 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-11T08:54:53.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:54:59.566 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-11T08:55:04.573 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-11T08:55:04.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:55:07.696 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-11T08:55:10.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:55:13.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:55:21.776 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-11T08:55:27.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:55:35.856 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-11T08:55:41.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:55:47.152 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-11T08:55:53.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:56:10.596 WARNING:teuthology.provision.fog.smithi079:timed out 2023-07-11T08:56:16.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:56:21.997 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:56:21.998 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:56:22.281 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-07-11T08:56:22.282 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-07-11T08:56:22.299 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-07-11T08:56:22.299 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-07-11T08:56:22.355 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-07-11T08:56:22.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-07-11T08:56:22.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-07-11T08:56:22.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-07-11T08:56:22.574 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-07-11T08:56:22.641 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-07-11T08:56:22.709 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-07-11T08:56:22.769 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-07-11T08:56:22.769 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-07-11T08:56:22.769 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-07-11T08:56:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-07-11T08:56:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-07-11T08:56:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:56:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-11T08:56:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-07-11T08:56:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-11T08:56:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-07-11T08:56:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-11T08:56:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:56:22.771 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-11T08:56:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:56:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-11T08:56:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-11T08:56:22.772 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-11T08:56:22.772 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-07-11T08:56:22.774 DEBUG:teuthology.parallel:result is None 2023-07-11T08:56:25.201 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:56:25.201 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:56:25.500 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-07-11T08:56:25.500 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-07-11T08:56:25.516 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-07-11T08:56:25.516 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-07-11T08:56:25.572 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-07-11T08:56:25.573 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-11T08:56:25.773 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-07-11T08:56:25.800 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-07-11T08:56:25.868 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-07-11T08:56:25.935 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-11T08:56:26.001 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-11T08:56:26.058 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-07-11T08:56:26.058 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-07-11T08:56:26.058 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-07-11T08:56:26.058 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-07-11T08:56:26.059 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-07-11T08:56:26.059 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:56:26.059 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-11T08:56:26.059 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-11T08:56:26.059 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-11T08:56:26.059 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-07-11T08:56:26.060 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-11T08:56:26.060 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:56:26.060 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-11T08:56:26.060 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:56:26.060 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-11T08:56:26.060 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-11T08:56:26.060 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-11T08:56:26.061 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-07-11T08:56:26.061 DEBUG:teuthology.parallel:result is None 2023-07-11T08:56:27.629 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-07-11T08:56:27.630 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T08:56:27.655 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-07-11T08:56:27.656 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T08:56:27.673 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-07-11T08:56:27.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-11T08:56:27.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:56:27.744 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-07-11T08:56:27.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-11T08:56:27.817 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-07-11T08:56:27.879 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-07-11T08:56:27.879 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-07-11T08:56:27.940 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-07-11T08:56:27.941 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-07-11T08:56:27.941 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-07-11T08:56:27.941 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-07-11T08:56:27.941 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-07-11T08:56:27.941 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:56:27.942 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-11T08:56:27.942 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-07-11T08:56:27.942 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-11T08:56:27.942 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-07-11T08:56:27.942 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-11T08:56:27.942 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:56:27.942 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-07-11T08:56:27.942 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:56:27.943 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-11T08:56:27.943 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-11T08:56:27.943 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-11T08:56:27.945 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-07-11T08:56:27.972 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-07-11T08:56:27.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-11T08:56:27.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:56:28.036 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-07-11T08:56:28.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-11T08:56:28.102 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-07-11T08:56:28.157 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-07-11T08:56:28.158 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-11T08:56:28.212 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-07-11T08:56:28.213 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-07-11T08:56:28.213 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-07-11T08:56:28.213 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-07-11T08:56:28.213 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-07-11T08:56:28.213 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:56:28.213 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-11T08:56:28.213 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-11T08:56:28.214 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-11T08:56:28.214 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-07-11T08:56:28.214 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-11T08:56:28.214 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:56:28.214 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-11T08:56:28.214 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:56:28.214 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-11T08:56:28.215 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-11T08:56:28.215 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-11T08:56:28.215 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-11T08:56:28.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:56:28.239 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:56:28.338 INFO:teuthology.dispatcher.supervisor:Running job 7333602 2023-07-11T08:56:28.339 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-07-11_08:35:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7333602 --name prsrivas-2023-07-11_08:35:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/prsrivas-2023-07-11_08:35:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7333602/orig.config.yaml 2023-07-11T08:56:28.342 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-07-11_08:35:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7333602 2023-07-11T08:56:28.343 INFO:teuthology.dispatcher.supervisor:Job PID: 2217 2023-07-11T08:56:28.343 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-11T08:58:28.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:58:28.446 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:00:33.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:00:33.294 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:02:33.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:02:33.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:04:37.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:04:37.086 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:06:41.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:06:41.447 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:08:46.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:08:46.611 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:10:47.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:10:47.346 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:12:52.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:12:52.538 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:14:53.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:14:53.950 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:16:59.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:16:59.150 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:19:00.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:19:00.166 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:21:05.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:21:05.345 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:23:10.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:23:10.530 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:23:14.211 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-11T09:23:14.321 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-11T09:23:14.322 INFO:teuthology.nuke:Checking targets against current locks 2023-07-11T09:23:14.378 DEBUG:teuthology.nuke:shortname: smithi079 2023-07-11T09:23:14.379 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T09:23:14.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-11_08:35:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7333602', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:51:05.797348', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-11T09:23:14.408 DEBUG:teuthology.nuke:shortname: smithi145 2023-07-11T09:23:14.409 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T09:23:14.434 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-11_08:35:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7333602', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:51:05.795734', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-11T09:23:14.468 INFO:teuthology.orchestra.console:Power off smithi079 2023-07-11T09:23:14.469 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T09:23:14.484 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-11T09:23:14.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T09:23:14.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:23:14.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:23:14.624 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2023-07-11T09:23:14.634 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-11T09:23:14.787 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-07-11T09:23:14.794 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com