2023-07-19T20:14:49.577 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T20:14:49.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:14:49.579 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:14:49.739 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f94eee2dee0>, signals=[15]) 2023-07-19T20:14:49.741 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-07-19T20:14:49.741 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T20:14:49.741 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-19T20:14:49.781 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-07-19T20:14:49.781 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T20:14:49.781 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-19T20:14:49.783 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"} 2023-07-19T20:14:49.805 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"} 2023-07-19T20:14:49.862 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-07-19T20:14:49.868 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-07-19T20:14:49.915 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_rhel_8.4 (ID 7) 2023-07-19T20:14:49.915 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 7} 2023-07-19T20:14:49.918 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_rhel_8.4 (ID 7) 2023-07-19T20:14:49.918 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 7} 2023-07-19T20:14:49.961 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of rhel 8.4 2023-07-19T20:14:49.962 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:14:49.965 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.4 2023-07-19T20:14:49.966 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:14:50.025 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T20:14:50.029 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T20:14:50.070 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1} 2023-07-19T20:14:50.075 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1} 2023-07-19T20:14:50.129 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:14:50.131 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:14:50.236 INFO:teuthology.orchestra.console:Power off smithi086 2023-07-19T20:14:50.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:14:50.252 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-19T20:14:50.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:14:50.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:14:50.275 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:14:54.290 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:14:54.299 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:14:58.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:14:58.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:14:58.623 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-19T20:14:58.725 INFO:teuthology.orchestra.console:Power on smithi040 2023-07-19T20:14:58.725 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T20:14:58.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:15:02.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:15:02.732 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-07-19T20:15:02.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:15:02.833 INFO:teuthology.orchestra.console:Power on smithi086 2023-07-19T20:15:02.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T20:15:02.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:15:06.879 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:15:06.887 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:15:07.096 INFO:teuthology.orchestra.console:Power on for smithi040 completed 2023-07-19T20:15:07.197 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-07-19T20:15:07.198 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:15:10.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:15:11.203 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2023-07-19T20:15:11.303 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-07-19T20:15:11.304 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:15:22.288 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:15:26.384 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:15:37.360 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:15:41.448 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:15:52.432 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:15:56.516 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:16:07.492 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:16:11.576 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:16:22.560 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:16:26.637 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:16:37.624 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:16:41.700 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:16:52.684 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:16:56.764 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:17:07.740 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:17:11.816 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:17:22.824 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:17:26.876 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:17:37.884 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T20:17:37.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:17:38.046 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: Authentication failed. 2023-07-19T20:17:38.049 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:17:38.050 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:17:38.052 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T20:17:41.935 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:17:56.989 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-19T20:17:57.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:18:00.112 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-19T20:18:06.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:18:09.172 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-19T20:18:15.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:18:18.228 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-19T20:18:24.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:18:27.280 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-19T20:18:33.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:18:36.336 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-19T20:18:42.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:19:30.032 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-19T20:19:30.034 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi040 2023-07-19T20:19:39.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-19T20:19:39.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:19:39.333 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-07-19T20:19:39.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-19T20:19:39.599 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:19:39.599 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:19:39.654 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-07-19T20:19:39.654 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-07-19T20:19:39.709 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-07-19T20:19:39.709 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-07-19T20:19:39.765 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-07-19T20:19:39.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-19T20:19:39.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-07-19T20:19:39.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-07-19T20:19:39.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-07-19T20:19:40.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-19T20:19:40.123 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-19T20:19:40.178 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T20:19:40.178 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8.4 (Ootpa)" 2023-07-19T20:19:40.178 INFO:teuthology.orchestra.run.smithi040.stdout:ID="rhel" 2023-07-19T20:19:40.179 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="fedora" 2023-07-19T20:19:40.179 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8.4" 2023-07-19T20:19:40.179 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-07-19T20:19:40.179 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-19T20:19:40.179 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-19T20:19:40.179 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-19T20:19:40.179 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T20:19:40.180 INFO:teuthology.orchestra.run.smithi040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T20:19:40.180 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T20:19:40.180 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-19T20:19:40.180 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T20:19:40.180 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-19T20:19:40.180 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T20:19:40.181 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-19T20:19:40.181 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-07-19T20:19:40.182 DEBUG:teuthology.parallel:result is None 2023-07-19T20:19:42.339 WARNING:teuthology.provision.fog.smithi086:timed out 2023-07-19T20:19:48.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:19:48.692 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T20:19:48.693 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T20:19:48.916 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-07-19T20:19:48.916 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-07-19T20:19:48.969 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2023-07-19T20:19:48.969 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2023-07-19T20:19:49.023 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2023-07-19T20:19:49.023 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-07-19T20:19:49.149 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2023-07-19T20:19:49.174 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2023-07-19T20:19:49.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2023-07-19T20:19:49.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-07-19T20:19:49.372 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-19T20:19:49.429 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T20:19:49.430 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.4 (Ootpa)" 2023-07-19T20:19:49.430 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-07-19T20:19:49.430 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-07-19T20:19:49.430 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.4" 2023-07-19T20:19:49.431 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-07-19T20:19:49.431 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-19T20:19:49.431 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-19T20:19:49.431 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-19T20:19:49.431 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T20:19:49.431 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T20:19:49.431 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T20:19:49.432 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-19T20:19:49.432 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T20:19:49.432 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-19T20:19:49.432 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T20:19:49.432 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-19T20:19:49.433 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-07-19T20:19:49.433 DEBUG:teuthology.parallel:result is None 2023-07-19T20:19:49.591 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-07-19T20:19:49.592 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T20:19:49.620 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-07-19T20:19:49.620 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T20:19:49.645 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-07-19T20:19:49.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-19T20:19:49.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:19:49.717 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-07-19T20:19:49.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-19T20:19:49.744 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-07-19T20:19:49.801 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-07-19T20:19:49.801 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-19T20:19:49.858 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T20:19:49.858 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8.4 (Ootpa)" 2023-07-19T20:19:49.858 INFO:teuthology.orchestra.run.smithi040.stdout:ID="rhel" 2023-07-19T20:19:49.858 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="fedora" 2023-07-19T20:19:49.858 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8.4" 2023-07-19T20:19:49.859 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-07-19T20:19:49.859 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-19T20:19:49.859 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-19T20:19:49.859 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-19T20:19:49.860 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T20:19:49.860 INFO:teuthology.orchestra.run.smithi040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T20:19:49.860 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T20:19:49.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-19T20:19:49.860 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T20:19:49.860 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-19T20:19:49.860 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T20:19:49.861 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-19T20:19:49.861 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-19T20:19:49.885 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-07-19T20:19:49.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-19T20:19:49.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T20:19:49.954 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-07-19T20:19:50.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-19T20:19:50.018 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-07-19T20:19:50.076 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-07-19T20:19:50.077 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-19T20:19:50.134 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T20:19:50.134 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.4 (Ootpa)" 2023-07-19T20:19:50.134 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2023-07-19T20:19:50.134 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2023-07-19T20:19:50.134 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.4" 2023-07-19T20:19:50.134 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-07-19T20:19:50.135 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-07-19T20:19:50.135 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-19T20:19:50.135 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-07-19T20:19:50.135 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T20:19:50.135 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T20:19:50.135 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T20:19:50.135 INFO:teuthology.orchestra.run.smithi086.stdout: 2023-07-19T20:19:50.136 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T20:19:50.136 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-07-19T20:19:50.136 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T20:19:50.136 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-07-19T20:19:50.137 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-19T20:19:50.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:19:50.170 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:19:50.271 INFO:teuthology.dispatcher.supervisor:Running job 7343732 2023-07-19T20:19:50.271 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-19_14:33:14-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343732 --name yuriw-2023-07-19_14:33:14-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi --description rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} -- /home/teuthworker/archive/yuriw-2023-07-19_14:33:14-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343732/orig.config.yaml 2023-07-19T20:19:50.276 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-19_14:33:14-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343732 2023-07-19T20:19:50.277 INFO:teuthology.dispatcher.supervisor:Job PID: 29425 2023-07-19T20:19:50.277 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-19T20:21:50.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:21:50.377 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:23:50.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:23:50.557 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:25:50.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:25:50.750 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:27:50.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:27:50.925 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:29:51.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:29:51.094 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:31:51.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:31:51.258 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:33:51.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:33:51.424 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:35:51.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:35:51.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:37:51.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T20:37:51.771 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T20:37:51.862 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-19T20:37:52.404 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-19T20:37:52.404 INFO:teuthology.nuke:Checking targets against current locks 2023-07-19T20:37:52.474 DEBUG:teuthology.nuke:shortname: smithi040 2023-07-19T20:37:52.474 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T20:37:52.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_14:33:14-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343732', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:14:48.756663', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwKw2ZshLKlJHhyS8r/LtgufD9FLQ/AdgVVOkVeY2VZQo9hWsWD6gxIEXTmlDhF8mvU+j2UHG8lYYz2k58dWgQ='} 2023-07-19T20:37:52.517 DEBUG:teuthology.nuke:shortname: smithi086 2023-07-19T20:37:52.517 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T20:37:52.546 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_14:33:14-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343732', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 20:14:48.755078', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrTZITgNh3/7HqHAlkTwX3QBumbZswAK9T2g1S1Xprn7YuA/YjuaRczprigomlZCPLDfpOVmwhLBUlIbDuucSSGOrk2P3NRlBPzhWoKOjKjz3Rf9UQ3d0hI4iDtsfIHMb7w27Suf5q638/agwh1I9mhglYbSDLMnqYFaJ/dORtnwTwkEvrjrGnmXjEOqC/DFm0unS/fKm5QPLcekGD1AwJuz6iSDf/aHNwny4re8OD4QCMGGF4bpFaknCrKIyOq4oswsvCZkGUcHFYcXCF2T54caYwoqSfzN3Xk7FTmi7YP0qHKCi319Xd2kaDkcWwK52acqEY9KskabCPaCilRi/JaaoJXyB9W1A+BcAu/HMVamMuq45ew1Eb9QHDY1z1moJJUzCWX4xqsVlU7D9T/lxViXj/wEJnTAi3TpaGtj99OyoTpOkrcV/YMfg4vwzdcRcUCsogHc2VE3Ib1qBP7J/wGr15TDWI0cosQVTiobgNG3VR7wqjJvVnj3YihmWa86k='} 2023-07-19T20:37:52.580 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-19T20:37:52.581 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:37:52.606 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:37:52.634 INFO:teuthology.orchestra.console:Power off smithi086 2023-07-19T20:37:52.635 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T20:37:52.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T20:37:52.751 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-19T20:37:52.798 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-07-19T20:37:52.927 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-07-19T20:37:52.952 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com