2023-07-12T12:12:57.413 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T12:12:57.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:12:57.415 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:12:57.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3b49e658b0>, signals=[15]) 2023-07-12T12:12:57.586 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-07-12T12:12:57.586 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T12:12:57.587 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-12T12:12:57.630 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-07-12T12:12:57.630 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T12:12:57.631 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-07-12T12:12:57.633 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-07-12T12:12:57.662 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-07-12T12:12:57.707 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T12:12:57.732 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-12T12:12:57.746 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T12:12:57.746 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 5} 2023-07-12T12:12:57.775 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-12T12:12:57.775 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 5} 2023-07-12T12:12:57.784 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of rhel 8.6 2023-07-12T12:12:57.784 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:12:57.819 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of rhel 8.6 2023-07-12T12:12:57.819 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:12:57.827 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T12:12:57.867 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-07-12T12:12:57.873 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T12:12:57.909 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-07-12T12:12:57.913 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:12:57.961 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:12:58.006 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-12T12:12:58.007 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:12:58.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:12:58.074 INFO:teuthology.orchestra.console:Power off smithi193 2023-07-12T12:12:58.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:12:58.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:02.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:02.118 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:06.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:06.230 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:10.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:10.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:10.501 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-12T12:13:10.553 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-07-12T12:13:10.603 INFO:teuthology.orchestra.console:Power on smithi003 2023-07-12T12:13:10.603 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T12:13:10.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:10.654 INFO:teuthology.orchestra.console:Power on smithi193 2023-07-12T12:13:10.655 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T12:13:10.675 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:14.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:14.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:13:14.865 INFO:teuthology.orchestra.console:Power on for smithi003 completed 2023-07-12T12:13:14.908 INFO:teuthology.orchestra.console:Power on for smithi193 completed 2023-07-12T12:13:14.966 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-07-12T12:13:14.967 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:13:15.008 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-07-12T12:13:15.009 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:13:30.036 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:13:30.054 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:13:45.104 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:13:45.106 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:14:00.172 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:14:00.174 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:14:15.240 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:14:15.241 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:14:30.318 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:14:30.320 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:14:45.396 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:14:45.397 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:15:00.480 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:15:00.482 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:15:15.560 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:15:15.561 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:15:30.640 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:15:30.641 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:15:45.719 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:15:45.720 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-12T12:15:45.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:15:48.848 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-12T12:15:54.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:15:57.936 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-12T12:16:00.796 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-12T12:16:00.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:03.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:03.952 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-12T12:16:06.992 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-12T12:16:09.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:12.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:13.008 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-12T12:16:16.048 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-12T12:16:19.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:22.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:22.068 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-12T12:16:25.104 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-12T12:16:28.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:31.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:31.124 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-12T12:16:34.160 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-12T12:16:37.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:40.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:40.176 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-12T12:16:46.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:16:49.232 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-12T12:16:55.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:17:40.212 WARNING:teuthology.provision.fog.smithi003:timed out 2023-07-12T12:17:46.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:17:46.546 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T12:17:46.547 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T12:17:46.868 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-07-12T12:17:46.868 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-07-12T12:17:46.887 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-07-12T12:17:46.887 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-07-12T12:17:46.947 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-07-12T12:17:46.948 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-12T12:17:47.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-07-12T12:17:47.101 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-07-12T12:17:47.171 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-07-12T12:17:47.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-12T12:17:47.308 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-12T12:17:47.366 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T12:17:47.366 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T12:17:47.366 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-07-12T12:17:47.367 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-07-12T12:17:47.367 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-07-12T12:17:47.367 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:17:47.367 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T12:17:47.367 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-12T12:17:47.367 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T12:17:47.367 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T12:17:47.368 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T12:17:47.368 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:17:47.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-07-12T12:17:47.368 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:17:47.368 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T12:17:47.368 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T12:17:47.368 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T12:17:47.369 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-07-12T12:17:47.371 DEBUG:teuthology.parallel:result is None 2023-07-12T12:17:55.244 WARNING:teuthology.provision.fog.smithi193:timed out 2023-07-12T12:18:01.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:18:01.582 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T12:18:01.582 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T12:18:01.876 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-07-12T12:18:01.877 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-07-12T12:18:01.895 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193 2023-07-12T12:18:01.895 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193 /etc/hosts 2023-07-12T12:18:01.952 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-07-12T12:18:01.953 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-07-12T12:18:02.077 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193/smithi193/g' /etc/hosts 2023-07-12T12:18:02.105 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-07-12T12:18:02.174 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193/smithi193/g' /etc/hostname 2023-07-12T12:18:02.240 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-07-12T12:18:02.306 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-07-12T12:18:02.363 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T12:18:02.363 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T12:18:02.363 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-07-12T12:18:02.364 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-07-12T12:18:02.364 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2023-07-12T12:18:02.364 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:18:02.364 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T12:18:02.365 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-07-12T12:18:02.365 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T12:18:02.365 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T12:18:02.365 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T12:18:02.365 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:18:02.365 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-07-12T12:18:02.366 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:18:02.366 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T12:18:02.366 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T12:18:02.366 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T12:18:02.366 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-07-12T12:18:02.367 DEBUG:teuthology.parallel:result is None 2023-07-12T12:18:02.528 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-07-12T12:18:02.529 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T12:18:02.553 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-07-12T12:18:02.554 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T12:18:02.579 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-07-12T12:18:02.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-12T12:18:02.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:18:02.647 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-07-12T12:18:02.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-12T12:18:02.783 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-07-12T12:18:02.841 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-07-12T12:18:02.841 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-12T12:18:02.899 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T12:18:02.899 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T12:18:02.899 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-07-12T12:18:02.900 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-07-12T12:18:02.900 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-07-12T12:18:02.900 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:18:02.900 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T12:18:02.900 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-12T12:18:02.900 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T12:18:02.900 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T12:18:02.901 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T12:18:02.901 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:18:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-07-12T12:18:02.901 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:18:02.901 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T12:18:02.901 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T12:18:02.901 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T12:18:02.902 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-12T12:18:02.929 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-07-12T12:18:02.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-07-12T12:18:02.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T12:18:03.039 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-07-12T12:18:03.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-07-12T12:18:03.105 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-07-12T12:18:03.160 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-07-12T12:18:03.161 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-07-12T12:18:03.217 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-07-12T12:18:03.217 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2023-07-12T12:18:03.217 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-07-12T12:18:03.217 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-07-12T12:18:03.217 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2023-07-12T12:18:03.218 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-07-12T12:18:03.218 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-12T12:18:03.218 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-07-12T12:18:03.218 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-12T12:18:03.218 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-07-12T12:18:03.218 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-12T12:18:03.218 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-12T12:18:03.218 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-07-12T12:18:03.219 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-12T12:18:03.219 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-12T12:18:03.219 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-12T12:18:03.219 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-12T12:18:03.219 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-07-12T12:18:03.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:18:03.245 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:18:03.352 INFO:teuthology.dispatcher.supervisor:Running job 7334954 2023-07-12T12:18:03.353 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_kkeithle@teuthology --archive /home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334954 --name kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334954/orig.config.yaml 2023-07-12T12:18:03.357 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334954 2023-07-12T12:18:03.358 INFO:teuthology.dispatcher.supervisor:Job PID: 30302 2023-07-12T12:18:03.358 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-12T12:20:03.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:20:03.458 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:22:03.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:22:03.645 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:24:03.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:24:03.837 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:26:04.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:26:04.020 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:28:04.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:28:04.206 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:30:04.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:30:04.389 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:32:04.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:32:04.562 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:34:04.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:34:04.746 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:36:04.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:36:04.922 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:38:05.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T12:38:05.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T12:38:05.175 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-12T12:38:05.294 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-12T12:38:05.294 INFO:teuthology.nuke:Checking targets against current locks 2023-07-12T12:38:05.354 DEBUG:teuthology.nuke:shortname: smithi003 2023-07-12T12:38:05.355 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T12:38:05.378 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 12:12:56.556926', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T12:38:05.381 DEBUG:teuthology.nuke:shortname: smithi193 2023-07-12T12:38:05.382 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T12:38:05.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2023-07-12_09:17:11-rgw:verify-wip-kkeithley-zipper-ai-distro-default-smithi/7334954', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 12:12:56.558219', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-12T12:38:05.443 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-12T12:38:05.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:38:05.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:38:05.484 INFO:teuthology.orchestra.console:Power off smithi193 2023-07-12T12:38:05.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T12:38:05.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T12:38:05.599 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-12T12:38:05.635 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-07-12T12:38:05.763 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-07-12T12:38:05.788 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com