2023-07-07T18:50:35.192 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-07T18:50:35.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T18:50:35.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T18:50:35.366 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdca9ed1c10>, signals=[15]) 2023-07-07T18:50:35.368 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging 2023-07-07T18:50:35.368 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server 2023-07-07T18:50:35.368 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-07-07T18:50:35.390 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-07-07T18:50:35.391 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-07-07T18:50:35.391 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-07T18:50:35.392 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /host {"name": "smithi042"} 2023-07-07T18:50:35.416 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-07-07T18:50:35.453 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-07T18:50:35.487 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-07T18:50:35.495 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-07T18:50:35.496 DEBUG:teuthology.provision.fog.smithi042:FOG request: PUT /host/147 {"imageID": 5} 2023-07-07T18:50:35.524 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-07T18:50:35.525 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 5} 2023-07-07T18:50:35.532 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of rhel 8.6 2023-07-07T18:50:35.532 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:50:35.564 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.6 2023-07-07T18:50:35.564 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:50:35.600 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /tasktype {"name": "deploy"} 2023-07-07T18:50:35.631 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-07-07T18:50:35.636 DEBUG:teuthology.provision.fog.smithi042:FOG request: POST /host/147/task {"taskTypeID": 1} 2023-07-07T18:50:35.681 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-07-07T18:50:35.695 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:50:35.726 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:50:35.793 INFO:teuthology.orchestra.console:Power off smithi042 2023-07-07T18:50:35.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T18:50:35.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T18:50:35.839 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-07T18:50:35.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T18:50:35.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T18:50:35.951 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2023-07-07T18:50:35.985 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-07T18:50:36.052 INFO:teuthology.orchestra.console:Power on smithi042 2023-07-07T18:50:36.053 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-07T18:50:36.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T18:50:36.086 INFO:teuthology.orchestra.console:Power on smithi062 2023-07-07T18:50:36.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-07T18:50:36.109 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T18:50:40.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T18:50:40.132 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T18:50:40.342 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2023-07-07T18:50:40.443 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-07-07T18:50:40.443 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:50:44.215 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T18:50:44.425 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2023-07-07T18:50:44.527 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2023-07-07T18:50:44.527 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:50:55.555 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:50:59.652 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:51:10.815 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:51:14.865 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:51:26.017 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:51:30.069 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:51:41.223 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:51:45.275 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:51:56.424 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:52:00.471 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:52:11.636 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:52:15.695 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:52:26.858 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:52:30.958 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:52:42.150 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:52:46.210 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:52:57.485 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:53:01.517 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:53:12.798 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:53:16.826 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-07T18:53:17.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:53:28.030 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:53:35.472 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:53:41.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:53:43.353 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:53:44.560 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:53:50.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:53:53.648 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:53:58.711 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:53:59.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:54:02.704 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:54:08.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:54:11.792 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:54:14.124 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:54:17.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:54:20.848 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:54:26.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:54:29.508 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:54:29.936 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:54:35.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:54:38.992 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:54:44.902 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:54:44.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:54:48.048 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:54:54.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:54:57.104 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:55:00.267 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:55:03.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:55:06.160 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-07T18:55:12.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:55:15.567 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:55:30.859 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:55:46.368 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:56:01.796 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:56:12.176 WARNING:teuthology.provision.fog.smithi042:timed out 2023-07-07T18:56:17.208 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:56:18.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:56:18.505 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-07T18:56:18.506 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-07T18:56:18.849 INFO:teuthology.provision.fog.smithi042:Node is ready 2023-07-07T18:56:18.849 DEBUG:teuthology.orchestra.run.smithi042:> hostname 2023-07-07T18:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2023-07-07T18:56:18.867 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts 2023-07-07T18:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2023-07-07T18:56:18.926 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2023-07-07T18:56:19.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts 2023-07-07T18:56:19.083 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts 2023-07-07T18:56:19.152 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname 2023-07-07T18:56:19.222 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2023-07-07T18:56:19.289 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2023-07-07T18:56:19.346 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Red Hat Enterprise Linux" 2023-07-07T18:56:19.346 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8.6 (Ootpa)" 2023-07-07T18:56:19.347 INFO:teuthology.orchestra.run.smithi042.stdout:ID="rhel" 2023-07-07T18:56:19.347 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="fedora" 2023-07-07T18:56:19.347 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8.6" 2023-07-07T18:56:19.347 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2023-07-07T18:56:19.347 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-07T18:56:19.347 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2023-07-07T18:56:19.347 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-07T18:56:19.348 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.redhat.com/" 2023-07-07T18:56:19.348 INFO:teuthology.orchestra.run.smithi042.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-07T18:56:19.348 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-07T18:56:19.348 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-07T18:56:19.348 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-07T18:56:19.348 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-07T18:56:19.348 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-07T18:56:19.349 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-07T18:56:19.349 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2023-07-07T18:56:19.350 DEBUG:teuthology.parallel:result is None 2023-07-07T18:56:32.556 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:56:47.975 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:57:03.372 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-07T18:57:03.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:57:06.832 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-07T18:57:12.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:57:15.888 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-07T18:57:21.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:57:24.944 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-07T18:57:30.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:57:34.032 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-07T18:57:40.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:57:43.120 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-07T18:57:49.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:57:52.208 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-07T18:57:58.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:58:01.296 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-07T18:58:07.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:59:07.365 WARNING:teuthology.provision.fog.smithi062:timed out 2023-07-07T18:59:13.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:59:13.607 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-07T18:59:13.607 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-07T18:59:13.913 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-07-07T18:59:13.914 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-07-07T18:59:13.933 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062 2023-07-07T18:59:13.934 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062 /etc/hosts 2023-07-07T18:59:13.992 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-07-07T18:59:13.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-07T18:59:14.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062/smithi062/g' /etc/hosts 2023-07-07T18:59:14.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-07-07T18:59:14.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062/smithi062/g' /etc/hostname 2023-07-07T18:59:14.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-07T18:59:14.345 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-07T18:59:14.402 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2023-07-07T18:59:14.403 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2023-07-07T18:59:14.403 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2023-07-07T18:59:14.403 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2023-07-07T18:59:14.404 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2023-07-07T18:59:14.404 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-07-07T18:59:14.404 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-07T18:59:14.404 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-07T18:59:14.405 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-07T18:59:14.405 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2023-07-07T18:59:14.405 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-07T18:59:14.405 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-07T18:59:14.405 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-07-07T18:59:14.406 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-07T18:59:14.406 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-07T18:59:14.406 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-07T18:59:14.406 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-07T18:59:14.407 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-07-07T18:59:14.407 DEBUG:teuthology.parallel:result is None 2023-07-07T18:59:14.604 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2023-07-07T18:59:14.605 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-07T18:59:14.632 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-07-07T18:59:14.633 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-07T18:59:14.659 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2023-07-07T18:59:14.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-07-07T18:59:14.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:59:14.701 DEBUG:teuthology.orchestra.run.smithi042:> true 2023-07-07T18:59:14.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-07-07T18:59:14.845 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2023-07-07T18:59:14.903 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2023-07-07T18:59:14.903 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2023-07-07T18:59:14.964 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Red Hat Enterprise Linux" 2023-07-07T18:59:14.964 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8.6 (Ootpa)" 2023-07-07T18:59:14.965 INFO:teuthology.orchestra.run.smithi042.stdout:ID="rhel" 2023-07-07T18:59:14.965 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="fedora" 2023-07-07T18:59:14.965 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8.6" 2023-07-07T18:59:14.965 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2023-07-07T18:59:14.965 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-07T18:59:14.965 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2023-07-07T18:59:14.965 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-07T18:59:14.966 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.redhat.com/" 2023-07-07T18:59:14.966 INFO:teuthology.orchestra.run.smithi042.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-07T18:59:14.966 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-07T18:59:14.966 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-07T18:59:14.966 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-07T18:59:14.966 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-07T18:59:14.966 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-07T18:59:14.967 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-07T18:59:14.967 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-07-07T18:59:14.991 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-07-07T18:59:14.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-07T18:59:14.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:59:15.058 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-07-07T18:59:15.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-07T18:59:15.127 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-07-07T18:59:15.186 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-07-07T18:59:15.186 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-07T18:59:15.245 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2023-07-07T18:59:15.245 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2023-07-07T18:59:15.245 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2023-07-07T18:59:15.245 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2023-07-07T18:59:15.245 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2023-07-07T18:59:15.246 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-07-07T18:59:15.246 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-07T18:59:15.246 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-07T18:59:15.246 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-07T18:59:15.246 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2023-07-07T18:59:15.246 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-07T18:59:15.246 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-07T18:59:15.247 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-07-07T18:59:15.247 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-07T18:59:15.247 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-07T18:59:15.247 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-07T18:59:15.247 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-07T18:59:15.248 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-07T18:59:15.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T18:59:15.283 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T18:59:15.385 INFO:teuthology.dispatcher.supervisor:Running job 7328437 2023-07-07T18:59:15.386 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-07-07_18:49:32-rgw-wip-cbodley-testing-distro-default-smithi/7328437 --name cbodley-2023-07-07_18:49:32-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/sts/{cluster ignore-pg-availability objectstore overrides pool-type rgw_frontend/beast s3tests-branch supported-random-distro$/{rhel_8} tasks/{0-install 1-keycloak 2-s3tests}} -- /home/teuthworker/archive/cbodley-2023-07-07_18:49:32-rgw-wip-cbodley-testing-distro-default-smithi/7328437/orig.config.yaml 2023-07-07T18:59:15.390 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-07-07_18:49:32-rgw-wip-cbodley-testing-distro-default-smithi/7328437 2023-07-07T18:59:15.391 INFO:teuthology.dispatcher.supervisor:Job PID: 15890 2023-07-07T18:59:15.391 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-07T19:01:15.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:01:15.489 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:03:15.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:03:15.659 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:05:15.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:05:15.834 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:07:16.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:07:16.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:09:16.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:09:16.200 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:11:16.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:11:16.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:13:16.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:13:16.609 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:15:16.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:15:16.816 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:17:17.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:17:17.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:19:17.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:19:17.227 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:21:17.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:21:17.395 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:23:17.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:23:17.566 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:25:17.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:25:17.739 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:27:17.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:27:18.000 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:29:18.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:29:18.177 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:31:18.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:31:18.350 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:33:18.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:33:18.522 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:35:18.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:35:18.670 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:37:18.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:37:18.827 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:39:19.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:39:19.003 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:41:19.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:41:19.158 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:43:19.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:43:19.280 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:45:19.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T19:45:19.348 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-07T19:45:19.427 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-07T19:45:19.589 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-07T19:45:19.590 INFO:teuthology.nuke:Checking targets against current locks 2023-07-07T19:45:19.633 DEBUG:teuthology.nuke:shortname: smithi042 2023-07-07T19:45:19.633 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-07T19:45:19.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-07_18:49:32-rgw-wip-cbodley-testing-distro-default-smithi/7328437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-07 18:50:34.405436', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-07T19:45:19.662 DEBUG:teuthology.nuke:shortname: smithi062 2023-07-07T19:45:19.662 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-07T19:45:19.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-07_18:49:32-rgw-wip-cbodley-testing-distro-default-smithi/7328437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-07 18:50:34.404156', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-07T19:45:19.706 INFO:teuthology.orchestra.console:Power off smithi042 2023-07-07T19:45:19.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T19:45:19.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T19:45:19.749 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-07T19:45:19.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T19:45:19.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T19:45:19.858 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2023-07-07T19:45:19.890 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-07T19:45:20.014 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com 2023-07-07T19:45:20.039 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com