2023-06-26T21:55:16.343 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-26T21:55:16.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:55:16.345 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:55:16.513 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f30eeacd8b0>, signals=[15]) 2023-06-26T21:55:16.515 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2023-06-26T21:55:16.515 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T21:55:16.516 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-06-26T21:55:16.542 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-06-26T21:55:16.543 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T21:55:16.543 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-06-26T21:55:16.544 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /host {"name": "smithi066"} 2023-06-26T21:55:19.095 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"} 2023-06-26T21:55:19.153 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-26T21:55:19.193 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-26T21:55:19.193 DEBUG:teuthology.provision.fog.smithi066:FOG request: PUT /host/171 {"imageID": 7} 2023-06-26T21:55:19.197 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-26T21:55:19.234 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-26T21:55:19.234 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 7} 2023-06-26T21:55:19.251 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of rhel 8.4 2023-06-26T21:55:19.252 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:55:19.282 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.4 2023-06-26T21:55:19.283 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:55:19.309 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T21:55:19.344 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T21:55:19.348 DEBUG:teuthology.provision.fog.smithi066:FOG request: POST /host/171/task {"taskTypeID": 1} 2023-06-26T21:55:19.396 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1} 2023-06-26T21:55:19.406 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:55:19.455 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:55:19.513 INFO:teuthology.orchestra.console:Power off smithi066 2023-06-26T21:55:19.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T21:55:19.541 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:19.570 INFO:teuthology.orchestra.console:Power off smithi110 2023-06-26T21:55:19.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T21:55:19.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:23.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:23.627 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:27.704 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:27.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:32.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:32.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:37.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:37.963 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:43.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:43.075 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:48.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:48.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:48.399 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-06-26T21:55:48.500 INFO:teuthology.orchestra.console:Power on smithi110 2023-06-26T21:55:48.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T21:55:48.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:52.556 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:53.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:53.483 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2023-06-26T21:55:53.584 INFO:teuthology.orchestra.console:Power on smithi066 2023-06-26T21:55:53.585 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T21:55:53.605 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:56.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:55:56.881 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2023-06-26T21:55:56.982 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-06-26T21:55:56.982 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:56:06.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:56:07.206 INFO:teuthology.orchestra.console:Power on for smithi066 completed 2023-06-26T21:56:07.307 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2023-06-26T21:56:07.307 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:56:22.074 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:56:22.364 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:56:37.156 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:56:42.163 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:57:02.244 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:57:02.245 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:57:25.572 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:57:25.573 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:57:40.664 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:57:40.665 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:57:59.768 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:57:59.770 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:58:24.845 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-06-26T21:58:24.847 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:58:33.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:58:41.520 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-26T21:58:47.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:58:53.455 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:58:58.461 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-26T21:59:04.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:59:07.540 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-26T21:59:13.520 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-06-26T21:59:18.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:59:18.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:59:21.588 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-06-26T21:59:21.648 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-06-26T21:59:27.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:59:32.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:59:40.660 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-06-26T21:59:46.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:59:54.740 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-06-26T22:00:00.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:00:03.824 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-06-26T22:00:09.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:00:17.904 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-06-26T22:00:23.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:00:31.988 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-06-26T22:00:32.596 WARNING:teuthology.provision.fog.smithi110:timed out 2023-06-26T22:00:37.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:00:39.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:00:39.388 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T22:00:39.389 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T22:00:39.653 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-06-26T22:00:39.653 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-06-26T22:00:39.668 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110 2023-06-26T22:00:39.668 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110 /etc/hosts 2023-06-26T22:00:39.726 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-06-26T22:00:39.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-06-26T22:00:39.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110/smithi110/g' /etc/hosts 2023-06-26T22:00:39.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-06-26T22:00:39.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110/smithi110/g' /etc/hostname 2023-06-26T22:00:39.999 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-06-26T22:00:40.067 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-06-26T22:00:40.124 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-06-26T22:00:40.124 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)" 2023-06-26T22:00:40.124 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-06-26T22:00:40.125 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-06-26T22:00:40.125 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4" 2023-06-26T22:00:40.125 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-06-26T22:00:40.126 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-26T22:00:40.126 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-06-26T22:00:40.126 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-26T22:00:40.126 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-06-26T22:00:40.127 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-26T22:00:40.127 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-26T22:00:40.127 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-06-26T22:00:40.127 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-26T22:00:40.127 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-26T22:00:40.127 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-26T22:00:40.127 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-26T22:00:40.128 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-06-26T22:00:40.130 DEBUG:teuthology.parallel:result is None 2023-06-26T22:00:57.456 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-06-26T22:01:03.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:01:11.536 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-06-26T22:01:17.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:01:17.885 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T22:01:17.886 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T22:01:38.171 INFO:teuthology.provision.fog.smithi066:Node is ready 2023-06-26T22:01:38.172 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2023-06-26T22:01:38.188 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2023-06-26T22:01:38.188 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2023-06-26T22:01:38.242 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2023-06-26T22:01:38.243 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-06-26T22:01:38.392 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2023-06-26T22:01:38.418 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2023-06-26T22:01:38.483 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2023-06-26T22:01:38.547 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-06-26T22:01:38.612 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-06-26T22:01:38.666 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux" 2023-06-26T22:01:38.666 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.4 (Ootpa)" 2023-06-26T22:01:38.666 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel" 2023-06-26T22:01:38.666 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora" 2023-06-26T22:01:38.666 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.4" 2023-06-26T22:01:38.667 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2023-06-26T22:01:38.667 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-26T22:01:38.667 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-06-26T22:01:38.667 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-26T22:01:38.667 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/" 2023-06-26T22:01:38.667 INFO:teuthology.orchestra.run.smithi066.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-26T22:01:38.667 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-26T22:01:38.668 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-06-26T22:01:38.668 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-26T22:01:38.668 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-26T22:01:38.668 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-26T22:01:38.668 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-26T22:01:38.668 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2023-06-26T22:01:38.669 DEBUG:teuthology.parallel:result is None 2023-06-26T22:01:49.243 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2023-06-26T22:01:49.244 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T22:01:49.780 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-06-26T22:01:49.780 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T22:01:49.798 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2023-06-26T22:01:49.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-06-26T22:01:49.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:01:49.867 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-06-26T22:01:49.995 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2023-06-26T22:01:50.051 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2023-06-26T22:01:50.051 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-06-26T22:01:50.106 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux" 2023-06-26T22:01:50.107 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.4 (Ootpa)" 2023-06-26T22:01:50.107 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel" 2023-06-26T22:01:50.107 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora" 2023-06-26T22:01:50.107 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.4" 2023-06-26T22:01:50.107 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2023-06-26T22:01:50.108 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-26T22:01:50.108 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-06-26T22:01:50.108 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-26T22:01:50.108 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/" 2023-06-26T22:01:50.108 INFO:teuthology.orchestra.run.smithi066.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-26T22:01:50.108 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-26T22:01:50.108 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-06-26T22:01:50.109 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-26T22:01:50.109 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-26T22:01:50.109 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-26T22:01:50.109 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-26T22:01:50.110 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-06-26T22:01:50.138 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-06-26T22:01:50.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-06-26T22:01:50.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T22:01:50.207 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-06-26T22:01:50.327 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-06-26T22:01:50.381 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-06-26T22:01:50.381 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-06-26T22:01:50.435 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-06-26T22:01:50.436 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.4 (Ootpa)" 2023-06-26T22:01:50.436 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-06-26T22:01:50.436 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-06-26T22:01:50.436 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.4" 2023-06-26T22:01:50.436 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-06-26T22:01:50.437 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-26T22:01:50.437 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-06-26T22:01:50.437 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-26T22:01:50.437 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-06-26T22:01:50.437 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-26T22:01:50.437 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-26T22:01:50.437 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-06-26T22:01:50.438 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-26T22:01:50.438 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-26T22:01:50.438 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-26T22:01:50.438 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-26T22:01:50.439 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-06-26T22:01:55.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:01:55.464 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:01:55.552 INFO:teuthology.dispatcher.supervisor:Running job 7316987 2023-06-26T22:01:55.553 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7316987 --name yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} -- /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7316987/orig.config.yaml 2023-06-26T22:01:55.557 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7316987 2023-06-26T22:01:55.557 INFO:teuthology.dispatcher.supervisor:Job PID: 27959 2023-06-26T22:01:55.558 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-26T22:03:55.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:03:55.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:06:00.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:06:00.830 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:08:06.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:08:06.009 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:10:11.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:10:11.187 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:12:16.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:12:16.370 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:14:21.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:14:21.544 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:16:26.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:16:26.706 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:18:31.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:18:31.882 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:20:35.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:20:35.498 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:22:40.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:22:40.682 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:24:45.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T22:24:45.863 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T22:24:50.934 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-26T22:24:54.600 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-26T22:24:54.600 INFO:teuthology.nuke:Checking targets against current locks 2023-06-26T22:24:54.642 DEBUG:teuthology.nuke:shortname: smithi066 2023-06-26T22:24:54.643 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T22:24:54.666 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7316987', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 21:55:15.458175', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCeRj6S4Ul6His6OhU0TxVgg3iHAGWHqJbuJg5Nh96IKikyZ0ZfwGAZ9WgII5J84tUe/a3ztGZZonXlvYn2Y1bvddikaiMSs9nWs6ZVVSEsLj5JMAv/WKWyik8Iug+m5aX0YNEwOXQVKBduNPdMfH8FxCv7z1l3UtIwytcIvdIDlke5Zr6MxCh5WdfZ2oDOCEOvBImE+cXZJZ64/LbICPfJX4FWaopGhNYjT3BKYck24EdEnWSTs0UROkvQxlZjK/xPrM524OHpUAbzjV9xzwk+6PJRnaCAmremPVc2fIRbuZ2McXa/vHnRbN3z4P3WujWR/HkqhB7B8CAJ5VCq15cEmlbCCh60nnbP5ovxrpL8iKob+UyO9IGGZbwKB2iP/3sFD7OOT2MojwDHiePzYcQaPo35z46FtINAs2+N3KxuW8ujVvgOExQBViRM7WfDdclI+hLrWXVItOHvA3A311fcVDvz0m4JJYZQxMAKAuBG5T3SqEVl0NqqHpz1RULsuUE='} 2023-06-26T22:24:54.671 DEBUG:teuthology.nuke:shortname: smithi110 2023-06-26T22:24:54.672 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T22:24:54.697 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7316987', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 21:55:15.460275', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDyIbwu2Ds2hiBglg3gEzO8K7yENkoKnftFeSfDNTALxQe5FxTxmCEeYJqSOD0Ofw/i62IM7WHThV9HWZJIeb1kWuDlr1wRQkac/rKdcSLoav2TtlHthgloO29nquqay3XsvJnM72Y/1LDokh5X2ggdDExzEgPIiWqWvafFUSkFK64mq4EhrU13jSKzb9382lTLdhjVvjqoqhJyAXUspIYgQmRKZDKg62VAakNqxpv1eC2cp/zD0+Ytu9UPgRrOy896jNq33JgLCnO7WjVuc0rcdDBJGZBGnKC5v1I3mdlk3OhogrOM9IUPxuAg+gma48Zi16tv6vfty8YwKCz16qpnL/CDvuXqXcpIM0eOnxxdtlYxyxhzEkRUpw4JUVjtdGa18DQaRxTRzqgUBfvyBgdWkbwUhpnnhhStBqd0dQ2fXFWLr8YAe2gp6NR4MWWarqHiSK3eybQ2NJY4tvoppbEwJGyThV2KImPakrwNMtoGxCnUGVDw/doKKUNEKRroYI8='} 2023-06-26T22:24:54.724 INFO:teuthology.orchestra.console:Power off smithi066 2023-06-26T22:24:54.725 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T22:24:54.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T22:24:54.767 INFO:teuthology.orchestra.console:Power off smithi110 2023-06-26T22:24:54.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T22:24:54.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T22:24:54.879 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2023-06-26T22:24:54.911 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-06-26T22:24:55.041 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com 2023-06-26T22:24:55.061 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com