2023-07-09T04:34:34.543 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T04:34:34.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:34:34.546 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:34:34.704 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcc7766fd30>, signals=[15]) 2023-07-09T04:34:34.706 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-07-09T04:34:34.706 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T04:34:34.707 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-09T04:34:34.730 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-07-09T04:34:34.731 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T04:34:34.731 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-09T04:34:34.732 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"} 2023-07-09T04:34:34.755 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-07-09T04:34:34.808 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-09T04:34:34.825 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-09T04:34:34.851 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-09T04:34:34.851 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 5} 2023-07-09T04:34:34.868 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-09T04:34:34.869 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5} 2023-07-09T04:34:34.920 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.6 2023-07-09T04:34:34.921 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:34:34.935 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-07-09T04:34:34.935 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:34:34.973 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T04:34:34.977 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T04:34:35.004 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1} 2023-07-09T04:34:35.016 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-07-09T04:34:35.052 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:34:35.062 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:34:35.145 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-09T04:34:35.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T04:34:35.165 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-09T04:34:35.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T04:34:35.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:35.191 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:39.204 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:39.213 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:43.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:43.325 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:43.528 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-09T04:34:43.536 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-09T04:34:43.630 INFO:teuthology.orchestra.console:Power on smithi169 2023-07-09T04:34:43.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T04:34:43.642 INFO:teuthology.orchestra.console:Power on smithi038 2023-07-09T04:34:43.643 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T04:34:43.655 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:43.666 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:47.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:47.693 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:51.796 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:51.805 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:52.008 INFO:teuthology.orchestra.console:Power on for smithi169 completed 2023-07-09T04:34:52.015 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2023-07-09T04:34:52.110 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-07-09T04:34:52.110 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:34:52.116 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-07-09T04:34:52.116 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:35:07.173 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:35:07.175 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:35:22.253 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:35:22.255 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:35:37.340 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:35:37.341 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:35:52.437 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:35:52.438 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:36:07.528 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:36:07.530 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:36:22.616 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:36:22.617 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:36:37.700 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:36:37.701 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:36:52.786 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:36:52.788 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:37:07.875 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:37:07.877 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:37:22.956 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-09T04:37:22.958 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:37:23.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:37:26.096 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-09T04:37:32.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:37:35.152 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-09T04:37:38.028 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-09T04:37:38.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:37:41.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:37:41.168 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:37:44.208 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-09T04:37:47.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:37:50.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:37:50.224 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:37:53.264 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-09T04:37:56.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:37:59.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:37:59.280 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:38:02.320 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-09T04:38:05.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:38:08.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:38:08.336 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:38:11.376 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-09T04:38:14.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:38:17.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:38:17.392 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:38:23.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:38:26.448 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:38:32.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:38:35.508 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:38:41.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:38:44.592 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:38:50.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:39:08.912 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:39:14.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:39:17.385 WARNING:teuthology.provision.fog.smithi038:timed out 2023-07-09T04:39:17.968 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-09T04:39:23.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:39:23.759 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T04:39:23.760 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T04:39:23.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:39:24.066 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-07-09T04:39:24.066 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-07-09T04:39:24.086 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-07-09T04:39:24.086 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-07-09T04:39:24.146 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-07-09T04:39:24.146 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-09T04:39:24.255 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-07-09T04:39:24.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-07-09T04:39:24.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-07-09T04:39:24.426 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-09T04:39:24.495 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-09T04:39:24.553 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T04:39:24.554 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T04:39:24.554 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-07-09T04:39:24.554 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-07-09T04:39:24.555 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2023-07-09T04:39:24.555 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-09T04:39:24.555 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T04:39:24.555 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-09T04:39:24.556 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T04:39:24.556 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T04:39:24.556 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T04:39:24.557 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T04:39:24.557 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-09T04:39:24.557 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T04:39:24.557 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T04:39:24.558 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T04:39:24.558 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T04:39:24.559 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-07-09T04:39:24.561 DEBUG:teuthology.parallel:result is None 2023-07-09T04:39:26.338 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T04:39:26.338 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T04:39:26.624 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-07-09T04:39:26.625 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-07-09T04:39:26.641 INFO:teuthology.orchestra.run.smithi169.stdout:smithi022 2023-07-09T04:39:26.641 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi022 /etc/hosts 2023-07-09T04:39:26.697 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-09T04:39:26.698 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-09T04:39:26.825 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi022/smithi169/g' /etc/hosts 2023-07-09T04:39:26.852 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.22/172.21.15.169/g' /etc/hosts 2023-07-09T04:39:26.918 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi022/smithi169/g' /etc/hostname 2023-07-09T04:39:26.985 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-09T04:39:27.051 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-09T04:39:27.108 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T04:39:27.108 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T04:39:27.108 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-07-09T04:39:27.109 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-07-09T04:39:27.109 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-07-09T04:39:27.109 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-07-09T04:39:27.109 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T04:39:27.109 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-07-09T04:39:27.109 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T04:39:27.110 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T04:39:27.110 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T04:39:27.110 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T04:39:27.110 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-07-09T04:39:27.110 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T04:39:27.110 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T04:39:27.110 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T04:39:27.111 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T04:39:27.111 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-07-09T04:39:27.111 DEBUG:teuthology.parallel:result is None 2023-07-09T04:39:27.287 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-07-09T04:39:27.288 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-07-09T04:39:27.290 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-07-09T04:39:27.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-09T04:39:27.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:39:27.358 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-07-09T04:39:27.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-09T04:39:27.428 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-07-09T04:39:27.486 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-07-09T04:39:27.487 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-09T04:39:27.545 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T04:39:27.545 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T04:39:27.545 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-07-09T04:39:27.546 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-07-09T04:39:27.546 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2023-07-09T04:39:27.546 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-09T04:39:27.546 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T04:39:27.546 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-09T04:39:27.546 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T04:39:27.546 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T04:39:27.547 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T04:39:27.547 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T04:39:27.547 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-07-09T04:39:27.547 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T04:39:27.547 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T04:39:27.547 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T04:39:27.547 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T04:39:27.548 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-09T04:39:27.570 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-07-09T04:39:27.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-09T04:39:27.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:39:27.635 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-07-09T04:39:27.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-09T04:39:27.716 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-07-09T04:39:27.773 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-07-09T04:39:27.773 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-09T04:39:27.829 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T04:39:27.829 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T04:39:27.830 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-07-09T04:39:27.830 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-07-09T04:39:27.830 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-07-09T04:39:27.830 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-07-09T04:39:27.830 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T04:39:27.831 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-07-09T04:39:27.831 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T04:39:27.831 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T04:39:27.831 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T04:39:27.831 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T04:39:27.831 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-07-09T04:39:27.831 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T04:39:27.831 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T04:39:27.832 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T04:39:27.832 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T04:39:27.833 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-09T04:39:27.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:39:27.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:39:27.973 INFO:teuthology.dispatcher.supervisor:Running job 7331396 2023-07-09T04:39:27.973 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331396 --name rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} -- /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331396/orig.config.yaml 2023-07-09T04:39:27.979 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331396 2023-07-09T04:39:27.980 INFO:teuthology.dispatcher.supervisor:Job PID: 16899 2023-07-09T04:39:27.980 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-09T04:41:28.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:41:28.081 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:43:28.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:43:28.270 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:45:28.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:45:28.449 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:47:28.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:47:28.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:49:28.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:49:28.806 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:51:28.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:51:28.986 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:53:29.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:53:29.153 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:55:29.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:55:29.330 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:57:29.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:57:29.502 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:59:29.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:59:29.687 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T05:01:29.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T05:01:29.858 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T05:03:30.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T05:03:30.034 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T05:05:30.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T05:05:30.205 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T05:07:30.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T05:07:30.396 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T05:09:30.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T05:09:30.574 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T05:09:30.640 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-09T05:09:30.823 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-09T05:09:30.823 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T05:09:30.881 DEBUG:teuthology.nuke:shortname: smithi038 2023-07-09T05:09:30.882 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T05:09:30.907 DEBUG:teuthology.nuke:shortname: smithi169 2023-07-09T05:09:30.907 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T05:09:30.910 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331396', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 04:34:33.708603', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T05:09:30.934 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331396', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 04:34:33.710018', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T05:09:30.967 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-09T05:09:30.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T05:09:30.988 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-09T05:09:30.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T05:09:30.999 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T05:09:31.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T05:09:31.122 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-09T05:09:31.129 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-09T05:09:31.272 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2023-07-09T05:09:31.289 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com