2023-06-20T08:25:13.969 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T08:25:13.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:25:13.971 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:25:14.168 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc73121d5e0>, signals=[15]) 2023-06-20T08:25:14.170 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-06-20T08:25:14.171 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T08:25:14.172 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-06-20T08:25:14.199 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-06-20T08:25:14.200 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T08:25:14.200 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-06-20T08:25:14.203 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-06-20T08:25:14.232 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-06-20T08:25:14.232 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T08:25:14.232 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-06-20T08:25:14.233 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-06-20T08:25:14.257 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-06-20T08:25:14.278 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-20T08:25:14.306 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-20T08:25:14.315 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-20T08:25:14.315 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 5} 2023-06-20T08:25:14.331 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-20T08:25:14.351 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-20T08:25:14.351 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 5} 2023-06-20T08:25:14.364 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6 2023-06-20T08:25:14.364 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:25:14.378 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-20T08:25:14.378 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 5} 2023-06-20T08:25:14.396 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6 2023-06-20T08:25:14.396 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:25:14.415 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T08:25:14.425 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of rhel 8.6 2023-06-20T08:25:14.425 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:25:14.443 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T08:25:14.459 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-06-20T08:25:14.475 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-06-20T08:25:14.479 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T08:25:14.514 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:25:14.517 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-06-20T08:25:14.520 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:25:14.569 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:25:14.606 INFO:teuthology.orchestra.console:Power off smithi142 2023-06-20T08:25:14.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T08:25:14.624 INFO:teuthology.orchestra.console:Power off smithi057 2023-06-20T08:25:14.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T08:25:14.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:14.655 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:14.681 INFO:teuthology.orchestra.console:Power off smithi187 2023-06-20T08:25:14.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T08:25:14.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:18.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:18.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:18.726 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:22.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:22.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:22.837 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:23.014 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-06-20T08:25:23.048 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2023-06-20T08:25:23.116 INFO:teuthology.orchestra.console:Power on smithi057 2023-06-20T08:25:23.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T08:25:23.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:23.151 INFO:teuthology.orchestra.console:Power on smithi187 2023-06-20T08:25:23.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T08:25:23.179 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:26.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:27.115 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-06-20T08:25:27.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:27.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:27.216 INFO:teuthology.orchestra.console:Power on smithi142 2023-06-20T08:25:27.217 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T08:25:27.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:31.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:31.278 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:31.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:25:31.476 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2023-06-20T08:25:31.491 INFO:teuthology.orchestra.console:Power on for smithi057 completed 2023-06-20T08:25:31.535 INFO:teuthology.orchestra.console:Power on for smithi187 completed 2023-06-20T08:25:31.577 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-06-20T08:25:31.578 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:25:31.592 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-06-20T08:25:31.592 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:25:31.636 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-06-20T08:25:31.636 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:25:46.668 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:25:46.669 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:25:46.689 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:26:01.744 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:26:01.746 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:26:01.749 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:26:16.824 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:26:16.825 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:26:16.826 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:26:31.905 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:26:31.907 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:26:31.908 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:26:46.980 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:26:46.982 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:26:46.985 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:27:02.060 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:27:02.061 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:27:02.062 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:27:17.132 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:27:17.138 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:27:17.147 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:27:32.198 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:27:32.200 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:27:32.201 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:27:47.282 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:27:47.284 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:27:47.285 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:28:02.356 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:28:02.358 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:28:02.359 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:28:17.436 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-20T08:28:17.438 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-06-20T08:28:17.440 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-06-20T08:28:17.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:17.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:17.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:20.560 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-20T08:28:20.592 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-20T08:28:20.593 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-06-20T08:28:26.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:26.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:26.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:29.648 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-20T08:28:29.681 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-20T08:28:29.681 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-06-20T08:28:35.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:35.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:35.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:38.740 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-20T08:28:38.741 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-20T08:28:38.741 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-06-20T08:28:44.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:44.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:44.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:47.824 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-20T08:28:47.825 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-20T08:28:47.825 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-06-20T08:28:53.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:53.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:53.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:28:56.912 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-20T08:28:56.913 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-06-20T08:28:56.913 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-20T08:29:02.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:29:02.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:29:02.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:29:05.968 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-20T08:29:05.969 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-06-20T08:29:11.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:29:11.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:29:15.028 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-06-20T08:29:21.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:30:02.960 WARNING:teuthology.provision.fog.smithi187:timed out 2023-06-20T08:30:08.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:30:09.292 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T08:30:09.294 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T08:30:09.598 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-06-20T08:30:09.599 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-06-20T08:30:09.616 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-06-20T08:30:09.617 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-06-20T08:30:09.675 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-06-20T08:30:09.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-06-20T08:30:09.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-06-20T08:30:09.833 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-06-20T08:30:09.902 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-06-20T08:30:09.970 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-06-20T08:30:10.038 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-06-20T08:30:10.095 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T08:30:10.095 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T08:30:10.095 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-06-20T08:30:10.095 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-06-20T08:30:10.096 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-06-20T08:30:10.096 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-06-20T08:30:10.096 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T08:30:10.096 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-06-20T08:30:10.097 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T08:30:10.097 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T08:30:10.097 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T08:30:10.097 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T08:30:10.097 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-20T08:30:10.097 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T08:30:10.098 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T08:30:10.098 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T08:30:10.098 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T08:30:10.099 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-06-20T08:30:10.100 DEBUG:teuthology.parallel:result is None 2023-06-20T08:30:11.976 WARNING:teuthology.provision.fog.smithi142:timed out 2023-06-20T08:30:17.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:30:18.527 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T08:30:18.527 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T08:30:18.821 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-06-20T08:30:18.822 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-06-20T08:30:18.839 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-06-20T08:30:18.840 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-06-20T08:30:18.897 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-06-20T08:30:18.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-06-20T08:30:19.034 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-06-20T08:30:19.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-06-20T08:30:19.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-06-20T08:30:19.200 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-06-20T08:30:19.266 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-06-20T08:30:19.323 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T08:30:19.323 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T08:30:19.324 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-06-20T08:30:19.324 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-06-20T08:30:19.324 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-06-20T08:30:19.324 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-06-20T08:30:19.324 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T08:30:19.325 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-06-20T08:30:19.325 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T08:30:19.325 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T08:30:19.325 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T08:30:19.325 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T08:30:19.326 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-06-20T08:30:19.326 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T08:30:19.326 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T08:30:19.327 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T08:30:19.327 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T08:30:19.327 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-06-20T08:30:19.328 DEBUG:teuthology.parallel:result is None 2023-06-20T08:30:21.036 WARNING:teuthology.provision.fog.smithi057:timed out 2023-06-20T08:30:27.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:30:27.273 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T08:30:27.273 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T08:30:27.570 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-06-20T08:30:27.571 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-06-20T08:30:27.591 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-06-20T08:30:27.591 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-06-20T08:30:27.650 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-06-20T08:30:27.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-06-20T08:30:27.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-06-20T08:30:27.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-06-20T08:30:27.872 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-06-20T08:30:27.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-06-20T08:30:28.008 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-06-20T08:30:28.067 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T08:30:28.067 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T08:30:28.067 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-06-20T08:30:28.068 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-06-20T08:30:28.068 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-06-20T08:30:28.068 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-06-20T08:30:28.068 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T08:30:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-06-20T08:30:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T08:30:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T08:30:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T08:30:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T08:30:28.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-06-20T08:30:28.070 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T08:30:28.070 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T08:30:28.070 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T08:30:28.071 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T08:30:28.071 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-06-20T08:30:28.072 DEBUG:teuthology.parallel:result is None 2023-06-20T08:30:28.264 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-06-20T08:30:28.265 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T08:30:28.302 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-06-20T08:30:28.302 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T08:30:28.326 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-06-20T08:30:28.326 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T08:30:28.362 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-06-20T08:30:28.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-06-20T08:30:28.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:30:28.430 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-06-20T08:30:28.502 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-06-20T08:30:28.559 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-06-20T08:30:28.560 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-06-20T08:30:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T08:30:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T08:30:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-06-20T08:30:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-06-20T08:30:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-06-20T08:30:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-06-20T08:30:28.618 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T08:30:28.618 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-06-20T08:30:28.618 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T08:30:28.618 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T08:30:28.618 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T08:30:28.618 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T08:30:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-06-20T08:30:28.619 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T08:30:28.619 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T08:30:28.619 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T08:30:28.619 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T08:30:28.620 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-06-20T08:30:28.643 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-06-20T08:30:28.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-06-20T08:30:28.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:30:28.710 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-06-20T08:30:28.780 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-06-20T08:30:28.840 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-06-20T08:30:28.841 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-06-20T08:30:28.900 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T08:30:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T08:30:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-06-20T08:30:28.901 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-06-20T08:30:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-06-20T08:30:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-06-20T08:30:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T08:30:28.902 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-06-20T08:30:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T08:30:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T08:30:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T08:30:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T08:30:28.904 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-06-20T08:30:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T08:30:28.904 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T08:30:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T08:30:28.905 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T08:30:28.905 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-06-20T08:30:28.927 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-06-20T08:30:28.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-06-20T08:30:28.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T08:30:28.995 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-06-20T08:30:29.126 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-06-20T08:30:29.184 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-06-20T08:30:29.185 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-06-20T08:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T08:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T08:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-06-20T08:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-06-20T08:30:29.242 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-06-20T08:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-06-20T08:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T08:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-06-20T08:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T08:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T08:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T08:30:29.243 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T08:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-06-20T08:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T08:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T08:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T08:30:29.244 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T08:30:29.245 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-06-20T08:30:29.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:30:29.269 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:30:29.383 INFO:teuthology.dispatcher.supervisor:Running job 7307878 2023-06-20T08:30:29.384 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307878 --name rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307878/orig.config.yaml 2023-06-20T08:30:29.387 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307878 2023-06-20T08:30:29.388 INFO:teuthology.dispatcher.supervisor:Job PID: 32725 2023-06-20T08:30:29.388 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T08:32:29.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:32:29.490 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:34:29.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:34:29.678 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:36:29.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:36:29.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:38:30.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:38:30.034 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:40:30.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:40:30.218 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:42:30.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:42:30.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:44:30.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:44:30.574 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:46:30.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:46:30.750 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:48:30.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:48:30.933 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:50:31.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:50:31.126 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:52:31.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:52:31.302 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:54:31.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:54:31.473 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:56:31.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:56:31.651 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:58:31.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:58:31.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:00:32.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:00:32.037 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:02:32.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:02:32.217 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:04:32.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:04:32.395 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:06:32.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:06:32.563 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:08:32.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:08:32.744 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:10:32.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:10:32.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:12:33.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:12:33.106 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:14:33.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:14:33.303 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:16:33.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:16:33.478 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:18:33.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:18:33.649 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:20:33.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:20:33.818 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:22:33.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:22:33.984 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:24:34.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:24:34.142 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:26:34.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:26:34.314 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:28:34.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:28:34.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:30:34.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:30:34.671 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:32:34.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:32:34.851 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:32:34.932 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T09:32:35.161 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-20T09:32:35.161 INFO:teuthology.nuke:Checking targets against current locks 2023-06-20T09:32:35.211 DEBUG:teuthology.nuke:shortname: smithi057 2023-06-20T09:32:35.211 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T09:32:35.237 DEBUG:teuthology.nuke:shortname: smithi142 2023-06-20T09:32:35.237 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T09:32:35.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 08:25:13.051081', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-20T09:32:35.252 DEBUG:teuthology.nuke:shortname: smithi187 2023-06-20T09:32:35.253 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T09:32:35.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 08:25:13.047823', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-20T09:32:35.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 08:25:13.049831', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-20T09:32:35.285 INFO:teuthology.orchestra.console:Power off smithi057 2023-06-20T09:32:35.286 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T09:32:35.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T09:32:35.322 INFO:teuthology.orchestra.console:Power off smithi187 2023-06-20T09:32:35.323 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T09:32:35.338 INFO:teuthology.orchestra.console:Power off smithi142 2023-06-20T09:32:35.339 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T09:32:35.352 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T09:32:35.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T09:32:35.452 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2023-06-20T09:32:35.473 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2023-06-20T09:32:35.483 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-06-20T09:32:35.605 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-06-20T09:32:35.621 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com 2023-06-20T09:32:35.630 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com