2023-07-19T16:26:49.034 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T16:26:49.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:26:49.036 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:26:49.236 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f75617468b0>, signals=[15]) 2023-07-19T16:26:49.238 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-07-19T16:26:49.238 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T16:26:49.238 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-19T16:26:49.264 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-07-19T16:26:49.265 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T16:26:49.265 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-07-19T16:26:49.268 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-07-19T16:26:49.297 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-07-19T16:26:49.297 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T16:26:49.297 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-07-19T16:26:49.298 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-07-19T16:26:49.321 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-07-19T16:26:49.347 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T16:26:49.371 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T16:26:49.384 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T16:26:49.384 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 5} 2023-07-19T16:26:49.391 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T16:26:49.406 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T16:26:49.407 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 5} 2023-07-19T16:26:49.438 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T16:26:49.439 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 5} 2023-07-19T16:26:49.441 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.6 2023-07-19T16:26:49.442 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:26:49.457 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of rhel 8.6 2023-07-19T16:26:49.457 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:26:49.488 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T16:26:49.491 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of rhel 8.6 2023-07-19T16:26:49.491 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:26:49.499 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T16:26:49.521 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-07-19T16:26:49.531 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-07-19T16:26:49.537 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T16:26:49.574 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:26:49.585 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-07-19T16:26:49.588 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:26:49.638 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:26:49.656 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-19T16:26:49.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T16:26:49.671 INFO:teuthology.orchestra.console:Power off smithi129 2023-07-19T16:26:49.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T16:26:49.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:49.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:49.729 INFO:teuthology.orchestra.console:Power off smithi164 2023-07-19T16:26:49.730 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T16:26:49.752 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:53.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:53.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:53.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:57.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:57.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:57.887 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:26:58.098 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-07-19T16:26:58.199 INFO:teuthology.orchestra.console:Power on smithi164 2023-07-19T16:26:58.199 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T16:26:58.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:01.940 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:01.949 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:02.152 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-19T16:27:02.160 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2023-07-19T16:27:02.247 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:02.257 INFO:teuthology.orchestra.console:Power on smithi083 2023-07-19T16:27:02.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T16:27:02.273 INFO:teuthology.orchestra.console:Power on smithi129 2023-07-19T16:27:02.274 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T16:27:02.288 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:02.299 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:06.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:06.321 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:06.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:06.524 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2023-07-19T16:27:06.594 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2023-07-19T16:27:06.626 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-07-19T16:27:06.626 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:27:06.695 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-07-19T16:27:06.696 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:27:10.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:27:10.646 INFO:teuthology.orchestra.console:Power on for smithi129 completed 2023-07-19T16:27:10.747 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-07-19T16:27:10.748 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:27:21.700 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:27:21.766 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:27:25.816 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:27:36.772 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:27:36.828 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:27:40.882 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:27:51.844 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:27:51.876 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:27:55.944 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:28:06.928 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:28:06.938 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:28:11.004 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:28:22.004 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:28:22.005 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:28:26.068 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:28:37.077 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:28:37.079 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:28:41.132 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:28:52.148 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:28:52.150 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:28:56.196 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:29:07.228 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:29:07.229 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:29:11.264 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:29:22.296 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:29:22.297 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:29:26.333 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:29:37.368 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:29:37.369 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:29:41.396 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:29:52.436 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-19T16:29:52.438 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-19T16:29:52.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:29:52.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:29:55.568 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-19T16:29:55.569 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-19T16:29:56.466 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-07-19T16:29:56.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:29:59.664 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-07-19T16:30:01.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:01.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:04.624 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-19T16:30:04.625 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-19T16:30:05.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:08.720 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-07-19T16:30:10.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:10.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:13.680 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-19T16:30:13.681 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-19T16:30:14.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:17.780 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-07-19T16:30:19.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:19.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:22.736 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-19T16:30:22.740 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-19T16:30:23.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:26.864 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-07-19T16:30:28.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:28.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:31.792 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-19T16:30:31.793 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-19T16:30:32.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:35.921 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-07-19T16:30:37.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:37.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:40.852 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-19T16:30:40.853 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-19T16:30:41.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:44.976 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-07-19T16:30:46.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:46.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:49.904 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-19T16:30:50.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:30:55.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:31:46.906 WARNING:teuthology.provision.fog.smithi083:timed out 2023-07-19T16:31:50.980 WARNING:teuthology.provision.fog.smithi129:timed out 2023-07-19T16:31:52.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:31:53.272 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T16:31:53.273 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T16:31:53.586 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-07-19T16:31:53.586 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-07-19T16:31:53.603 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-07-19T16:31:53.603 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2023-07-19T16:31:53.664 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-07-19T16:31:53.664 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-07-19T16:31:53.795 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2023-07-19T16:31:53.822 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-07-19T16:31:53.893 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2023-07-19T16:31:53.963 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-07-19T16:31:54.032 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-07-19T16:31:54.092 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:31:54.093 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:31:54.093 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-07-19T16:31:54.093 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-07-19T16:31:54.094 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-07-19T16:31:54.094 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:31:54.094 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:31:54.095 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-07-19T16:31:54.095 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:31:54.095 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:31:54.095 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:31:54.096 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:31:54.096 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-07-19T16:31:54.096 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:31:54.097 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:31:54.097 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:31:54.097 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:31:54.098 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-07-19T16:31:54.100 DEBUG:teuthology.parallel:result is None 2023-07-19T16:31:55.912 WARNING:teuthology.provision.fog.smithi164:timed out 2023-07-19T16:31:56.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:31:57.318 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T16:31:57.318 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T16:31:57.628 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-07-19T16:31:57.628 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-07-19T16:31:57.646 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-07-19T16:31:57.647 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-07-19T16:31:57.707 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-07-19T16:31:57.708 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-07-19T16:31:57.827 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-07-19T16:31:57.856 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-07-19T16:31:57.926 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-07-19T16:31:57.997 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-07-19T16:31:58.066 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-07-19T16:31:58.125 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:31:58.126 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:31:58.126 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2023-07-19T16:31:58.126 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2023-07-19T16:31:58.127 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2023-07-19T16:31:58.127 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:31:58.127 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:31:58.127 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-07-19T16:31:58.127 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:31:58.127 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:31:58.127 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:31:58.128 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:31:58.128 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-07-19T16:31:58.128 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:31:58.128 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:31:58.128 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:31:58.128 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:31:58.129 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-07-19T16:31:58.129 DEBUG:teuthology.parallel:result is None 2023-07-19T16:32:01.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:32:02.254 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T16:32:02.255 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T16:32:02.533 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-07-19T16:32:02.534 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-07-19T16:32:02.550 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2023-07-19T16:32:02.551 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2023-07-19T16:32:02.608 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-07-19T16:32:02.608 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-07-19T16:32:02.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2023-07-19T16:32:02.742 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-07-19T16:32:02.810 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2023-07-19T16:32:02.877 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-07-19T16:32:02.943 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-07-19T16:32:02.999 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:32:02.999 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:32:03.000 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2023-07-19T16:32:03.000 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2023-07-19T16:32:03.000 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2023-07-19T16:32:03.000 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:32:03.000 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:32:03.000 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-07-19T16:32:03.000 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:32:03.001 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:32:03.001 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:32:03.001 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:32:03.001 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-07-19T16:32:03.001 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:32:03.001 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:32:03.001 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:32:03.002 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:32:03.002 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2023-07-19T16:32:03.002 DEBUG:teuthology.parallel:result is None 2023-07-19T16:32:03.195 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-07-19T16:32:03.196 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T16:32:03.225 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-07-19T16:32:03.225 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T16:32:03.249 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2023-07-19T16:32:03.250 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T16:32:03.268 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-07-19T16:32:03.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-19T16:32:03.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:32:03.337 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-07-19T16:32:03.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-19T16:32:03.408 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-07-19T16:32:03.467 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-07-19T16:32:03.467 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-07-19T16:32:03.525 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:32:03.526 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:32:03.526 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-07-19T16:32:03.526 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-07-19T16:32:03.526 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-07-19T16:32:03.526 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:32:03.527 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:32:03.527 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-07-19T16:32:03.527 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:32:03.527 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:32:03.527 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:32:03.527 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:32:03.527 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-07-19T16:32:03.527 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:32:03.528 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:32:03.528 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:32:03.528 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:32:03.528 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-19T16:32:03.550 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-07-19T16:32:03.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-07-19T16:32:03.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:32:03.616 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-07-19T16:32:03.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-07-19T16:32:03.688 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-07-19T16:32:03.747 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-07-19T16:32:03.747 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-07-19T16:32:03.806 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:32:03.806 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:32:03.806 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2023-07-19T16:32:03.806 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2023-07-19T16:32:03.806 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2023-07-19T16:32:03.807 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:32:03.807 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:32:03.807 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-07-19T16:32:03.807 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:32:03.807 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:32:03.807 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:32:03.807 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:32:03.807 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-07-19T16:32:03.808 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:32:03.808 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:32:03.808 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:32:03.808 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:32:03.809 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-07-19T16:32:03.833 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2023-07-19T16:32:03.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-07-19T16:32:03.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:32:03.899 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-07-19T16:32:03.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-07-19T16:32:03.966 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-07-19T16:32:04.023 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-07-19T16:32:04.023 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-07-19T16:32:04.080 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:32:04.080 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:32:04.081 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2023-07-19T16:32:04.081 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2023-07-19T16:32:04.081 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2023-07-19T16:32:04.081 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:32:04.081 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:32:04.081 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-07-19T16:32:04.082 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:32:04.082 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:32:04.082 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:32:04.082 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:32:04.082 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-07-19T16:32:04.082 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:32:04.082 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:32:04.083 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:32:04.083 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:32:04.083 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-07-19T16:32:04.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:32:04.109 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:32:04.215 INFO:teuthology.dispatcher.supervisor:Running job 7344103 2023-07-19T16:32:04.215 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344103 --name pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344103/orig.config.yaml 2023-07-19T16:32:04.220 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344103 2023-07-19T16:32:04.220 INFO:teuthology.dispatcher.supervisor:Job PID: 15155 2023-07-19T16:32:04.221 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-19T16:34:04.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:34:04.223 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:36:04.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:36:04.298 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:38:04.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:38:04.383 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:40:04.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:40:04.459 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:42:04.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:42:04.538 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:44:04.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:44:04.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:46:04.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:46:04.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:48:04.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:48:04.772 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:50:04.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:50:04.848 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:52:04.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:52:04.964 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:54:05.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:54:05.043 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:56:05.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:56:05.124 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:58:05.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:58:05.214 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:00:05.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:00:05.292 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:02:05.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:02:05.372 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:04:05.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:04:05.449 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:06:05.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:06:05.522 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:08:05.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:08:05.605 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:10:05.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:10:05.681 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:12:05.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:12:05.829 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:12:05.902 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-19T17:12:06.062 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-19T17:12:06.062 INFO:teuthology.nuke:Checking targets against current locks 2023-07-19T17:12:06.125 DEBUG:teuthology.nuke:shortname: smithi083 2023-07-19T17:12:06.125 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T17:12:06.144 DEBUG:teuthology.nuke:shortname: smithi129 2023-07-19T17:12:06.144 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T17:12:06.149 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 16:26:48.199980', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T17:12:06.166 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 16:26:48.203426', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T17:12:06.173 DEBUG:teuthology.nuke:shortname: smithi164 2023-07-19T17:12:06.173 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T17:12:06.201 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-19T17:12:06.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:12:06.218 INFO:teuthology.orchestra.console:Power off smithi129 2023-07-19T17:12:06.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:12:06.227 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 16:26:48.201939', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T17:12:06.230 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:12:06.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:12:06.287 INFO:teuthology.orchestra.console:Power off smithi164 2023-07-19T17:12:06.288 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:12:06.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:12:06.352 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-19T17:12:06.363 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2023-07-19T17:12:06.435 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-07-19T17:12:06.511 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-07-19T17:12:06.518 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com 2023-07-19T17:12:06.594 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com