2023-07-06T21:30:39.480 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T21:30:39.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:30:39.483 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:30:39.707 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa5f8d5c8b0>, signals=[15]) 2023-07-06T21:30:39.709 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-07-06T21:30:39.710 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T21:30:39.710 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-06T21:30:39.739 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-07-06T21:30:39.739 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T21:30:39.739 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-07-06T21:30:39.741 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-07-06T21:30:39.763 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-07-06T21:30:39.763 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T21:30:39.763 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-06T21:30:39.765 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-07-06T21:30:39.788 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-07-06T21:30:39.818 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T21:30:39.832 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T21:30:39.860 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T21:30:39.860 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 5} 2023-07-06T21:30:39.862 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T21:30:39.872 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T21:30:39.872 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 5} 2023-07-06T21:30:39.899 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T21:30:39.900 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5} 2023-07-06T21:30:39.902 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of rhel 8.6 2023-07-06T21:30:39.902 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:30:39.916 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of rhel 8.6 2023-07-06T21:30:39.917 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:30:39.940 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-07-06T21:30:39.940 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:30:39.954 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T21:30:39.974 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T21:30:39.986 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T21:30:39.990 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-07-06T21:30:40.015 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-07-06T21:30:40.032 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-07-06T21:30:40.138 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:30:40.168 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:30:40.171 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:30:40.245 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-06T21:30:40.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T21:30:40.264 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-06T21:30:40.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T21:30:40.280 INFO:teuthology.orchestra.console:Power off smithi164 2023-07-06T21:30:40.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T21:30:40.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:40.302 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:40.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:44.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:44.339 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:44.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:48.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:48.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:48.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:48.667 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-06T21:30:48.768 INFO:teuthology.orchestra.console:Power on smithi118 2023-07-06T21:30:48.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T21:30:48.790 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:52.560 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:52.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:52.772 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-06T21:30:52.791 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-07-06T21:30:52.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:52.874 INFO:teuthology.orchestra.console:Power on smithi169 2023-07-06T21:30:52.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T21:30:52.892 INFO:teuthology.orchestra.console:Power on smithi164 2023-07-06T21:30:52.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T21:30:52.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:52.915 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:56.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:56.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:56.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:30:57.140 INFO:teuthology.orchestra.console:Power on for smithi169 completed 2023-07-06T21:30:57.147 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-07-06T21:30:57.241 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-07-06T21:30:57.242 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:30:57.247 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-07-06T21:30:57.248 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:31:01.059 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T21:31:01.271 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2023-07-06T21:31:01.372 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-07-06T21:31:01.372 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:31:12.336 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:31:12.337 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:31:16.444 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:31:27.420 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:31:27.421 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:31:31.548 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:31:42.516 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:31:42.518 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:31:46.648 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:31:57.616 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:31:57.617 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:32:01.732 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:32:12.717 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:32:12.719 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:32:16.840 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:32:27.808 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:32:27.810 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:32:31.926 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:32:42.900 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:32:42.902 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:32:47.016 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:32:57.992 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:32:57.993 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:33:02.080 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:33:13.080 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:33:13.081 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:33:17.162 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:33:28.160 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:33:28.162 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:33:32.232 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:33:43.248 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:33:43.249 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:33:47.298 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-06T21:33:47.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:33:50.420 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-06T21:33:56.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:33:58.320 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-06T21:33:58.321 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-06T21:33:58.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:33:58.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:33:59.508 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-06T21:34:01.460 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-06T21:34:01.461 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:34:05.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:07.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:07.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:08.596 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-06T21:34:10.548 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:34:10.549 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-06T21:34:14.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:16.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:16.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:17.680 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-06T21:34:19.636 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:34:19.637 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-06T21:34:23.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:25.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:25.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:26.740 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-06T21:34:28.688 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:34:28.720 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-06T21:34:32.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:34.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:34.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:35.824 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-06T21:34:37.744 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:34:37.776 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-06T21:34:41.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:43.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:43.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:44.880 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-06T21:34:46.804 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:34:46.836 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-06T21:34:50.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:52.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:52.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:34:55.888 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:35:01.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:35:04.976 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:35:10.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:35:29.392 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:35:35.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:35:38.480 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-06T21:35:44.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:35:47.811 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T21:35:47.812 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T21:35:48.096 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-07-06T21:35:48.096 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-07-06T21:35:48.112 INFO:teuthology.orchestra.run.smithi118.stdout:smithi022 2023-07-06T21:35:48.113 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi022 /etc/hosts 2023-07-06T21:35:48.169 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-06T21:35:48.170 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-06T21:35:48.287 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi022/smithi118/g' /etc/hosts 2023-07-06T21:35:48.315 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.22/172.21.15.118/g' /etc/hosts 2023-07-06T21:35:48.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi022/smithi118/g' /etc/hostname 2023-07-06T21:35:48.446 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-06T21:35:48.512 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-06T21:35:48.568 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T21:35:48.568 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T21:35:48.568 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-07-06T21:35:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-07-06T21:35:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-07-06T21:35:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-07-06T21:35:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T21:35:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-07-06T21:35:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T21:35:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T21:35:48.569 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T21:35:48.570 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T21:35:48.570 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-06T21:35:48.570 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T21:35:48.570 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T21:35:48.570 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T21:35:48.570 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T21:35:48.571 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-07-06T21:35:48.573 DEBUG:teuthology.parallel:result is None 2023-07-06T21:35:50.888 WARNING:teuthology.provision.fog.smithi164:timed out 2023-07-06T21:35:52.840 WARNING:teuthology.provision.fog.smithi169:timed out 2023-07-06T21:35:56.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:35:57.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T21:35:57.231 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T21:35:57.518 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-07-06T21:35:57.518 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-07-06T21:35:57.535 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2023-07-06T21:35:57.536 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2023-07-06T21:35:57.593 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-07-06T21:35:57.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-07-06T21:35:57.700 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2023-07-06T21:35:57.728 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-07-06T21:35:57.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2023-07-06T21:35:57.862 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-07-06T21:35:57.928 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-07-06T21:35:57.984 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T21:35:57.984 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T21:35:57.984 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2023-07-06T21:35:57.985 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2023-07-06T21:35:57.985 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2023-07-06T21:35:57.985 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-07-06T21:35:57.985 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T21:35:57.985 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-07-06T21:35:57.985 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T21:35:57.985 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T21:35:57.986 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T21:35:57.986 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T21:35:57.986 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-07-06T21:35:57.986 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T21:35:57.986 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T21:35:57.986 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T21:35:57.986 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T21:35:57.987 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2023-07-06T21:35:57.987 DEBUG:teuthology.parallel:result is None 2023-07-06T21:35:58.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:35:59.182 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T21:35:59.182 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T21:35:59.468 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-07-06T21:35:59.469 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-07-06T21:35:59.486 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-07-06T21:35:59.486 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-07-06T21:35:59.543 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-07-06T21:35:59.543 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-06T21:35:59.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-07-06T21:35:59.698 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-07-06T21:35:59.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-07-06T21:35:59.832 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-06T21:35:59.899 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-06T21:35:59.955 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T21:35:59.956 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T21:35:59.956 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-07-06T21:35:59.956 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-07-06T21:35:59.956 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-07-06T21:35:59.957 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-07-06T21:35:59.957 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T21:35:59.957 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-07-06T21:35:59.957 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T21:35:59.957 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T21:35:59.957 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T21:35:59.957 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T21:35:59.958 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-07-06T21:35:59.958 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T21:35:59.958 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T21:35:59.958 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T21:35:59.958 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T21:35:59.958 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-07-06T21:35:59.959 DEBUG:teuthology.parallel:result is None 2023-07-06T21:36:00.144 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-07-06T21:36:00.145 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T21:36:00.170 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2023-07-06T21:36:00.170 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-07-06T21:36:00.172 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-07-06T21:36:00.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-06T21:36:00.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:36:00.238 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-07-06T21:36:00.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-06T21:36:00.374 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-07-06T21:36:00.430 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-07-06T21:36:00.431 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-06T21:36:00.488 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T21:36:00.488 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T21:36:00.488 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-07-06T21:36:00.489 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-07-06T21:36:00.489 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-07-06T21:36:00.489 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-07-06T21:36:00.489 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T21:36:00.489 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-07-06T21:36:00.489 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T21:36:00.489 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T21:36:00.490 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T21:36:00.490 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T21:36:00.490 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-06T21:36:00.490 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T21:36:00.490 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T21:36:00.490 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T21:36:00.490 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T21:36:00.491 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-06T21:36:00.511 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2023-07-06T21:36:00.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-07-06T21:36:00.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:36:00.577 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-07-06T21:36:00.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-07-06T21:36:00.647 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-07-06T21:36:00.705 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-07-06T21:36:00.706 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-07-06T21:36:00.763 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T21:36:00.764 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T21:36:00.764 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2023-07-06T21:36:00.764 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2023-07-06T21:36:00.764 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2023-07-06T21:36:00.764 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-07-06T21:36:00.765 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T21:36:00.765 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-07-06T21:36:00.765 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T21:36:00.765 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T21:36:00.765 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T21:36:00.765 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T21:36:00.765 INFO:teuthology.orchestra.run.smithi164.stdout: 2023-07-06T21:36:00.766 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T21:36:00.766 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T21:36:00.766 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T21:36:00.766 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T21:36:00.767 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-07-06T21:36:00.795 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-07-06T21:36:00.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-06T21:36:00.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T21:36:00.861 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-07-06T21:36:00.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-06T21:36:00.936 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-07-06T21:36:00.995 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-07-06T21:36:00.996 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-06T21:36:01.055 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T21:36:01.055 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T21:36:01.056 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel" 2023-07-06T21:36:01.056 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora" 2023-07-06T21:36:01.056 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6" 2023-07-06T21:36:01.056 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-07-06T21:36:01.056 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T21:36:01.056 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-07-06T21:36:01.056 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T21:36:01.057 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T21:36:01.057 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T21:36:01.057 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T21:36:01.057 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-07-06T21:36:01.057 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T21:36:01.057 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T21:36:01.057 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T21:36:01.057 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T21:36:01.058 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-06T21:36:01.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:36:01.078 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:36:01.173 INFO:teuthology.dispatcher.supervisor:Running job 7328255 2023-07-06T21:36:01.173 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328255 --name rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328255/orig.config.yaml 2023-07-06T21:36:01.177 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328255 2023-07-06T21:36:01.178 INFO:teuthology.dispatcher.supervisor:Job PID: 21982 2023-07-06T21:36:01.178 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-06T21:38:01.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:38:01.278 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:40:01.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:40:01.446 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:42:01.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:42:01.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:44:01.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:44:01.793 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:46:01.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:46:01.966 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:48:02.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:48:02.096 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:50:02.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:50:02.265 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:52:02.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:52:02.441 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:54:02.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:54:02.614 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:56:02.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:56:02.793 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T21:58:02.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T21:58:02.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:00:03.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:00:03.106 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:02:03.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:02:03.286 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:04:03.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:04:03.439 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:06:03.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:06:03.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:08:03.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:08:03.775 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:10:03.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:10:03.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:12:03.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:12:03.997 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:14:04.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:14:04.158 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:16:04.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:16:04.257 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:18:04.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:18:04.426 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:20:04.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:20:04.599 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:22:04.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T22:22:04.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T22:22:04.837 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-06T22:22:05.031 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-06T22:22:05.031 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T22:22:05.085 DEBUG:teuthology.nuke:shortname: smithi118 2023-07-06T22:22:05.085 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T22:22:05.107 DEBUG:teuthology.nuke:shortname: smithi164 2023-07-06T22:22:05.107 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T22:22:05.110 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 21:30:38.548721', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-06T22:22:05.128 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 21:30:38.546842', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T22:22:05.131 DEBUG:teuthology.nuke:shortname: smithi169 2023-07-06T22:22:05.132 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T22:22:05.163 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-06T22:22:05.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T22:22:05.171 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:46:43-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7328255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 21:30:38.550385', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T22:22:05.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:22:05.208 INFO:teuthology.orchestra.console:Power off smithi164 2023-07-06T22:22:05.208 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T22:22:05.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:22:05.244 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-06T22:22:05.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T22:22:05.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T22:22:05.318 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-06T22:22:05.354 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-07-06T22:22:05.384 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-06T22:22:05.478 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-07-06T22:22:05.502 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com 2023-07-06T22:22:05.528 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com