2023-07-20T01:54:53.496 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T01:54:53.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T01:54:53.498 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T01:54:53.671 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f24e7fffa60>, signals=[15]) 2023-07-20T01:54:53.672 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-07-20T01:54:53.673 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T01:54:53.673 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-07-20T01:54:53.699 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2023-07-20T01:54:53.699 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T01:54:53.699 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-07-20T01:54:53.701 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /host {"name": "smithi027"} 2023-07-20T01:54:53.723 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2023-07-20T01:54:53.724 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T01:54:53.724 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-07-20T01:54:53.725 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"} 2023-07-20T01:54:53.749 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"} 2023-07-20T01:54:53.780 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T01:54:53.795 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T01:54:53.816 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T01:54:53.818 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T01:54:53.819 DEBUG:teuthology.provision.fog.smithi027:FOG request: PUT /host/132 {"imageID": 5} 2023-07-20T01:54:53.833 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T01:54:53.833 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 5} 2023-07-20T01:54:53.858 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.6 2023-07-20T01:54:53.858 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:54:53.861 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T01:54:53.861 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 5} 2023-07-20T01:54:53.875 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of rhel 8.6 2023-07-20T01:54:53.876 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:54:53.900 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of rhel 8.6 2023-07-20T01:54:53.901 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:54:53.919 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T01:54:53.934 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T01:54:53.951 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T01:54:53.953 DEBUG:teuthology.provision.fog.smithi027:FOG request: POST /host/132/task {"taskTypeID": 1} 2023-07-20T01:54:53.964 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1} 2023-07-20T01:54:53.989 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1} 2023-07-20T01:54:53.998 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:54:54.092 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:54:54.108 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:54:54.158 INFO:teuthology.orchestra.console:Power off smithi027 2023-07-20T01:54:54.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:54:54.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:54:54.210 INFO:teuthology.orchestra.console:Power off smithi120 2023-07-20T01:54:54.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:54:54.224 INFO:teuthology.orchestra.console:Power off smithi050 2023-07-20T01:54:54.225 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:54:54.234 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:54:54.247 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:54:54.373 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2023-07-20T01:54:54.474 INFO:teuthology.orchestra.console:Power on smithi050 2023-07-20T01:54:54.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T01:54:54.495 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:54:58.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:54:58.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:54:58.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:02.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:02.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:02.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:02.841 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2023-07-20T01:55:02.942 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2023-07-20T01:55:02.942 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:55:06.468 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:06.482 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:06.680 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2023-07-20T01:55:06.692 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2023-07-20T01:55:06.782 INFO:teuthology.orchestra.console:Power on smithi027 2023-07-20T01:55:06.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T01:55:06.793 INFO:teuthology.orchestra.console:Power on smithi120 2023-07-20T01:55:06.793 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T01:55:06.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:06.815 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:10.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:10.838 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:11.050 INFO:teuthology.orchestra.console:Power on for smithi120 completed 2023-07-20T01:55:11.151 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2023-07-20T01:55:11.151 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:55:14.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:55:15.154 INFO:teuthology.orchestra.console:Power on for smithi027 completed 2023-07-20T01:55:15.255 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-07-20T01:55:15.256 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:55:18.020 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:55:26.248 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:55:30.336 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:55:33.092 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:55:41.324 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:55:45.404 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:55:48.172 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:55:56.404 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:56:00.477 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:56:03.260 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:56:11.500 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:56:15.562 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:56:18.344 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:56:26.603 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:56:30.652 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:56:33.427 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:56:41.684 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:56:45.745 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:56:48.504 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:56:56.761 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:57:00.832 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:57:03.599 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:57:11.836 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:57:15.904 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:57:18.684 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:57:26.912 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:57:30.978 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:57:33.772 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-20T01:57:33.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:57:36.912 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-20T01:57:41.992 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:57:42.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:57:45.968 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-20T01:57:46.063 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:57:51.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:57:55.024 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-20T01:57:57.080 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-07-20T01:57:57.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:00.208 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-20T01:58:01.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:01.151 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:58:04.080 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-20T01:58:06.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:09.264 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-20T01:58:10.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:13.136 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-20T01:58:15.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:16.248 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:58:18.320 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-20T01:58:19.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:22.192 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-20T01:58:24.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:27.376 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-20T01:58:28.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:31.336 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-07-20T01:58:31.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:33.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:34.480 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:58:36.436 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-20T01:58:40.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:42.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:43.536 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:58:45.524 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-07-20T01:58:49.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:51.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:58:52.592 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:58:58.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:01.648 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:59:07.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:10.704 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:59:16.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:19.760 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:59:25.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:28.196 WARNING:teuthology.provision.fog.smithi050:timed out 2023-07-20T01:59:28.848 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:59:34.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:34.538 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T01:59:34.539 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T01:59:34.810 INFO:teuthology.provision.fog.smithi050:Node is ready 2023-07-20T01:59:34.810 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2023-07-20T01:59:34.829 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2023-07-20T01:59:34.829 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2023-07-20T01:59:34.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:34.888 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2023-07-20T01:59:34.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-07-20T01:59:35.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2023-07-20T01:59:35.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2023-07-20T01:59:35.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2023-07-20T01:59:35.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-07-20T01:59:35.255 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-07-20T01:59:35.313 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T01:59:35.314 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T01:59:35.314 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2023-07-20T01:59:35.314 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2023-07-20T01:59:35.314 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6" 2023-07-20T01:59:35.314 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-07-20T01:59:35.314 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T01:59:35.315 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-07-20T01:59:35.315 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T01:59:35.315 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T01:59:35.315 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T01:59:35.315 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T01:59:35.315 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-07-20T01:59:35.315 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T01:59:35.315 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T01:59:35.316 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T01:59:35.316 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T01:59:35.316 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2023-07-20T01:59:35.318 DEBUG:teuthology.parallel:result is None 2023-07-20T01:59:37.904 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:59:43.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:46.960 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-07-20T01:59:51.534 WARNING:teuthology.provision.fog.smithi120:timed out 2023-07-20T01:59:52.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:57.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:59:57.764 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T01:59:57.764 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T01:59:58.050 INFO:teuthology.provision.fog.smithi120:Node is ready 2023-07-20T01:59:58.051 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2023-07-20T01:59:58.069 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2023-07-20T01:59:58.070 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2023-07-20T01:59:58.128 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2023-07-20T01:59:58.129 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-07-20T01:59:58.240 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2023-07-20T01:59:58.269 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2023-07-20T01:59:58.338 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2023-07-20T01:59:58.407 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-07-20T01:59:58.475 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-07-20T01:59:58.532 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T01:59:58.532 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T01:59:58.532 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2023-07-20T01:59:58.532 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2023-07-20T01:59:58.533 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6" 2023-07-20T01:59:58.533 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-07-20T01:59:58.533 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T01:59:58.533 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-07-20T01:59:58.534 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T01:59:58.534 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T01:59:58.534 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T01:59:58.534 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T01:59:58.534 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-07-20T01:59:58.534 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T01:59:58.535 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T01:59:58.535 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T01:59:58.535 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T01:59:58.535 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2023-07-20T01:59:58.536 DEBUG:teuthology.parallel:result is None 2023-07-20T02:00:53.016 WARNING:teuthology.provision.fog.smithi027:timed out 2023-07-20T02:00:59.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:00:59.352 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:00:59.353 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:00:59.664 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-07-20T02:00:59.665 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-07-20T02:00:59.683 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2023-07-20T02:00:59.684 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2023-07-20T02:00:59.743 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2023-07-20T02:00:59.744 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-07-20T02:00:59.854 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2023-07-20T02:00:59.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2023-07-20T02:00:59.954 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2023-07-20T02:01:00.024 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-07-20T02:01:00.092 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-07-20T02:01:00.150 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:01:00.150 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:01:00.151 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-07-20T02:01:00.151 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-07-20T02:01:00.151 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-07-20T02:01:00.151 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:01:00.151 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:01:00.151 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-07-20T02:01:00.151 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:01:00.152 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:01:00.152 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:01:00.152 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:01:00.152 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-20T02:01:00.152 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:01:00.152 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:01:00.152 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:01:00.153 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:01:00.153 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-07-20T02:01:00.153 DEBUG:teuthology.parallel:result is None 2023-07-20T02:01:00.381 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-07-20T02:01:00.382 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:01:00.405 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2023-07-20T02:01:00.406 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2023-07-20T02:01:00.406 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:01:00.432 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:01:00.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-07-20T02:01:00.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:01:00.531 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-07-20T02:01:00.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-07-20T02:01:00.599 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-07-20T02:01:00.658 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-07-20T02:01:00.658 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-07-20T02:01:00.716 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:01:00.717 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:01:00.717 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-07-20T02:01:00.717 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-07-20T02:01:00.717 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2023-07-20T02:01:00.717 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:01:00.718 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:01:00.718 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-07-20T02:01:00.718 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:01:00.718 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:01:00.718 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:01:00.718 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:01:00.718 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-07-20T02:01:00.719 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:01:00.719 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:01:00.719 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:01:00.719 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:01:00.720 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-07-20T02:01:00.755 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:01:00.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-20T02:01:00.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:01:00.825 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-07-20T02:01:00.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-20T02:01:00.959 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-07-20T02:01:01.017 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-07-20T02:01:01.017 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-07-20T02:01:01.074 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:01:01.075 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:01:01.075 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2023-07-20T02:01:01.075 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2023-07-20T02:01:01.075 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6" 2023-07-20T02:01:01.075 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:01:01.075 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:01:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-07-20T02:01:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:01:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:01:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:01:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:01:01.076 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-07-20T02:01:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:01:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:01:01.077 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:01:01.077 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:01:01.077 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-07-20T02:01:01.105 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:01:01.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-07-20T02:01:01.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:01:01.171 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-07-20T02:01:01.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-07-20T02:01:01.307 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-07-20T02:01:01.364 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-07-20T02:01:01.365 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-07-20T02:01:01.421 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:01:01.422 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:01:01.422 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2023-07-20T02:01:01.422 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2023-07-20T02:01:01.422 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6" 2023-07-20T02:01:01.422 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:01:01.423 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:01:01.423 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-07-20T02:01:01.423 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:01:01.423 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:01:01.423 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:01:01.423 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:01:01.423 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-07-20T02:01:01.424 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:01:01.424 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:01:01.424 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:01:01.424 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:01:01.425 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-07-20T02:01:01.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:01:01.447 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:01:01.550 INFO:teuthology.dispatcher.supervisor:Running job 7344280 2023-07-20T02:01:01.551 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344280 --name pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/direct_io}} -- /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344280/orig.config.yaml 2023-07-20T02:01:01.555 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344280 2023-07-20T02:01:01.556 INFO:teuthology.dispatcher.supervisor:Job PID: 26858 2023-07-20T02:01:01.556 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-20T02:03:01.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:03:01.658 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:05:01.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:05:01.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:07:02.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:07:02.022 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:09:02.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:09:02.199 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:11:02.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:11:02.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:13:02.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:13:02.545 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:15:02.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:15:02.718 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:17:02.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:17:02.882 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:19:03.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:19:03.049 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:21:03.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:21:03.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:23:03.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:23:03.401 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:25:03.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:25:03.573 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:27:03.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:27:03.743 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:29:03.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:29:03.918 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:31:04.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:31:04.100 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:33:04.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:33:04.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:35:04.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:35:04.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:37:04.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:37:04.605 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:39:04.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:39:04.780 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:41:04.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:41:04.959 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:43:05.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:43:05.133 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:45:05.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:45:05.303 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:47:05.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:47:05.478 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:49:05.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:49:05.653 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:49:05.722 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-20T02:49:05.906 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-20T02:49:05.907 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T02:49:05.965 DEBUG:teuthology.nuke:shortname: smithi027 2023-07-20T02:49:05.966 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T02:49:05.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 01:54:52.664946', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-20T02:49:06.012 DEBUG:teuthology.nuke:shortname: smithi120 2023-07-20T02:49:06.013 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T02:49:06.019 DEBUG:teuthology.nuke:shortname: smithi050 2023-07-20T02:49:06.020 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T02:49:06.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 01:54:52.666206', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-20T02:49:06.048 INFO:teuthology.orchestra.console:Power off smithi027 2023-07-20T02:49:06.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:49:06.058 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 01:54:52.663431', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-20T02:49:06.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:49:06.120 INFO:teuthology.orchestra.console:Power off smithi050 2023-07-20T02:49:06.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:49:06.134 INFO:teuthology.orchestra.console:Power off smithi120 2023-07-20T02:49:06.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:49:06.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:49:06.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:49:06.195 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2023-07-20T02:49:06.267 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2023-07-20T02:49:06.277 INFO:teuthology.orchestra.console:Power off for smithi120 completed 2023-07-20T02:49:06.354 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2023-07-20T02:49:06.421 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2023-07-20T02:49:06.429 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com