2023-07-10T23:28:47.954 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-10T23:28:47.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T23:28:47.956 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T23:28:48.162 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9accd07820>, signals=[15]) 2023-07-10T23:28:48.164 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-07-10T23:28:48.165 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-07-10T23:28:48.166 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-07-10T23:28:48.197 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-07-10T23:28:48.197 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-07-10T23:28:48.198 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-07-10T23:28:48.199 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-07-10T23:28:48.222 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-07-10T23:28:48.222 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-07-10T23:28:48.222 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-10T23:28:48.224 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-07-10T23:28:48.247 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-07-10T23:28:48.278 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-10T23:28:48.290 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-10T23:28:48.315 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-10T23:28:48.315 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 5} 2023-07-10T23:28:48.320 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-10T23:28:48.332 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-10T23:28:48.332 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 5} 2023-07-10T23:28:48.357 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-10T23:28:48.357 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 5} 2023-07-10T23:28:48.358 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.6 2023-07-10T23:28:48.358 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:28:48.366 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6 2023-07-10T23:28:48.366 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:28:48.403 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of rhel 8.6 2023-07-10T23:28:48.404 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:28:48.432 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-07-10T23:28:48.436 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-07-10T23:28:48.473 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-07-10T23:28:48.478 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-07-10T23:28:48.482 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-07-10T23:28:48.515 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-07-10T23:28:48.520 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:28:48.543 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:28:48.561 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:28:48.632 INFO:teuthology.orchestra.console:Power off smithi105 2023-07-10T23:28:48.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T23:28:48.650 INFO:teuthology.orchestra.console:Power off smithi107 2023-07-10T23:28:48.650 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T23:28:48.661 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:48.682 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-10T23:28:48.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T23:28:48.693 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:48.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:48.819 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2023-07-10T23:28:48.922 INFO:teuthology.orchestra.console:Power on smithi107 2023-07-10T23:28:48.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-10T23:28:48.949 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:52.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:52.731 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:52.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:53.187 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2023-07-10T23:28:53.288 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-07-10T23:28:53.288 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:28:56.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:56.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:57.035 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2023-07-10T23:28:57.051 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-10T23:28:57.137 INFO:teuthology.orchestra.console:Power on smithi105 2023-07-10T23:28:57.137 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-10T23:28:57.153 INFO:teuthology.orchestra.console:Power on smithi203 2023-07-10T23:28:57.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-10T23:28:57.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:28:57.178 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:29:01.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:29:01.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:29:05.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:29:05.318 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:29:05.524 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2023-07-10T23:29:05.598 INFO:teuthology.orchestra.console:Power on for smithi203 completed 2023-07-10T23:29:05.626 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-07-10T23:29:05.626 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:29:05.699 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-07-10T23:29:05.699 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:29:08.364 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:29:20.716 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:29:20.761 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:29:23.448 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:29:35.812 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:29:35.830 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:29:38.514 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:29:50.906 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:29:50.907 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:29:53.580 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:30:05.989 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:30:05.991 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:30:08.644 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:30:21.064 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:30:21.065 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:30:23.710 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:30:36.141 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:30:36.143 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:30:38.799 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:30:51.216 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:30:51.217 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:30:53.876 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:31:06.296 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:31:06.298 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:31:08.963 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:31:21.380 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:31:21.381 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:31:24.036 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:31:36.460 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-10T23:31:36.466 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:31:36.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:31:39.108 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-10T23:31:39.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:31:39.568 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-07-10T23:31:42.228 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-10T23:31:45.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:31:48.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:31:48.624 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-07-10T23:31:51.312 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-10T23:31:51.525 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-10T23:31:51.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:31:54.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:31:54.640 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-10T23:31:57.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:31:57.680 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-07-10T23:32:00.368 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-10T23:32:00.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:03.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:03.696 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-10T23:32:06.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:06.736 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-07-10T23:32:09.424 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-10T23:32:09.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:12.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:12.752 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-10T23:32:15.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:15.792 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-07-10T23:32:18.480 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-10T23:32:18.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:21.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:21.808 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-10T23:32:24.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:24.848 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-07-10T23:32:27.536 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-10T23:32:27.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:30.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:30.864 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-10T23:32:33.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:33.904 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-07-10T23:32:36.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:39.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:39.920 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-10T23:32:45.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:32:48.976 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-10T23:32:54.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:33:33.580 WARNING:teuthology.provision.fog.smithi107:timed out 2023-07-10T23:33:39.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:33:39.911 WARNING:teuthology.provision.fog.smithi105:timed out 2023-07-10T23:33:40.087 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T23:33:40.088 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T23:33:40.494 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-07-10T23:33:40.495 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-07-10T23:33:40.542 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107 2023-07-10T23:33:40.542 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107 /etc/hosts 2023-07-10T23:33:40.559 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-07-10T23:33:40.559 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-07-10T23:33:40.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107/smithi107/g' /etc/hosts 2023-07-10T23:33:40.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-07-10T23:33:40.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107/smithi107/g' /etc/hostname 2023-07-10T23:33:40.851 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-07-10T23:33:40.916 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-07-10T23:33:40.972 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T23:33:40.972 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T23:33:40.972 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-07-10T23:33:40.972 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-07-10T23:33:40.973 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-07-10T23:33:40.973 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:33:40.973 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T23:33:40.973 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-07-10T23:33:40.973 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T23:33:40.973 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T23:33:40.974 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T23:33:40.974 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:33:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-07-10T23:33:40.974 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:33:40.974 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T23:33:40.975 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T23:33:40.975 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T23:33:40.976 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-07-10T23:33:40.977 DEBUG:teuthology.parallel:result is None 2023-07-10T23:33:45.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:33:46.249 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T23:33:46.249 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T23:33:46.554 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-07-10T23:33:46.555 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-07-10T23:33:46.571 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105 2023-07-10T23:33:46.572 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105 /etc/hosts 2023-07-10T23:33:46.631 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-07-10T23:33:46.632 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-07-10T23:33:46.754 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105/smithi105/g' /etc/hosts 2023-07-10T23:33:46.781 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-07-10T23:33:46.851 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105/smithi105/g' /etc/hostname 2023-07-10T23:33:46.922 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-07-10T23:33:46.990 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-07-10T23:33:47.050 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T23:33:47.051 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T23:33:47.051 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel" 2023-07-10T23:33:47.051 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora" 2023-07-10T23:33:47.051 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6" 2023-07-10T23:33:47.051 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:33:47.051 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T23:33:47.051 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-07-10T23:33:47.052 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T23:33:47.052 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T23:33:47.052 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T23:33:47.052 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:33:47.052 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-07-10T23:33:47.052 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:33:47.052 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T23:33:47.053 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T23:33:47.053 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T23:33:47.053 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-07-10T23:33:47.053 DEBUG:teuthology.parallel:result is None 2023-07-10T23:33:54.987 WARNING:teuthology.provision.fog.smithi203:timed out 2023-07-10T23:34:00.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:34:01.319 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T23:34:01.320 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T23:34:01.595 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-07-10T23:34:01.595 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-07-10T23:34:01.612 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-07-10T23:34:01.613 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-07-10T23:34:01.668 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-07-10T23:34:01.669 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-10T23:34:01.785 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-07-10T23:34:01.814 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-07-10T23:34:01.879 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-07-10T23:34:01.943 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-07-10T23:34:02.007 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-10T23:34:02.061 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T23:34:02.061 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T23:34:02.061 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel" 2023-07-10T23:34:02.062 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora" 2023-07-10T23:34:02.062 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.6" 2023-07-10T23:34:02.062 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:34:02.062 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T23:34:02.062 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-10T23:34:02.062 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T23:34:02.062 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T23:34:02.063 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T23:34:02.063 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:34:02.063 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-07-10T23:34:02.063 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:34:02.063 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T23:34:02.063 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T23:34:02.064 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T23:34:02.064 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-07-10T23:34:02.064 DEBUG:teuthology.parallel:result is None 2023-07-10T23:34:02.252 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-07-10T23:34:02.253 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-10T23:34:02.280 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-07-10T23:34:02.280 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-10T23:34:02.305 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-07-10T23:34:02.307 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-07-10T23:34:02.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-07-10T23:34:02.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:34:02.375 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-07-10T23:34:02.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-07-10T23:34:02.507 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-07-10T23:34:02.569 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-07-10T23:34:02.569 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-07-10T23:34:02.626 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T23:34:02.626 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T23:34:02.627 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel" 2023-07-10T23:34:02.627 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora" 2023-07-10T23:34:02.627 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6" 2023-07-10T23:34:02.627 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:34:02.627 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T23:34:02.627 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-07-10T23:34:02.628 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T23:34:02.628 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T23:34:02.628 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T23:34:02.628 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:34:02.628 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-07-10T23:34:02.628 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:34:02.628 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T23:34:02.629 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T23:34:02.629 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T23:34:02.629 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-07-10T23:34:02.655 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-07-10T23:34:02.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-07-10T23:34:02.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:34:02.722 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-07-10T23:34:02.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-07-10T23:34:02.853 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-07-10T23:34:02.910 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-07-10T23:34:02.910 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-07-10T23:34:02.967 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T23:34:02.968 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T23:34:02.968 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-07-10T23:34:02.968 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-07-10T23:34:02.968 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-07-10T23:34:02.968 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:34:02.968 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T23:34:02.968 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-07-10T23:34:02.969 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T23:34:02.969 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T23:34:02.969 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T23:34:02.969 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:34:02.969 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-07-10T23:34:02.969 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:34:02.969 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T23:34:02.970 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T23:34:02.970 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T23:34:02.970 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-07-10T23:34:02.997 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-07-10T23:34:02.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-10T23:34:02.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T23:34:03.059 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-10T23:34:03.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-10T23:34:03.128 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-07-10T23:34:03.188 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-07-10T23:34:03.188 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-07-10T23:34:03.244 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux" 2023-07-10T23:34:03.245 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.6 (Ootpa)" 2023-07-10T23:34:03.245 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel" 2023-07-10T23:34:03.246 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora" 2023-07-10T23:34:03.246 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.6" 2023-07-10T23:34:03.246 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8" 2023-07-10T23:34:03.246 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-10T23:34:03.246 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-07-10T23:34:03.246 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-10T23:34:03.246 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/" 2023-07-10T23:34:03.247 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-10T23:34:03.247 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-10T23:34:03.247 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-07-10T23:34:03.248 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-10T23:34:03.248 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-10T23:34:03.249 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-10T23:34:03.249 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-10T23:34:03.250 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-10T23:34:03.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T23:34:03.272 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T23:34:03.372 INFO:teuthology.dispatcher.supervisor:Running job 7332858 2023-07-10T23:34:03.373 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332858 --name pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332858/orig.config.yaml 2023-07-10T23:34:03.376 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332858 2023-07-10T23:34:03.376 INFO:teuthology.dispatcher.supervisor:Job PID: 3708 2023-07-10T23:34:03.377 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-10T23:36:03.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T23:36:03.477 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T23:36:03.551 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-10T23:36:03.683 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-10T23:36:03.684 INFO:teuthology.nuke:Checking targets against current locks 2023-07-10T23:36:03.739 DEBUG:teuthology.nuke:shortname: smithi105 2023-07-10T23:36:03.740 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T23:36:03.761 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332858', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 23:28:47.070777', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-10T23:36:03.790 DEBUG:teuthology.nuke:shortname: smithi203 2023-07-10T23:36:03.790 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T23:36:03.803 DEBUG:teuthology.nuke:shortname: smithi107 2023-07-10T23:36:03.803 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T23:36:03.813 INFO:teuthology.orchestra.console:Power off smithi105 2023-07-10T23:36:03.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T23:36:03.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332858', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 23:28:47.073010', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-10T23:36:03.829 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332858', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 23:28:47.074781', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-10T23:36:03.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:36:03.885 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-10T23:36:03.886 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T23:36:03.899 INFO:teuthology.orchestra.console:Power off smithi107 2023-07-10T23:36:03.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T23:36:03.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:36:03.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T23:36:03.960 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2023-07-10T23:36:04.030 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-10T23:36:04.042 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2023-07-10T23:36:04.116 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2023-07-10T23:36:04.176 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com 2023-07-10T23:36:04.190 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com