2023-07-19T17:29:08.725 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T17:29:08.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:29:08.727 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:29:08.920 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7e43e2a8b0>, signals=[15]) 2023-07-19T17:29:08.922 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-07-19T17:29:08.922 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T17:29:08.923 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-07-19T17:29:08.946 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-07-19T17:29:08.946 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T17:29:08.947 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-19T17:29:08.948 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-07-19T17:29:08.971 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-07-19T17:29:08.971 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T17:29:08.972 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-07-19T17:29:08.973 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-07-19T17:29:08.998 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-07-19T17:29:09.025 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T17:29:09.053 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T17:29:09.065 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T17:29:09.065 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 5} 2023-07-19T17:29:09.069 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T17:29:09.095 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T17:29:09.095 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 5} 2023-07-19T17:29:09.116 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6 2023-07-19T17:29:09.117 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:29:09.119 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T17:29:09.119 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 5} 2023-07-19T17:29:09.138 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.6 2023-07-19T17:29:09.139 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:29:09.162 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6 2023-07-19T17:29:09.162 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:29:09.182 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T17:29:09.195 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T17:29:09.228 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-07-19T17:29:09.231 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T17:29:09.239 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-07-19T17:29:09.268 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-07-19T17:29:09.286 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:29:09.289 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:29:09.318 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:29:09.406 INFO:teuthology.orchestra.console:Power off smithi099 2023-07-19T17:29:09.407 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:29:09.422 INFO:teuthology.orchestra.console:Power off smithi142 2023-07-19T17:29:09.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:29:09.436 INFO:teuthology.orchestra.console:Power off smithi102 2023-07-19T17:29:09.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:29:09.445 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:09.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:09.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:09.574 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-07-19T17:29:09.577 INFO:teuthology.orchestra.console:Power off for smithi099 completed 2023-07-19T17:29:09.584 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-07-19T17:29:09.676 INFO:teuthology.orchestra.console:Power on smithi142 2023-07-19T17:29:09.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T17:29:09.687 INFO:teuthology.orchestra.console:Power on smithi099 2023-07-19T17:29:09.687 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T17:29:09.698 INFO:teuthology.orchestra.console:Power on smithi102 2023-07-19T17:29:09.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T17:29:09.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:09.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:09.729 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:13.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:13.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:13.762 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:17.860 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:17.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:17.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:29:18.071 INFO:teuthology.orchestra.console:Power on for smithi099 completed 2023-07-19T17:29:18.078 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2023-07-19T17:29:18.088 INFO:teuthology.orchestra.console:Power on for smithi102 completed 2023-07-19T17:29:18.172 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-07-19T17:29:18.173 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:29:18.179 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-07-19T17:29:18.180 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:29:18.189 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-07-19T17:29:18.189 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:29:33.260 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:29:33.265 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:29:33.267 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:29:48.346 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:29:48.349 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:29:48.352 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:30:03.417 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:30:03.419 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:30:03.420 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:30:18.484 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:30:18.485 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:30:18.486 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:30:33.552 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:30:33.553 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:30:33.554 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:30:48.616 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:30:48.617 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:30:48.618 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:31:03.688 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:31:03.690 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:31:03.691 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:31:18.768 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:31:18.770 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:31:18.772 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:31:33.844 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:31:33.846 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:31:33.849 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:31:48.912 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:31:48.913 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:31:48.915 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-19T17:31:48.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:31:52.048 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-19T17:31:58.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:01.104 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-19T17:32:03.973 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-07-19T17:32:03.976 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-19T17:32:04.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:04.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:07.088 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-19T17:32:07.089 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-19T17:32:07.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:10.164 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-19T17:32:13.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:13.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:16.144 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-19T17:32:16.145 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-19T17:32:16.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:19.216 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-19T17:32:22.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:22.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:25.200 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-19T17:32:25.201 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-19T17:32:25.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:28.272 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-19T17:32:31.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:31.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:34.256 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-19T17:32:34.257 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-19T17:32:34.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:37.328 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-19T17:32:40.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:40.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:43.312 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-07-19T17:32:43.316 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-19T17:32:43.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:46.384 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-19T17:32:49.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:49.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:52.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:32:52.400 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-19T17:32:58.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:33:49.368 WARNING:teuthology.provision.fog.smithi099:timed out 2023-07-19T17:33:52.395 WARNING:teuthology.provision.fog.smithi102:timed out 2023-07-19T17:33:55.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:33:55.737 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T17:33:55.738 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T17:33:56.016 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-07-19T17:33:56.016 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-07-19T17:33:56.034 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-07-19T17:33:56.035 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-07-19T17:33:56.093 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-07-19T17:33:56.094 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-07-19T17:33:56.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-07-19T17:33:56.243 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-07-19T17:33:56.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-07-19T17:33:56.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-07-19T17:33:56.446 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-07-19T17:33:56.502 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:33:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:33:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-07-19T17:33:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-07-19T17:33:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2023-07-19T17:33:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:33:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:33:56.503 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-07-19T17:33:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:33:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:33:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:33:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:33:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-07-19T17:33:56.504 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:33:56.505 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:33:56.505 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:33:56.505 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:33:56.505 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-07-19T17:33:56.507 DEBUG:teuthology.parallel:result is None 2023-07-19T17:33:58.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:33:58.406 WARNING:teuthology.provision.fog.smithi142:timed out 2023-07-19T17:33:58.644 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T17:33:58.644 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T17:33:58.967 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-07-19T17:33:58.967 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-07-19T17:33:58.985 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-07-19T17:33:58.985 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-07-19T17:33:59.046 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-07-19T17:33:59.047 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-19T17:33:59.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-07-19T17:33:59.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-07-19T17:33:59.270 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-07-19T17:33:59.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-19T17:33:59.410 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-19T17:33:59.470 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:33:59.471 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:33:59.471 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-07-19T17:33:59.471 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-07-19T17:33:59.471 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-07-19T17:33:59.471 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:33:59.471 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:33:59.472 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-07-19T17:33:59.472 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:33:59.472 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:33:59.472 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:33:59.472 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:33:59.472 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-19T17:33:59.472 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:33:59.473 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:33:59.473 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:33:59.473 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:33:59.473 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-07-19T17:33:59.473 DEBUG:teuthology.parallel:result is None 2023-07-19T17:34:04.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:34:04.777 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T17:34:04.777 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T17:34:05.096 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-07-19T17:34:05.097 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-07-19T17:34:05.114 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-07-19T17:34:05.114 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-07-19T17:34:05.176 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-07-19T17:34:05.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-07-19T17:34:05.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-07-19T17:34:05.336 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-07-19T17:34:05.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-07-19T17:34:05.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-07-19T17:34:05.545 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-07-19T17:34:05.604 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:34:05.605 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:34:05.605 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-07-19T17:34:05.605 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-07-19T17:34:05.605 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-07-19T17:34:05.605 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:34:05.605 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:34:05.606 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-07-19T17:34:05.606 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:34:05.606 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:34:05.606 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:34:05.606 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:34:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-07-19T17:34:05.606 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:34:05.606 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:34:05.607 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:34:05.607 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:34:05.607 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-07-19T17:34:05.608 DEBUG:teuthology.parallel:result is None 2023-07-19T17:34:05.823 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-07-19T17:34:05.823 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-07-19T17:34:05.824 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T17:34:05.847 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-07-19T17:34:05.849 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-07-19T17:34:05.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-07-19T17:34:05.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:34:05.916 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-07-19T17:34:05.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-07-19T17:34:05.984 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-07-19T17:34:06.043 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-07-19T17:34:06.043 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-07-19T17:34:06.101 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:34:06.101 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:34:06.102 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-07-19T17:34:06.102 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-07-19T17:34:06.102 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2023-07-19T17:34:06.102 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:34:06.102 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:34:06.102 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-07-19T17:34:06.102 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:34:06.103 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:34:06.103 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:34:06.103 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:34:06.103 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-07-19T17:34:06.103 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:34:06.103 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:34:06.103 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:34:06.104 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:34:06.104 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-07-19T17:34:06.131 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-07-19T17:34:06.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-19T17:34:06.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:34:06.196 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-07-19T17:34:06.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-19T17:34:06.271 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-07-19T17:34:06.328 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-07-19T17:34:06.329 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-19T17:34:06.387 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:34:06.387 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:34:06.387 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-07-19T17:34:06.387 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-07-19T17:34:06.387 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-07-19T17:34:06.387 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:34:06.388 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:34:06.388 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-07-19T17:34:06.388 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:34:06.388 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:34:06.388 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:34:06.388 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:34:06.388 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-07-19T17:34:06.389 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:34:06.389 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:34:06.389 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:34:06.389 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:34:06.389 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-19T17:34:06.414 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-07-19T17:34:06.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-07-19T17:34:06.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:34:06.482 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-07-19T17:34:06.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-07-19T17:34:06.552 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-07-19T17:34:06.609 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-07-19T17:34:06.609 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-07-19T17:34:06.665 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:34:06.666 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:34:06.666 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-07-19T17:34:06.666 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-07-19T17:34:06.666 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-07-19T17:34:06.666 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:34:06.666 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:34:06.667 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-07-19T17:34:06.667 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:34:06.667 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:34:06.667 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:34:06.667 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:34:06.667 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-07-19T17:34:06.667 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:34:06.668 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:34:06.668 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:34:06.668 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:34:06.668 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-07-19T17:34:06.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:34:06.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:34:06.810 INFO:teuthology.dispatcher.supervisor:Running job 7344166 2023-07-19T17:34:06.810 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344166 --name pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/distributed export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/iozone}} -- /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344166/orig.config.yaml 2023-07-19T17:34:06.814 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344166 2023-07-19T17:34:06.815 INFO:teuthology.dispatcher.supervisor:Job PID: 22242 2023-07-19T17:34:06.815 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-19T17:36:06.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:36:06.818 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:38:06.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:38:06.898 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:40:06.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:40:06.975 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:42:07.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:42:07.065 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:44:07.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:44:07.132 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:46:07.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:46:07.212 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:48:07.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:48:07.278 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:50:07.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:50:07.346 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:52:07.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:52:07.424 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:54:07.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:54:07.504 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:56:07.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:56:07.578 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:58:07.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:58:07.690 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T18:00:07.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T18:00:07.772 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T18:02:07.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T18:02:07.841 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T18:04:07.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T18:04:07.924 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T18:06:08.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T18:06:08.077 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T18:06:08.147 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-19T18:06:08.311 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-19T18:06:08.312 INFO:teuthology.nuke:Checking targets against current locks 2023-07-19T18:06:08.373 DEBUG:teuthology.nuke:shortname: smithi099 2023-07-19T18:06:08.374 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T18:06:08.405 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:29:07.826590', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T18:06:08.408 DEBUG:teuthology.nuke:shortname: smithi102 2023-07-19T18:06:08.409 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T18:06:08.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:29:07.823233', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T18:06:08.440 DEBUG:teuthology.nuke:shortname: smithi142 2023-07-19T18:06:08.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T18:06:08.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344166', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:29:07.825336', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T18:06:08.478 INFO:teuthology.orchestra.console:Power off smithi099 2023-07-19T18:06:08.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T18:06:08.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T18:06:08.527 INFO:teuthology.orchestra.console:Power off smithi102 2023-07-19T18:06:08.528 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T18:06:08.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T18:06:08.566 INFO:teuthology.orchestra.console:Power off smithi142 2023-07-19T18:06:08.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T18:06:08.590 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T18:06:08.638 INFO:teuthology.orchestra.console:Power off for smithi099 completed 2023-07-19T18:06:08.678 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-07-19T18:06:08.713 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-07-19T18:06:08.797 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-07-19T18:06:08.897 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-07-19T18:06:08.906 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com