2023-07-21T13:22:04.181 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T13:22:04.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:22:04.183 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:22:04.384 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcea17a38b0>, signals=[15]) 2023-07-21T13:22:04.387 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-07-21T13:22:04.387 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T13:22:04.387 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-07-21T13:22:04.409 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-21T13:22:04.410 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T13:22:04.410 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-21T13:22:04.411 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /host {"name": "smithi053"} 2023-07-21T13:22:04.434 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-07-21T13:22:04.435 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T13:22:04.435 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-07-21T13:22:04.436 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-21T13:22:04.460 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-07-21T13:22:04.491 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-21T13:22:04.514 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-21T13:22:04.527 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-21T13:22:04.530 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-21T13:22:04.531 DEBUG:teuthology.provision.fog.smithi053:FOG request: PUT /host/158 {"imageID": 5} 2023-07-21T13:22:04.554 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-21T13:22:04.554 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 5} 2023-07-21T13:22:04.571 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-21T13:22:04.571 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 5} 2023-07-21T13:22:04.574 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of rhel 8.6 2023-07-21T13:22:04.574 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:22:04.592 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of rhel 8.6 2023-07-21T13:22:04.592 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:22:04.610 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T13:22:04.612 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6 2023-07-21T13:22:04.612 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:22:04.630 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T13:22:04.643 DEBUG:teuthology.provision.fog.smithi053:FOG request: POST /host/158/task {"taskTypeID": 1} 2023-07-21T13:22:04.647 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T13:22:04.666 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-21T13:22:04.678 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-07-21T13:22:04.710 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:22:04.789 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:22:04.802 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:22:04.828 INFO:teuthology.orchestra.console:Power off smithi053 2023-07-21T13:22:04.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T13:22:04.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:04.872 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-21T13:22:04.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T13:22:04.886 INFO:teuthology.orchestra.console:Power off smithi161 2023-07-21T13:22:04.887 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T13:22:04.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:04.909 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:08.900 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:08.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:08.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:13.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:13.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:13.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:13.224 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2023-07-21T13:22:13.244 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-21T13:22:13.326 INFO:teuthology.orchestra.console:Power on smithi053 2023-07-21T13:22:13.326 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T13:22:13.345 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-21T13:22:13.346 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T13:22:13.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:13.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:17.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:17.368 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-07-21T13:22:17.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:17.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:17.470 INFO:teuthology.orchestra.console:Power on smithi161 2023-07-21T13:22:17.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T13:22:17.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:21.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:21.504 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:21.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T13:22:21.704 INFO:teuthology.orchestra.console:Power on for smithi053 completed 2023-07-21T13:22:21.715 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-21T13:22:21.727 INFO:teuthology.orchestra.console:Power on for smithi161 completed 2023-07-21T13:22:21.805 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-07-21T13:22:21.806 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:22:21.817 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-21T13:22:21.817 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:22:21.828 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-07-21T13:22:21.828 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:22:36.880 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:22:36.881 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:22:36.886 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:22:51.952 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:22:51.953 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:22:51.956 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:23:07.020 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:23:07.022 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:23:07.023 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:23:22.096 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:23:22.098 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:23:22.098 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:23:37.176 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:23:37.178 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:23:37.179 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:23:52.255 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:23:52.257 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:23:52.257 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:24:07.332 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:24:07.333 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:24:07.334 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:24:22.408 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:24:22.410 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:24:22.411 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:24:37.488 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-21T13:24:37.490 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:24:37.491 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:24:37.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:24:37.829 ERROR:teuthology.orchestra.connection:Error authenticating with smithi053.front.sepia.ceph.com: Authentication failed. 2023-07-21T13:24:37.831 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T13:24:37.832 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T13:24:37.833 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-21T13:24:52.549 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:24:52.554 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:25:07.607 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:25:07.610 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-07-21T13:25:07.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:10.740 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T13:25:16.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:19.796 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T13:25:22.673 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-21T13:25:22.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:25.776 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-21T13:25:25.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:28.852 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T13:25:31.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:34.832 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-21T13:25:34.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:37.904 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T13:25:40.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:43.888 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-21T13:25:43.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:46.960 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T13:25:49.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:52.944 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-21T13:25:52.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:25:56.016 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T13:25:58.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:26:02.004 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-21T13:26:02.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:26:05.072 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T13:26:08.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:26:11.056 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-21T13:26:11.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:26:17.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:26:20.116 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-21T13:26:26.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:26:37.431 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-21T13:26:37.433 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi053 2023-07-21T13:26:46.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-21T13:26:46.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:26:46.771 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-07-21T13:26:47.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-21T13:26:47.045 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T13:26:47.045 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T13:26:47.063 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-07-21T13:26:47.063 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-07-21T13:26:47.121 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-07-21T13:26:47.122 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-07-21T13:26:47.180 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-07-21T13:26:47.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-07-21T13:26:47.318 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-07-21T13:26:47.347 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-07-21T13:26:47.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-07-21T13:26:47.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-07-21T13:26:47.551 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-07-21T13:26:47.608 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T13:26:47.608 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T13:26:47.609 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-07-21T13:26:47.609 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-07-21T13:26:47.609 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.6" 2023-07-21T13:26:47.609 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-07-21T13:26:47.609 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T13:26:47.609 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-07-21T13:26:47.610 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T13:26:47.610 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T13:26:47.610 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T13:26:47.610 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T13:26:47.610 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-21T13:26:47.610 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T13:26:47.610 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T13:26:47.610 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T13:26:47.611 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T13:26:47.611 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-07-21T13:26:47.612 DEBUG:teuthology.parallel:result is None 2023-07-21T13:27:11.076 WARNING:teuthology.provision.fog.smithi161:timed out 2023-07-21T13:27:17.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:27:17.581 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T13:27:17.582 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T13:27:17.926 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-07-21T13:27:17.927 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-07-21T13:27:17.945 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-07-21T13:27:17.945 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-07-21T13:27:18.004 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-07-21T13:27:18.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-07-21T13:27:18.121 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-07-21T13:27:18.151 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-07-21T13:27:18.221 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-07-21T13:27:18.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-07-21T13:27:18.357 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-07-21T13:27:18.415 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T13:27:18.415 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T13:27:18.415 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-07-21T13:27:18.415 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-07-21T13:27:18.415 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-07-21T13:27:18.415 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-07-21T13:27:18.416 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T13:27:18.416 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-07-21T13:27:18.416 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T13:27:18.416 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T13:27:18.416 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T13:27:18.417 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T13:27:18.417 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T13:27:18.417 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T13:27:18.417 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T13:27:18.417 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T13:27:18.417 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T13:27:18.417 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-07-21T13:27:18.418 DEBUG:teuthology.parallel:result is None 2023-07-21T13:27:26.120 WARNING:teuthology.provision.fog.smithi149:timed out 2023-07-21T13:27:32.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:27:32.461 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T13:27:32.461 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T13:27:32.775 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-21T13:27:32.775 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-21T13:27:32.793 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-21T13:27:32.794 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-21T13:27:32.854 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-21T13:27:32.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-21T13:27:32.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-21T13:27:32.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-21T13:27:33.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-21T13:27:33.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-21T13:27:33.185 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet 2023-07-21T13:27:33.185 ERROR:paramiko.transport:Traceback (most recent call last): 2023-07-21T13:27:33.186 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run 2023-07-21T13:27:33.186 ERROR:paramiko.transport: ptype, m = self.packetizer.read_message() 2023-07-21T13:27:33.186 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message 2023-07-21T13:27:33.186 ERROR:paramiko.transport: header = self.read_all(self.__block_size_in, check_rekey=True) 2023-07-21T13:27:33.187 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all 2023-07-21T13:27:33.187 ERROR:paramiko.transport: x = self.__socket.recv(n) 2023-07-21T13:27:33.187 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 663, in recv 2023-07-21T13:27:33.188 ERROR:paramiko.transport: self._wait(self._read_event) 2023-07-21T13:27:33.188 ERROR:paramiko.transport: File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket 2023-07-21T13:27:33.188 ERROR:paramiko.transport: File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket 2023-07-21T13:27:33.188 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet 2023-07-21T13:27:33.189 ERROR:paramiko.transport: 2023-07-21T13:27:33.206 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-21T13:27:33.266 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T13:27:33.266 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T13:27:33.266 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-07-21T13:27:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-07-21T13:27:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-07-21T13:27:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-21T13:27:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T13:27:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-21T13:27:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T13:27:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T13:27:33.268 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T13:27:33.268 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T13:27:33.268 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-07-21T13:27:33.268 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T13:27:33.268 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T13:27:33.268 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T13:27:33.268 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T13:27:33.269 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-21T13:27:33.269 DEBUG:teuthology.parallel:result is None 2023-07-21T13:27:33.457 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-07-21T13:27:33.458 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T13:27:33.483 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-21T13:27:33.484 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T13:27:33.508 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-07-21T13:27:33.508 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T13:27:33.535 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-07-21T13:27:33.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-21T13:27:33.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:27:33.604 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-07-21T13:27:33.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-21T13:27:33.682 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-07-21T13:27:33.741 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-07-21T13:27:33.742 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-07-21T13:27:33.801 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T13:27:33.801 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T13:27:33.801 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-07-21T13:27:33.801 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-07-21T13:27:33.802 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.6" 2023-07-21T13:27:33.802 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-07-21T13:27:33.802 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T13:27:33.802 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-07-21T13:27:33.802 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T13:27:33.802 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T13:27:33.802 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T13:27:33.803 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T13:27:33.803 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-07-21T13:27:33.803 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T13:27:33.803 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T13:27:33.803 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T13:27:33.803 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T13:27:33.804 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-07-21T13:27:33.824 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-21T13:27:33.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-21T13:27:33.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:27:33.894 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-21T13:27:33.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-21T13:27:33.961 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-21T13:27:34.020 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-21T13:27:34.020 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-21T13:27:34.080 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T13:27:34.080 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T13:27:34.081 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-07-21T13:27:34.081 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-07-21T13:27:34.081 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-07-21T13:27:34.081 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-21T13:27:34.081 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T13:27:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-21T13:27:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T13:27:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T13:27:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T13:27:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T13:27:34.082 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-07-21T13:27:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T13:27:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T13:27:34.083 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T13:27:34.083 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T13:27:34.083 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-21T13:27:34.108 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-07-21T13:27:34.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-21T13:27:34.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T13:27:34.175 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-07-21T13:27:34.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-21T13:27:34.306 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-07-21T13:27:34.363 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-07-21T13:27:34.363 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-07-21T13:27:34.421 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T13:27:34.421 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T13:27:34.421 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-07-21T13:27:34.421 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-07-21T13:27:34.422 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-07-21T13:27:34.422 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-07-21T13:27:34.422 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T13:27:34.422 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-07-21T13:27:34.422 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T13:27:34.422 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T13:27:34.422 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T13:27:34.423 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T13:27:34.423 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T13:27:34.423 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T13:27:34.423 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T13:27:34.423 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T13:27:34.423 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T13:27:34.424 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-07-21T13:27:34.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:27:34.450 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:27:34.565 INFO:teuthology.dispatcher.supervisor:Running job 7346191 2023-07-21T13:27:34.565 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346191 --name yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346191/orig.config.yaml 2023-07-21T13:27:34.569 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346191 2023-07-21T13:27:34.570 INFO:teuthology.dispatcher.supervisor:Job PID: 22514 2023-07-21T13:27:34.570 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T13:29:34.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:29:34.669 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:31:34.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:31:34.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:33:35.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:33:35.034 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:35:35.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:35:35.209 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:37:35.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:37:35.382 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:39:35.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:39:35.558 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:41:35.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:41:35.633 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:43:35.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:43:35.803 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:45:35.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:45:35.977 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:47:36.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:47:36.147 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:49:36.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:49:36.322 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:51:36.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:51:36.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:53:36.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:53:36.671 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:55:36.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:55:36.842 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:57:37.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:57:37.017 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T13:59:37.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T13:59:37.191 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:01:37.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:01:37.365 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:03:37.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:03:37.546 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:05:37.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:05:37.704 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:07:37.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:07:37.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:09:38.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:09:38.050 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:11:38.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:11:38.221 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:13:38.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:13:38.393 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:15:38.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:15:38.579 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:17:38.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:17:38.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:19:48.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:19:48.925 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:21:54.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:21:54.106 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:23:59.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:23:59.290 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:26:04.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:26:04.472 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:28:14.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:28:14.644 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:30:14.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:30:14.806 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:32:19.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:32:19.977 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:34:25.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:34:25.153 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:36:29.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:36:29.780 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:38:34.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:38:34.957 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:40:40.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:40:40.138 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:42:45.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:42:45.311 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:44:50.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:44:50.479 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:46:55.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:46:55.645 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:49:00.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:49:00.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:51:05.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:51:05.998 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:53:09.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:53:09.675 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:55:13.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:55:13.209 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:57:18.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:57:18.381 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T14:59:23.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T14:59:23.549 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T15:01:23.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T15:01:23.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T15:01:26.816 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T15:01:42.104 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T15:01:42.104 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T15:01:48.605 DEBUG:teuthology.nuke:shortname: smithi053 2023-07-21T15:01:48.606 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T15:01:48.628 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-21T15:01:48.628 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T15:01:48.631 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346191', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 13:22:03.323233', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T15:01:48.645 DEBUG:teuthology.nuke:shortname: smithi161 2023-07-21T15:01:48.645 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T15:01:53.653 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346191', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 13:22:03.321593', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T15:02:08.694 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346191', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 13:22:03.324686', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T15:02:08.703 INFO:teuthology.orchestra.console:Power off smithi053 2023-07-21T15:02:08.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T15:02:13.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:18.760 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-21T15:02:18.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T15:02:18.801 INFO:teuthology.orchestra.console:Power off smithi161 2023-07-21T15:02:18.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T15:02:18.871 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2023-07-21T15:02:23.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:23.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:28.283 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2023-07-21T15:02:32.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:32.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:37.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:37.374 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:42.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:42.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:47.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:47.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:52.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:52.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:02:52.918 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-21T15:02:58.080 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2023-07-21T15:03:02.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:03:07.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:03:12.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:03:17.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:03:22.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T15:03:22.720 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-07-21T15:03:32.883 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com