2023-07-15T08:41:14.029 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T08:41:14.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T08:41:14.031 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T08:41:14.187 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faa9306f8b0>, signals=[15]) 2023-07-15T08:41:14.188 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-07-15T08:41:14.189 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T08:41:14.189 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-15T08:41:14.209 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2023-07-15T08:41:14.209 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T08:41:14.210 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-07-15T08:41:14.211 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"} 2023-07-15T08:41:17.121 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /host {"name": "smithi177"} 2023-07-15T08:41:32.147 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-15T08:41:37.186 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-15T08:41:42.185 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3) 2023-07-15T08:41:42.186 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 3} 2023-07-15T08:41:42.225 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_8.stream (ID 3) 2023-07-15T08:41:42.226 DEBUG:teuthology.provision.fog.smithi177:FOG request: PUT /host/282 {"imageID": 3} 2023-07-15T08:41:42.248 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream 2023-07-15T08:41:42.248 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:41:42.283 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 8.stream 2023-07-15T08:41:42.284 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-15T08:41:42.297 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T08:41:42.337 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T08:41:42.341 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1} 2023-07-15T08:41:42.370 DEBUG:teuthology.provision.fog.smithi177:FOG request: POST /host/282/task {"taskTypeID": 1} 2023-07-15T08:41:42.404 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:41:42.421 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-15T08:41:52.495 INFO:teuthology.orchestra.console:Power off smithi177 2023-07-15T08:41:52.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T08:41:52.514 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-15T08:41:52.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T08:41:52.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:41:52.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:41:56.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:41:56.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:00.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:00.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:05.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:05.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:10.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:10.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:16.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:16.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:21.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:21.149 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:26.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:26.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:26.476 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-15T08:42:26.577 INFO:teuthology.orchestra.console:Power on smithi038 2023-07-15T08:42:26.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T08:42:26.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:30.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:30.844 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2023-07-15T08:42:30.945 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-07-15T08:42:30.945 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:42:31.365 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:36.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:41.589 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:42:46.012 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:42:56.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:01.132 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:06.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:11.104 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:43:16.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:17.220 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-07-15T08:43:17.221 ERROR:teuthology.orchestra.console:Failed to power off smithi177 2023-07-15T08:43:17.221 INFO:teuthology.orchestra.console:Power on smithi177 2023-07-15T08:43:17.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T08:43:22.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:27.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:31.184 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:43:36.193 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:41.305 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:46.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T08:43:47.141 INFO:teuthology.orchestra.console:Power on for smithi177 completed 2023-07-15T08:43:47.242 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2023-07-15T08:43:47.242 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-15T08:43:52.045 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:43:57.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:44:00.176 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-15T08:44:06.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:44:10.608 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-15T08:44:12.110 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:44:16.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:44:24.688 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-15T08:44:27.803 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:44:30.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:44:38.096 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-15T08:44:42.873 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:44:47.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:44:52.809 ERROR:teuthology.orchestra.connection:Error authenticating with smithi177.front.sepia.ceph.com: Authentication failed. 2023-07-15T08:44:52.810 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T08:44:52.811 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T08:44:52.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:44:53.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:44:54.821 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:44:55.826 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:44:56.832 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:44:57.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:44:58.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:44:59.849 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:00.855 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:01.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:02.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:03.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:04.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:05.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:06.892 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:07.747 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-15T08:45:07.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:45:07.897 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:08.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:09.909 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:10.868 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-15T08:45:10.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:11.921 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:12.927 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:13.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:14.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:15.945 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:16.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:45:16.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:17.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:18.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:19.956 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-15T08:45:19.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:20.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:21.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:22.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:23.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:25.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:25.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:45:26.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:27.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:28.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:29.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:29.044 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-15T08:45:30.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:31.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:32.048 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:33.054 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:34.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:35.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:45:40.050 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:41.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:42.060 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:43.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:43.120 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-15T08:45:44.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:45.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:46.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:47.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:48.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:49.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T08:45:49.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:46:54.130 WARNING:teuthology.provision.fog.smithi038:timed out 2023-07-15T08:47:00.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:47:05.375 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T08:47:05.376 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T08:47:05.612 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-07-15T08:47:05.612 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-07-15T08:47:05.634 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-07-15T08:47:05.635 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-07-15T08:47:05.695 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-07-15T08:47:05.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-15T08:47:05.791 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-07-15T08:47:05.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-07-15T08:47:05.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-07-15T08:47:05.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-15T08:47:06.037 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-15T08:47:06.097 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-07-15T08:47:06.097 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-07-15T08:47:06.098 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-07-15T08:47:06.098 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-07-15T08:47:06.098 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-07-15T08:47:06.098 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-15T08:47:06.098 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-15T08:47:06.098 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-15T08:47:06.098 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-15T08:47:06.099 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-07-15T08:47:06.099 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T08:47:06.099 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T08:47:06.099 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-15T08:47:06.102 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-07-15T08:47:06.103 DEBUG:teuthology.parallel:result is None 2023-07-15T08:47:41.172 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-15T08:47:41.173 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi177 2023-07-15T08:47:50.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-07-15T08:47:50.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T08:47:55.259 ERROR:teuthology.orchestra.connection:Error authenticating with smithi177.front.sepia.ceph.com: Authentication failed. 2023-07-15T08:47:55.259 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-07-15T08:47:55.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T09:48:04.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-07-15T09:48:04.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T09:48:09.438 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-07-15T09:48:09.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-07-15T09:48:09.509 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T09:48:09.509 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T09:48:09.568 INFO:teuthology.provision.fog.smithi177:Node is ready 2023-07-15T09:48:09.569 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2023-07-15T09:48:09.628 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177 2023-07-15T09:48:09.628 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177 /etc/hosts 2023-07-15T09:48:09.687 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177 smithi177 2023-07-15T09:48:09.687 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-07-15T09:48:09.757 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177/smithi177/g' /etc/hosts 2023-07-15T09:48:09.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2023-07-15T09:48:09.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177/smithi177/g' /etc/hostname 2023-07-15T09:48:09.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-07-15T09:48:10.029 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-07-15T09:48:10.088 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-07-15T09:48:10.089 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2023-07-15T09:48:10.089 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-07-15T09:48:10.089 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-07-15T09:48:10.089 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2023-07-15T09:48:10.089 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-07-15T09:48:10.090 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-15T09:48:10.090 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-07-15T09:48:10.090 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-15T09:48:10.090 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-07-15T09:48:10.090 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T09:48:10.090 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T09:48:10.091 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-15T09:48:10.091 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2023-07-15T09:48:10.091 DEBUG:teuthology.parallel:result is None 2023-07-15T09:48:10.283 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-07-15T09:48:10.284 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-15T09:48:10.313 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2023-07-15T09:48:10.313 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-15T09:48:10.339 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-07-15T09:48:10.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-15T09:48:10.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T09:48:10.408 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-07-15T09:48:10.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-15T09:48:10.549 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-07-15T09:48:10.609 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-07-15T09:48:10.609 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-15T09:48:10.670 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-07-15T09:48:10.670 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-07-15T09:48:10.671 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-07-15T09:48:10.671 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-07-15T09:48:10.671 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-07-15T09:48:10.671 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-15T09:48:10.671 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-15T09:48:10.672 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-15T09:48:10.672 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-15T09:48:10.672 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-07-15T09:48:10.672 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T09:48:10.673 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T09:48:10.673 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-15T09:48:10.674 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-15T09:48:10.696 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2023-07-15T09:48:10.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-07-15T09:48:10.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T09:48:10.762 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-07-15T09:48:10.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-07-15T09:48:10.831 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-07-15T09:48:10.889 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-07-15T09:48:10.890 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-07-15T09:48:10.948 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-07-15T09:48:10.948 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2023-07-15T09:48:10.948 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-07-15T09:48:10.948 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-07-15T09:48:10.948 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2023-07-15T09:48:10.949 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-07-15T09:48:10.949 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-15T09:48:10.949 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-07-15T09:48:10.949 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-15T09:48:10.949 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-07-15T09:48:10.949 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T09:48:10.949 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T09:48:10.949 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-15T09:48:10.950 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-07-15T09:48:10.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T09:48:10.980 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T09:48:11.089 INFO:teuthology.dispatcher.supervisor:Running job 7339843 2023-07-15T09:48:11.089 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-07-15_07:52:33-rbd-wip-dis-testing-distro-default-smithi/7339843 --name dis-2023-07-15_07:52:33-rbd-wip-dis-testing-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} -- /home/teuthworker/archive/dis-2023-07-15_07:52:33-rbd-wip-dis-testing-distro-default-smithi/7339843/orig.config.yaml 2023-07-15T09:48:11.094 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-07-15_07:52:33-rbd-wip-dis-testing-distro-default-smithi/7339843 2023-07-15T09:48:11.094 INFO:teuthology.dispatcher.supervisor:Job PID: 28468 2023-07-15T09:48:11.095 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-15T09:50:11.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T09:50:11.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T09:52:14.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T09:52:14.071 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T09:54:19.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T09:54:19.145 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T09:56:19.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T09:56:19.228 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T09:58:19.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T09:58:19.308 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:00:19.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:00:19.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:02:19.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:02:19.462 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:04:19.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:04:19.540 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:06:19.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:06:19.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:08:19.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:08:19.692 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:10:19.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:10:19.768 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:12:19.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:12:19.843 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:14:19.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:14:19.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:16:19.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:16:19.998 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:18:20.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:18:20.071 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:20:20.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:20:20.276 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:22:20.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:22:20.343 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:24:20.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:24:20.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:26:20.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:26:20.498 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:28:20.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:28:20.570 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:30:20.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:30:20.639 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:32:20.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:32:20.718 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:34:20.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:34:20.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:36:20.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:36:20.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:38:20.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:38:20.954 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:40:21.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:40:21.027 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:42:21.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:42:21.112 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:44:21.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:44:21.186 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:46:21.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:46:21.257 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:48:21.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:48:21.325 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:50:21.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:50:21.400 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:52:21.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:52:21.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:54:21.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:54:21.549 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:56:21.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T10:56:21.628 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T10:56:21.710 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-15T10:56:21.952 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi177 but it was locked by another job: /home/teuthworker/archive/dis-2023-07-15_07:52:33-rbd-wip-dis-testing-distro-default-smithi/7339949 2023-07-15T10:56:21.952 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-15T10:56:21.952 INFO:teuthology.nuke:Checking targets against current locks 2023-07-15T10:56:22.003 DEBUG:teuthology.nuke:shortname: smithi038 2023-07-15T10:56:22.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T10:56:22.033 DEBUG:teuthology.nuke:shortname: smithi177 2023-07-15T10:56:22.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T10:56:22.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-07-15_07:52:33-rbd-wip-dis-testing-distro-default-smithi/7339843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 08:41:07.701081', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1ByZ4n/GGvNcCNlXksb/qcn0puCbVTSRrdOi2hdo6ubyU71M/Bkc0HQxYO83EGdnnUEHjfsPHEAMCFq7TpZZSIrJXoGgOnc8hDKq6dCEDk9j8lhrPX2aeYSN8TwpBudaJ0m/SLa4qhWVJwKqW9M14StbLz7XgihuBQyOKiBee82+uo65PizfpiRHBC+X6uN1zwOZ7y0hgBrAxmPXH1fQwa4Q1HoJWZ0MbwJbAaizW74FF2zlPlF4aZo6iXmJFcmI3nn/kmkY9tdNyJUiDP/KIJGsRBdGQAoV22qQUGh0/actVIpSgefkWgfkiCLHnpQFNWHjTM/KQDuUeI2RvH3ROHCxCpLrv4xxZSdVfWj8WBGqGk5ARGCr893oh22LNvLkwONTt4oA32uo1HtUlZF0p8UFIF5vbGKugSO7IrL4EAcxceOSCx+A0NefJeEZk9yldh5sn4YA/jm5z/1PCs6/+lMyb5ael6yryUq6qHtTRX6iMxElPcieWVoaLPMA+4b8='} 2023-07-15T10:56:22.060 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-07-15_07:52:33-rbd-wip-dis-testing-distro-default-smithi/7339949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 10:23:27.037274', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-15T10:56:22.089 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-15T10:56:22.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T10:56:22.111 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T10:56:22.134 INFO:teuthology.orchestra.console:Power off smithi177 2023-07-15T10:56:22.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T10:56:22.158 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T10:56:22.245 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-15T10:56:22.279 INFO:teuthology.orchestra.console:Power off for smithi177 completed 2023-07-15T10:56:22.401 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2023-07-15T10:56:22.426 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com