2023-07-12T22:17:56.480 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-12T22:17:56.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T22:17:56.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T22:17:56.620 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb5eabecca0>, signals=[15]) 2023-07-12T22:17:56.621 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-07-12T22:17:56.622 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T22:17:56.622 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-12T22:17:56.643 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-07-12T22:17:56.644 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-07-12T22:17:56.644 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-07-12T22:17:56.646 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-07-12T22:17:56.668 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-07-12T22:17:56.721 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-12T22:17:56.746 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-12T22:17:56.756 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-12T22:17:56.757 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 2} 2023-07-12T22:17:56.795 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-12T22:17:56.796 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 2} 2023-07-12T22:17:56.800 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of ubuntu 20.04 2023-07-12T22:17:56.800 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:17:56.843 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of ubuntu 20.04 2023-07-12T22:17:56.844 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:17:56.862 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T22:17:56.897 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-07-12T22:17:56.917 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-07-12T22:17:56.948 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-07-12T22:17:56.951 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:17:57.000 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:17:57.050 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-12T22:17:57.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T22:17:57.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:17:57.100 INFO:teuthology.orchestra.console:Power off smithi164 2023-07-12T22:17:57.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T22:17:57.122 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:17:57.210 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-12T22:17:57.241 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-07-12T22:17:57.312 INFO:teuthology.orchestra.console:Power on smithi093 2023-07-12T22:17:57.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T22:17:57.333 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:17:57.342 INFO:teuthology.orchestra.console:Power on smithi164 2023-07-12T22:17:57.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-12T22:17:57.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:18:01.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:18:01.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:18:01.590 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2023-07-12T22:18:01.691 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-07-12T22:18:01.691 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:18:05.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:18:05.681 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2023-07-12T22:18:05.782 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-07-12T22:18:05.783 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:18:16.820 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:18:20.948 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:18:32.029 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:18:36.142 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:18:47.212 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:18:51.328 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:19:02.390 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:19:06.512 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:19:17.583 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:19:21.696 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:19:32.778 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:19:36.900 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:19:47.975 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:19:52.171 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:20:03.324 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:20:07.593 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:20:18.841 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:20:22.956 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:20:34.208 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:20:38.242 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:20:49.619 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:20:53.693 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:21:04.936 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:21:09.025 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:21:20.280 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:21:24.365 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:21:35.678 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:21:39.673 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:21:51.088 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:21:55.056 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:22:06.538 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:22:10.476 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:22:21.976 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:22:25.849 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:22:37.398 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:22:41.184 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:22:52.808 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:22:56.491 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:23:08.170 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:23:11.796 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:23:23.524 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:23:27.272 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:23:38.883 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:23:42.584 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:23:54.292 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:23:57.910 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:24:09.707 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:24:13.282 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:24:25.096 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:24:28.655 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:24:40.496 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:24:43.996 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:24:55.869 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:24:59.315 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:25:11.276 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:25:14.643 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:25:26.621 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:25:29.951 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:25:41.980 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:25:45.251 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:25:57.378 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:26:00.552 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:26:12.732 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:26:15.856 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:26:28.056 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:26:31.190 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:26:43.414 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:26:46.457 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:26:58.668 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:27:01.920 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:27:13.954 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:27:17.164 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:27:29.233 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:27:32.426 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:27:44.484 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:27:47.668 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:27:59.732 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:28:02.948 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:28:14.999 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:28:18.448 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:28:30.242 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:28:33.660 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:28:45.485 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:28:48.872 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:29:00.725 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:29:04.016 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:29:15.953 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:29:19.224 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:29:31.176 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:29:34.445 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:29:46.384 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:29:49.670 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:30:01.634 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:30:04.892 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:30:16.856 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:30:20.099 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:30:32.060 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:30:35.320 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:30:47.260 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:30:50.507 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:31:02.456 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:31:05.724 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:31:17.801 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:31:20.928 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-12T22:31:21.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:31:24.176 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-12T22:31:30.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:31:32.939 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:31:33.232 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-12T22:31:39.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:31:42.288 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-12T22:31:48.124 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:31:48.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:31:51.348 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-12T22:31:57.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:32:00.436 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-12T22:32:03.298 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:32:06.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:32:09.520 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-12T22:32:15.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:32:18.472 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:32:33.620 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:32:48.159 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T22:32:48.160 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T22:32:48.775 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:33:03.924 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:33:09.887 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-07-12T22:33:09.887 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-07-12T22:33:09.891 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2023-07-12T22:33:09.891 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts 2023-07-12T22:33:09.940 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-07-12T22:33:09.941 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-12T22:33:10.007 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts 2023-07-12T22:33:10.021 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-07-12T22:33:10.032 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname 2023-07-12T22:33:10.091 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-12T22:33:10.102 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Ubuntu" 2023-07-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi093.stdout:ID=ubuntu 2023-07-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE=debian 2023-07-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="20.04" 2023-07-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi093.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi093.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_CODENAME=focal 2023-07-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi093.stdout:UBUNTU_CODENAME=focal 2023-07-12T22:33:10.109 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-07-12T22:33:10.110 DEBUG:teuthology.parallel:result is None 2023-07-12T22:33:19.060 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-12T22:33:19.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:33:22.288 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-12T22:33:28.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:33:31.344 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-12T22:33:37.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:33:40.400 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-12T22:33:46.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:33:49.456 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-12T22:33:55.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:33:58.544 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-12T22:34:04.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:34:07.600 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-12T22:34:13.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:34:16.656 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-12T22:34:22.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:35:22.720 WARNING:teuthology.provision.fog.smithi164:timed out 2023-07-12T22:35:28.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:35:28.860 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-12T22:35:28.861 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-12T22:35:29.372 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-07-12T22:35:29.373 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-07-12T22:35:29.379 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2023-07-12T22:35:29.380 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2023-07-12T22:35:29.385 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-07-12T22:35:29.386 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-07-12T22:35:29.527 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2023-07-12T22:35:29.542 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-07-12T22:35:29.553 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2023-07-12T22:35:29.568 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-07-12T22:35:29.583 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-07-12T22:35:29.587 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2023-07-12T22:35:29.587 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-12T22:35:29.587 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2023-07-12T22:35:29.587 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2023-07-12T22:35:29.588 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-12T22:35:29.588 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="20.04" 2023-07-12T22:35:29.588 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-12T22:35:29.588 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-12T22:35:29.588 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-12T22:35:29.588 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-12T22:35:29.588 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=focal 2023-07-12T22:35:29.589 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=focal 2023-07-12T22:35:29.589 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2023-07-12T22:35:29.589 DEBUG:teuthology.parallel:result is None 2023-07-12T22:35:29.837 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-07-12T22:35:29.837 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T22:35:29.862 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2023-07-12T22:35:29.862 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-12T22:35:29.888 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-07-12T22:35:29.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-12T22:35:29.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:35:29.938 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-12T22:35:30.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-12T22:35:30.142 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-07-12T22:35:30.148 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-07-12T22:35:30.148 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-12T22:35:30.153 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Ubuntu" 2023-07-12T22:35:30.154 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-12T22:35:30.154 INFO:teuthology.orchestra.run.smithi093.stdout:ID=ubuntu 2023-07-12T22:35:30.154 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE=debian 2023-07-12T22:35:30.154 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-12T22:35:30.154 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="20.04" 2023-07-12T22:35:30.154 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-12T22:35:30.155 INFO:teuthology.orchestra.run.smithi093.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-12T22:35:30.155 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-12T22:35:30.155 INFO:teuthology.orchestra.run.smithi093.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-12T22:35:30.155 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_CODENAME=focal 2023-07-12T22:35:30.155 INFO:teuthology.orchestra.run.smithi093.stdout:UBUNTU_CODENAME=focal 2023-07-12T22:35:30.155 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-12T22:35:30.179 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2023-07-12T22:35:30.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-07-12T22:35:30.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-12T22:35:30.226 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-07-12T22:35:30.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-07-12T22:35:30.346 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-07-12T22:35:30.353 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-07-12T22:35:30.353 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-07-12T22:35:30.359 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2023-07-12T22:35:30.360 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-12T22:35:30.360 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2023-07-12T22:35:30.360 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2023-07-12T22:35:30.360 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-12T22:35:30.360 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="20.04" 2023-07-12T22:35:30.361 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-12T22:35:30.361 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-12T22:35:30.361 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-12T22:35:30.361 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-12T22:35:30.361 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=focal 2023-07-12T22:35:30.361 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=focal 2023-07-12T22:35:30.362 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-07-12T22:35:30.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T22:35:30.388 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T22:35:30.492 INFO:teuthology.dispatcher.supervisor:Running job 7335447 2023-07-12T22:35:30.492 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-07-12_22:16:14-krbd-main-wip-frame-segment-len-default-smithi/7335447 --name dis-2023-07-12_22:16:14-krbd-main-wip-frame-segment-len-default-smithi --description krbd/unmap/{ceph/ceph clusters/separate-client conf kernels/pre-single-major tasks/unmap} -- /home/teuthworker/archive/dis-2023-07-12_22:16:14-krbd-main-wip-frame-segment-len-default-smithi/7335447/orig.config.yaml 2023-07-12T22:35:30.495 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-07-12_22:16:14-krbd-main-wip-frame-segment-len-default-smithi/7335447 2023-07-12T22:35:30.496 INFO:teuthology.dispatcher.supervisor:Job PID: 23687 2023-07-12T22:35:30.496 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-12T22:37:30.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-12T22:37:30.598 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-12T22:37:30.672 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-12T22:37:30.766 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-12T22:37:30.766 INFO:teuthology.nuke:Checking targets against current locks 2023-07-12T22:37:30.825 DEBUG:teuthology.nuke:shortname: smithi093 2023-07-12T22:37:30.825 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T22:37:30.846 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-07-12_22:16:14-krbd-main-wip-frame-segment-len-default-smithi/7335447', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 22:17:55.715897', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-12T22:37:30.852 DEBUG:teuthology.nuke:shortname: smithi164 2023-07-12T22:37:30.852 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-12T22:37:30.876 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-07-12_22:16:14-krbd-main-wip-frame-segment-len-default-smithi/7335447', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 22:17:55.714114', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-12T22:37:30.895 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-12T22:37:30.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T22:37:30.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:37:30.936 INFO:teuthology.orchestra.console:Power off smithi164 2023-07-12T22:37:30.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-12T22:37:30.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-12T22:37:31.047 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-12T22:37:31.080 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-07-12T22:37:31.204 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-07-12T22:37:31.229 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com