2023-09-05T10:54:27.355 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-05T10:54:27.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T10:54:27.490 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6b8085670>, signals=[15]) 2023-09-05T10:54:27.492 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-09-05T10:54:27.492 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-09-05T10:54:27.492 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-09-05T10:54:27.516 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-09-05T10:54:27.516 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-09-05T10:54:27.517 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-09-05T10:54:27.518 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-09-05T10:54:27.541 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"} 2023-09-05T10:54:27.591 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-05T10:54:27.597 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-05T10:54:27.642 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-05T10:54:27.642 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 6} 2023-09-05T10:54:27.644 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-05T10:54:27.644 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 6} 2023-09-05T10:54:27.702 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 22.04 2023-09-05T10:54:27.703 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:54:27.705 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 22.04 2023-09-05T10:54:27.706 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:54:27.850 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-09-05T10:54:27.876 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"} 2023-09-05T10:54:27.890 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-09-05T10:54:27.927 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1} 2023-09-05T10:54:27.941 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:54:27.986 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:54:28.156 INFO:teuthology.orchestra.console.smithi123:Power off 2023-09-05T10:54:28.157 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T10:54:28.177 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-09-05T10:54:28.177 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T10:54:28.197 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-09-05T10:54:28.203 INFO:teuthology.orchestra.console.smithi143:Power off 2023-09-05T10:54:28.204 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T10:54:28.228 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-09-05T10:54:28.228 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T10:54:28.249 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-05T10:54:28.299 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-09-05T10:54:28.350 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-09-05T10:54:28.400 INFO:teuthology.orchestra.console.smithi123:Power on 2023-09-05T10:54:28.400 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-05T10:54:28.420 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-09-05T10:54:28.420 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T10:54:28.440 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-09-05T10:54:28.451 INFO:teuthology.orchestra.console.smithi143:Power on 2023-09-05T10:54:28.452 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-05T10:54:28.470 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-09-05T10:54:28.471 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T10:54:28.491 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-05T10:54:32.442 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T10:54:32.493 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T10:54:32.551 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-09-05T10:54:32.601 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-05T10:54:32.652 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-09-05T10:54:32.753 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-09-05T10:54:32.753 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:54:36.606 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T10:54:36.715 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-09-05T10:54:36.816 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-09-05T10:54:36.916 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-09-05T10:54:36.917 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:54:47.964 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:54:52.229 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:55:03.231 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:55:07.491 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:55:18.501 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:55:22.729 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:55:33.738 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:55:37.974 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:55:48.976 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:55:53.257 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:56:04.274 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:56:08.518 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:56:19.598 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:56:23.856 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:56:42.868 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:56:47.434 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:57:01.471 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:57:10.084 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:57:16.934 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:57:28.638 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:57:35.542 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:57:44.222 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:57:57.498 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:57:59.906 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:58:18.251 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:58:19.995 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:58:33.954 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:58:39.622 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:58:49.640 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:58:58.158 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:59:05.234 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:59:14.043 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:59:20.751 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:59:29.356 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:59:36.253 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T10:59:44.727 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T10:59:51.880 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T11:00:00.060 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T11:00:08.666 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T11:00:15.414 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T11:00:24.390 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T11:00:30.726 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T11:00:39.910 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T11:00:46.046 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T11:00:55.196 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T11:01:01.302 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T11:01:10.534 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T11:01:16.546 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-09-05T11:01:16.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:01:19.802 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:01:25.746 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T11:01:25.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:01:28.858 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:01:34.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:01:37.946 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:01:40.965 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-09-05T11:01:41.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:01:43.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:01:44.218 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:01:47.002 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:01:50.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:01:53.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:01:53.274 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:01:56.062 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:01:59.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:02.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:02.330 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:02:05.150 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:02:08.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:11.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:11.390 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:02:17.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:20.474 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:02:26.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:29.530 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:02:29.531 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:02:35.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:35.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:38.618 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:02:38.618 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:02:44.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:44.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:44.627 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:02:50.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:50.632 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:02:54.874 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:02:56.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:02:56.636 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:03:00.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:02.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:02.640 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:03:03.934 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:03:08.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:08.648 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-09-05T11:03:09.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:13.018 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:03:14.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:14.855 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-05T11:03:14.856 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-05T11:03:15.308 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-09-05T11:03:15.308 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-09-05T11:03:15.357 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-09-05T11:03:15.357 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-09-05T11:03:15.408 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-09-05T11:03:15.409 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-09-05T11:03:15.557 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-09-05T11:03:15.572 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-09-05T11:03:15.627 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-09-05T11:03:15.684 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-09-05T11:03:15.738 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-09-05T11:03:15.783 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-05T11:03:15.784 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2023-09-05T11:03:15.784 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04" 2023-09-05T11:03:15.784 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-05T11:03:15.784 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy 2023-09-05T11:03:15.784 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2023-09-05T11:03:15.785 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2023-09-05T11:03:15.785 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-05T11:03:15.785 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-05T11:03:15.785 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-05T11:03:15.785 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-05T11:03:15.786 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy 2023-09-05T11:03:15.786 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-09-05T11:03:15.788 DEBUG:teuthology.parallel:result is None 2023-09-05T11:03:19.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:19.025 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:03:25.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:25.032 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:03:31.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:31.040 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:03:37.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:37.049 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-09-05T11:03:43.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:43.330 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-05T11:03:43.331 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-05T11:03:43.746 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-09-05T11:03:43.747 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-09-05T11:03:43.795 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-09-05T11:03:43.796 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-09-05T11:03:43.841 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-09-05T11:03:43.842 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-09-05T11:03:43.985 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-09-05T11:03:43.999 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-09-05T11:03:44.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-09-05T11:03:44.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-09-05T11:03:44.169 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-09-05T11:03:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-05T11:03:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-09-05T11:03:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2023-09-05T11:03:44.218 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-05T11:03:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2023-09-05T11:03:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-09-05T11:03:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-09-05T11:03:44.219 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-05T11:03:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-05T11:03:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-05T11:03:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-05T11:03:44.220 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2023-09-05T11:03:44.221 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-09-05T11:03:44.221 DEBUG:teuthology.parallel:result is None 2023-09-05T11:03:44.401 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-09-05T11:03:44.402 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-05T11:03:44.427 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-09-05T11:03:44.428 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-05T11:03:44.445 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-09-05T11:03:44.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-09-05T11:03:44.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:44.528 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-09-05T11:03:44.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-09-05T11:03:44.618 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-09-05T11:03:44.669 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-09-05T11:03:44.670 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-09-05T11:03:44.724 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-05T11:03:44.724 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-09-05T11:03:44.725 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2023-09-05T11:03:44.725 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-05T11:03:44.725 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2023-09-05T11:03:44.725 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-09-05T11:03:44.725 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-09-05T11:03:44.726 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-05T11:03:44.726 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-05T11:03:44.726 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-05T11:03:44.726 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-05T11:03:44.727 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2023-09-05T11:03:44.727 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-09-05T11:03:44.753 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-09-05T11:03:44.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-09-05T11:03:44.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T11:03:44.829 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-09-05T11:03:45.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-09-05T11:03:45.046 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-09-05T11:03:45.094 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-09-05T11:03:45.095 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-09-05T11:03:45.138 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-05T11:03:45.139 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2023-09-05T11:03:45.139 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="22.04" 2023-09-05T11:03:45.139 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-05T11:03:45.139 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=jammy 2023-09-05T11:03:45.140 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2023-09-05T11:03:45.140 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2023-09-05T11:03:45.140 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-05T11:03:45.140 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-05T11:03:45.140 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-05T11:03:45.141 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-05T11:03:45.141 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=jammy 2023-09-05T11:03:45.141 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-09-05T11:03:45.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:03:45.251 INFO:teuthology.dispatcher.supervisor:Running job 7388189 2023-09-05T11:03:45.251 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388189 --name mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} -- /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388189/orig.config.yaml 2023-09-05T11:03:45.255 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388189 2023-09-05T11:03:45.255 INFO:teuthology.dispatcher.supervisor:Job PID: 2927222 2023-09-05T11:03:45.256 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-05T11:05:45.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:07:45.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:09:45.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:11:45.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:13:46.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:15:46.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:17:46.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:19:46.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:21:46.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:23:46.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:25:47.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:27:47.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:29:47.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:31:47.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:33:47.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:35:47.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:37:48.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:39:48.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:41:48.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:43:48.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:45:48.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:47:48.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:49:49.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:51:49.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:53:49.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:55:49.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:57:49.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T11:59:49.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:01:50.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:01:50.172 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-05T12:01:50.361 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-05T12:01:50.361 INFO:teuthology.nuke:Checking targets against current locks 2023-09-05T12:01:50.413 DEBUG:teuthology.nuke:shortname: smithi123 2023-09-05T12:01:50.414 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-05T12:01:50.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388189', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 10:54:26.574991', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBrr8O1dnNeFoZ+36p51X9Yo6pe+CbnMQtF35CADW4Mh'} 2023-09-05T12:01:50.446 DEBUG:teuthology.nuke:shortname: smithi143 2023-09-05T12:01:50.447 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-05T12:01:50.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388189', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 10:54:26.576415', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDDb1+tSIFSHONmRzMAREBsh6FFI2mE+1At9N4FyszwUiVdiUCAAckrzjdhuPBuyBgCfkf9yxedMGPsBDHAqNHA='} 2023-09-05T12:01:50.496 INFO:teuthology.orchestra.console.smithi123:Power off 2023-09-05T12:01:50.497 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T12:01:50.517 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-09-05T12:01:50.518 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:01:50.536 INFO:teuthology.orchestra.console.smithi143:Power off 2023-09-05T12:01:50.537 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T12:01:50.546 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-09-05T12:01:50.560 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-09-05T12:01:50.561 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:01:50.580 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-09-05T12:01:50.648 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-09-05T12:01:50.682 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-09-05T12:01:50.807 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-09-05T12:01:50.830 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com