2023-08-30T22:20:43.265 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T22:20:43.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:20:43.413 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc4af653670>, signals=[15]) 2023-08-30T22:20:43.415 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2023-08-30T22:20:43.415 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:20:43.415 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-08-30T22:20:43.440 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-08-30T22:20:43.440 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:20:43.440 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-08-30T22:20:43.442 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /host {"name": "smithi162"} 2023-08-30T22:20:43.465 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"} 2023-08-30T22:20:43.531 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-30T22:20:43.535 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-30T22:20:43.578 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-30T22:20:43.578 DEBUG:teuthology.provision.fog.smithi162:FOG request: PUT /host/267 {"imageID": 6} 2023-08-30T22:20:43.630 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-30T22:20:43.631 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 6} 2023-08-30T22:20:43.714 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of ubuntu 22.04 2023-08-30T22:20:43.715 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:20:43.718 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of ubuntu 22.04 2023-08-30T22:20:43.718 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:20:44.002 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:20:44.009 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:20:44.041 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1} 2023-08-30T22:20:44.051 DEBUG:teuthology.provision.fog.smithi162:FOG request: POST /host/267/task {"taskTypeID": 1} 2023-08-30T22:20:44.092 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:20:44.103 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:20:44.385 INFO:teuthology.orchestra.console.smithi181:Power off 2023-08-30T22:20:44.386 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:20:44.407 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-08-30T22:20:44.407 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:20:44.423 INFO:teuthology.orchestra.console.smithi162:Power off 2023-08-30T22:20:44.423 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:20:44.432 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-08-30T22:20:44.446 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-08-30T22:20:44.446 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:20:44.468 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-30T22:20:44.534 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-08-30T22:20:44.569 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-08-30T22:20:44.635 INFO:teuthology.orchestra.console.smithi181:Power on 2023-08-30T22:20:44.636 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:20:44.656 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2023-08-30T22:20:44.657 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:20:44.671 INFO:teuthology.orchestra.console.smithi162:Power on 2023-08-30T22:20:44.671 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:20:44.680 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-08-30T22:20:44.691 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2023-08-30T22:20:44.692 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:20:44.712 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-30T22:20:48.683 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:20:48.713 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:20:48.791 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-08-30T22:20:48.821 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-08-30T22:20:48.893 INFO:teuthology.orchestra.console.smithi181:Power on completed 2023-08-30T22:20:48.923 INFO:teuthology.orchestra.console.smithi162:Power on completed 2023-08-30T22:20:48.994 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-08-30T22:20:48.995 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:20:49.023 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2023-08-30T22:20:49.024 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:21:04.226 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:21:04.255 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:21:19.438 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:21:19.471 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:21:34.654 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:21:34.700 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:21:49.872 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:21:49.918 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:22:05.134 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:22:05.175 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:22:20.406 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:22:20.425 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:22:35.723 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:22:35.751 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:22:51.354 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:22:51.357 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:23:07.255 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:23:07.269 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:23:23.058 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:23:23.232 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:23:38.350 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:23:38.565 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:23:53.761 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:23:53.926 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:24:09.161 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:24:09.177 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:24:24.480 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:24:24.481 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:24:39.854 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:24:39.857 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:24:55.178 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:24:55.179 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:25:10.482 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:25:10.484 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:25:25.747 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:25:25.749 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:25:41.068 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:25:41.069 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:25:56.308 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:25:56.309 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:26:11.578 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:26:11.579 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:26:26.815 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:26:26.817 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:26:42.026 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:26:42.027 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:26:57.263 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:26:57.264 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:27:12.468 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:27:12.469 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:27:27.666 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:27:27.668 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:27:42.845 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:27:42.847 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:27:58.034 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:27:58.035 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:28:13.194 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-30T22:28:13.196 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:28:13.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:28:16.378 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:28:22.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:28:25.438 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:28:28.330 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:28:31.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:28:34.526 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:28:40.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:28:43.445 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-30T22:28:43.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:28:43.614 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:28:46.618 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-30T22:28:49.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:28:52.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:28:52.702 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:28:55.674 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-30T22:28:58.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:01.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:01.790 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:29:04.730 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-30T22:29:07.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:10.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:10.874 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:29:13.786 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-30T22:29:16.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:19.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:22.846 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-30T22:29:28.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:31.930 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-30T22:29:35.262 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:29:37.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:41.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:44.346 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:29:50.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:50.352 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:29:56.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:29:56.360 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:30:02.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:30:02.368 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:30:08.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:30:08.376 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:30:14.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:30:14.384 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-30T22:30:20.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:30:20.685 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:30:20.686 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:30:21.116 INFO:teuthology.provision.fog.smithi162:Node is ready 2023-08-30T22:30:21.117 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2023-08-30T22:30:21.162 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2023-08-30T22:30:21.163 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2023-08-30T22:30:21.211 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2023-08-30T22:30:21.211 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-08-30T22:30:21.367 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2023-08-30T22:30:21.382 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2023-08-30T22:30:21.442 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2023-08-30T22:30:21.499 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-08-30T22:30:21.553 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-08-30T22:30:21.603 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T22:30:21.603 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2023-08-30T22:30:21.603 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2023-08-30T22:30:21.604 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T22:30:21.604 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2023-08-30T22:30:21.604 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2023-08-30T22:30:21.604 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2023-08-30T22:30:21.604 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T22:30:21.605 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T22:30:21.605 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T22:30:21.605 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T22:30:21.605 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2023-08-30T22:30:21.606 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2023-08-30T22:30:21.607 DEBUG:teuthology.parallel:result is None 2023-08-30T22:30:37.936 WARNING:teuthology.provision.fog.smithi181:timed out 2023-08-30T22:30:43.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:30:44.413 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:30:44.413 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:30:44.852 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-08-30T22:30:44.853 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2023-08-30T22:30:44.901 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2023-08-30T22:30:44.901 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts 2023-08-30T22:30:44.950 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-08-30T22:30:44.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-08-30T22:30:45.066 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts 2023-08-30T22:30:45.080 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2023-08-30T22:30:45.141 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname 2023-08-30T22:30:45.199 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-08-30T22:30:45.256 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-08-30T22:30:45.310 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T22:30:45.310 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu" 2023-08-30T22:30:45.311 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04" 2023-08-30T22:30:45.311 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T22:30:45.311 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy 2023-08-30T22:30:45.311 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu 2023-08-30T22:30:45.311 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian 2023-08-30T22:30:45.312 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T22:30:45.312 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T22:30:45.312 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T22:30:45.312 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T22:30:45.312 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy 2023-08-30T22:30:45.313 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-08-30T22:30:45.313 DEBUG:teuthology.parallel:result is None 2023-08-30T22:30:45.492 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2023-08-30T22:30:45.493 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:30:45.519 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-08-30T22:30:45.520 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:30:45.545 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:30:45.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-08-30T22:30:45.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:30:45.620 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-08-30T22:30:45.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-08-30T22:30:45.718 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2023-08-30T22:30:45.765 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2023-08-30T22:30:45.766 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-08-30T22:30:45.814 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T22:30:45.814 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2023-08-30T22:30:45.815 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2023-08-30T22:30:45.815 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T22:30:45.815 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2023-08-30T22:30:45.815 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2023-08-30T22:30:45.815 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2023-08-30T22:30:45.816 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T22:30:45.816 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T22:30:45.816 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T22:30:45.816 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T22:30:45.816 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2023-08-30T22:30:45.817 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-08-30T22:30:45.836 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:30:45.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-08-30T22:30:45.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:30:45.918 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-08-30T22:30:46.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-08-30T22:30:46.014 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-08-30T22:30:46.060 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-08-30T22:30:46.060 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-08-30T22:30:46.109 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T22:30:46.109 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu" 2023-08-30T22:30:46.109 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04" 2023-08-30T22:30:46.109 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T22:30:46.110 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy 2023-08-30T22:30:46.110 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu 2023-08-30T22:30:46.110 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian 2023-08-30T22:30:46.110 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T22:30:46.110 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T22:30:46.110 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T22:30:46.111 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T22:30:46.112 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy 2023-08-30T22:30:46.112 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-08-30T22:30:46.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:30:46.231 INFO:teuthology.dispatcher.supervisor:Running job 7384759 2023-08-30T22:30:46.231 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384759 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384759/orig.config.yaml 2023-08-30T22:30:46.234 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384759 2023-08-30T22:30:46.235 INFO:teuthology.dispatcher.supervisor:Job PID: 2474190 2023-08-30T22:30:46.235 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T22:32:46.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:32:46.420 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T22:32:46.632 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T22:32:46.634 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T22:32:46.709 DEBUG:teuthology.nuke:shortname: smithi162 2023-08-30T22:32:46.710 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T22:32:46.735 DEBUG:teuthology.nuke:shortname: smithi181 2023-08-30T22:32:46.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T22:32:46.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384759', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:20:42.464974', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEOSZgy/ZKm2Lf5l6bnOplpuecQfoRIUBgALAAtSRe3Y'} 2023-08-30T22:32:46.791 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384759', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:20:42.466604', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM4BSDgQEKJGVW8VaSSfx02FDIiDVOHzQuJR5DqtFm4u'} 2023-08-30T22:32:46.826 INFO:teuthology.orchestra.console.smithi162:Power off 2023-08-30T22:32:46.826 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:32:46.886 INFO:teuthology.orchestra.console.smithi181:Power off 2023-08-30T22:32:46.887 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:32:46.897 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-08-30T22:32:46.898 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:32:46.920 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-30T22:32:46.925 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-08-30T22:32:46.926 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:32:46.958 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-08-30T22:32:47.039 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-08-30T22:32:47.061 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-08-30T22:32:47.217 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com 2023-08-30T22:32:47.232 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com