2023-11-16T17:22:13.957 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T17:22:13.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:22:14.115 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe375cc9670>, signals=[15]) 2023-11-16T17:22:14.116 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging 2023-11-16T17:22:14.116 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T17:22:14.116 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-11-16T17:22:14.133 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-11-16T17:22:14.134 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T17:22:14.134 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-11-16T17:22:14.135 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /host {"name": "smithi063"} 2023-11-16T17:22:14.150 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-11-16T17:22:14.150 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T17:22:14.150 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-11-16T17:22:14.151 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-11-16T17:22:14.175 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-11-16T17:22:14.211 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-16T17:22:14.217 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-16T17:22:14.241 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-16T17:22:14.250 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-16T17:22:14.250 DEBUG:teuthology.provision.fog.smithi063:FOG request: PUT /host/168 {"imageID": 2} 2023-11-16T17:22:14.269 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-16T17:22:14.270 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 2} 2023-11-16T17:22:14.283 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-16T17:22:14.283 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 2} 2023-11-16T17:22:14.286 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of ubuntu 20.04 2023-11-16T17:22:14.286 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:22:14.314 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of ubuntu 20.04 2023-11-16T17:22:14.315 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:22:14.339 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 20.04 2023-11-16T17:22:14.339 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:22:14.374 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T17:22:14.383 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T17:22:14.413 DEBUG:teuthology.provision.fog.smithi063:FOG request: POST /host/168/task {"taskTypeID": 1} 2023-11-16T17:22:14.417 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T17:22:14.420 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-11-16T17:22:14.456 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-11-16T17:22:14.463 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:22:14.466 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:22:14.504 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:22:14.562 INFO:teuthology.orchestra.console.smithi093:Power off 2023-11-16T17:22:14.563 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T17:22:14.575 INFO:teuthology.orchestra.console.smithi063:Power off 2023-11-16T17:22:14.575 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T17:22:14.587 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-11-16T17:22:14.587 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:14.595 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2023-11-16T17:22:14.596 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:14.607 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-11-16T17:22:14.613 INFO:teuthology.orchestra.console.smithi125:Power off 2023-11-16T17:22:14.614 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T17:22:14.621 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-11-16T17:22:14.633 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-11-16T17:22:14.633 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:14.653 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-16T17:22:14.708 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-11-16T17:22:14.722 INFO:teuthology.orchestra.console.smithi063:Power off completed 2023-11-16T17:22:14.755 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-11-16T17:22:14.809 INFO:teuthology.orchestra.console.smithi093:Power on 2023-11-16T17:22:14.809 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T17:22:14.823 INFO:teuthology.orchestra.console.smithi063:Power on 2023-11-16T17:22:14.823 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T17:22:14.829 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-11-16T17:22:14.830 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:14.845 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On 2023-11-16T17:22:14.846 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:14.853 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-11-16T17:22:14.856 INFO:teuthology.orchestra.console.smithi125:Power on 2023-11-16T17:22:14.856 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T17:22:14.866 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-11-16T17:22:14.875 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2023-11-16T17:22:14.875 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:14.895 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-16T17:22:18.858 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:18.867 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:18.896 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:19.013 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-11-16T17:22:19.013 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-11-16T17:22:19.113 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-16T17:22:19.113 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-11-16T17:22:19.213 INFO:teuthology.orchestra.console.smithi125:Power on completed 2023-11-16T17:22:19.214 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-11-16T17:22:19.214 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:22:19.315 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-11-16T17:22:19.388 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:22:23.017 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:22:23.126 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-11-16T17:22:23.226 INFO:teuthology.orchestra.console.smithi063:Power on completed 2023-11-16T17:22:23.327 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2023-11-16T17:22:23.327 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:22:34.406 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:22:34.487 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:22:38.423 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:22:49.521 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:22:49.580 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:22:53.550 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:23:04.674 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:23:04.677 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:23:15.673 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:23:19.794 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:23:19.795 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:23:30.871 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:23:34.907 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:23:34.912 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:23:46.038 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:23:50.025 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:23:50.026 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:24:01.240 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:24:05.130 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:24:05.131 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:24:16.462 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:24:20.249 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:24:20.261 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:24:31.694 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:24:35.403 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:24:35.407 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:24:46.846 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:24:50.532 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:24:50.533 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:25:01.990 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:25:05.645 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:25:05.646 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:25:17.126 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:25:20.738 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:25:20.739 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:25:32.214 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:25:35.841 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:25:35.842 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:25:47.302 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:25:50.948 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-11-16T17:25:50.950 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:25:51.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:02.382 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:26:06.030 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-16T17:26:06.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:09.530 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-16T17:26:15.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:17.425 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:26:18.586 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-16T17:26:24.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:24.638 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-16T17:26:27.675 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-16T17:26:30.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:32.477 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:26:33.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:33.722 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-16T17:26:36.730 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-16T17:26:39.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:42.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:42.782 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-16T17:26:45.786 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-16T17:26:47.531 DEBUG:teuthology.provision.fog.smithi063:FOG request: GET /task/active None 2023-11-16T17:26:47.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:48.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:51.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:26:58.704 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-16T17:27:04.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:06.106 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-11-16T17:27:12.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:15.162 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-11-16T17:27:17.117 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-16T17:27:21.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:23.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:23.258 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-16T17:27:24.222 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-11-16T17:27:25.505 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T17:27:25.505 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T17:27:29.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:30.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:31.470 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T17:27:31.470 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T17:27:33.274 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-11-16T17:27:39.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:42.330 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-11-16T17:27:47.165 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-11-16T17:27:47.165 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-11-16T17:27:47.171 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2023-11-16T17:27:47.171 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts 2023-11-16T17:27:47.224 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-11-16T17:27:47.224 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-11-16T17:27:47.293 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts 2023-11-16T17:27:47.308 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-11-16T17:27:47.366 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname 2023-11-16T17:27:47.377 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-11-16T17:27:47.388 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-11-16T17:27:47.435 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Ubuntu" 2023-11-16T17:27:47.435 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-16T17:27:47.435 INFO:teuthology.orchestra.run.smithi093.stdout:ID=ubuntu 2023-11-16T17:27:47.435 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE=debian 2023-11-16T17:27:47.435 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-16T17:27:47.435 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="20.04" 2023-11-16T17:27:47.436 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T17:27:47.436 INFO:teuthology.orchestra.run.smithi093.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T17:27:47.436 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T17:27:47.436 INFO:teuthology.orchestra.run.smithi093.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T17:27:47.436 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_CODENAME=focal 2023-11-16T17:27:47.436 INFO:teuthology.orchestra.run.smithi093.stdout:UBUNTU_CODENAME=focal 2023-11-16T17:27:47.437 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-11-16T17:27:47.438 DEBUG:teuthology.parallel:result is None 2023-11-16T17:27:48.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:27:53.202 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-11-16T17:27:53.202 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-11-16T17:27:53.208 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-11-16T17:27:53.209 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-11-16T17:27:53.257 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-11-16T17:27:53.257 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-11-16T17:27:53.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-11-16T17:27:53.349 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-11-16T17:27:53.406 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-11-16T17:27:53.416 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-11-16T17:27:53.431 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-11-16T17:27:53.480 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2023-11-16T17:27:53.480 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-16T17:27:53.480 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2023-11-16T17:27:53.480 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2023-11-16T17:27:53.480 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-16T17:27:53.480 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="20.04" 2023-11-16T17:27:53.481 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T17:27:53.481 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T17:27:53.481 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T17:27:53.481 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T17:27:53.481 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=focal 2023-11-16T17:27:53.481 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=focal 2023-11-16T17:27:53.481 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-11-16T17:27:53.482 DEBUG:teuthology.parallel:result is None 2023-11-16T17:28:48.382 WARNING:teuthology.provision.fog.smithi063:timed out 2023-11-16T17:28:54.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:28:54.588 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T17:28:54.589 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T17:28:55.117 INFO:teuthology.provision.fog.smithi063:Node is ready 2023-11-16T17:28:55.117 DEBUG:teuthology.orchestra.run.smithi063:> hostname 2023-11-16T17:28:55.123 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com 2023-11-16T17:28:55.123 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts 2023-11-16T17:28:55.130 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063 2023-11-16T17:28:55.130 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2023-11-16T17:28:55.212 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts 2023-11-16T17:28:55.228 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts 2023-11-16T17:28:55.239 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname 2023-11-16T17:28:55.250 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2023-11-16T17:28:55.261 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="20.04" 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T17:28:55.267 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T17:28:55.268 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T17:28:55.268 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=focal 2023-11-16T17:28:55.268 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=focal 2023-11-16T17:28:55.268 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2023-11-16T17:28:55.268 DEBUG:teuthology.parallel:result is None 2023-11-16T17:28:55.664 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2023-11-16T17:28:55.665 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T17:28:55.694 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-11-16T17:28:55.694 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T17:28:55.799 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-11-16T17:28:55.799 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T17:28:55.828 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2023-11-16T17:28:55.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-11-16T17:28:55.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:28:55.878 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-11-16T17:28:56.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-11-16T17:28:56.004 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2023-11-16T17:28:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2023-11-16T17:28:56.010 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2023-11-16T17:28:56.016 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2023-11-16T17:28:56.016 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-16T17:28:56.016 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2023-11-16T17:28:56.016 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2023-11-16T17:28:56.016 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-16T17:28:56.016 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="20.04" 2023-11-16T17:28:56.016 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T17:28:56.016 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T17:28:56.017 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T17:28:56.017 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T17:28:56.017 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=focal 2023-11-16T17:28:56.017 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=focal 2023-11-16T17:28:56.017 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-11-16T17:28:56.044 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-11-16T17:28:56.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-16T17:28:56.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:28:56.094 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-11-16T17:28:56.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-16T17:28:56.300 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-11-16T17:28:56.305 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-11-16T17:28:56.306 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Ubuntu" 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ID=ubuntu 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE=debian 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="20.04" 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T17:28:56.312 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_CODENAME=focal 2023-11-16T17:28:56.313 INFO:teuthology.orchestra.run.smithi093.stdout:UBUNTU_CODENAME=focal 2023-11-16T17:28:56.313 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-11-16T17:28:56.336 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-11-16T17:28:56.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-16T17:28:56.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T17:28:56.382 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-11-16T17:28:56.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-16T17:28:56.583 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-11-16T17:28:56.589 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-11-16T17:28:56.590 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="20.04" 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T17:28:56.637 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T17:28:56.638 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=focal 2023-11-16T17:28:56.638 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=focal 2023-11-16T17:28:56.638 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-11-16T17:28:56.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:28:56.727 INFO:teuthology.dispatcher.supervisor:Running job 7460934 2023-11-16T17:28:56.727 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460934 --name adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi --description orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} -- /home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460934/orig.config.yaml 2023-11-16T17:28:56.730 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460934 2023-11-16T17:28:56.730 INFO:teuthology.dispatcher.supervisor:Job PID: 965475 2023-11-16T17:28:56.730 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-16T17:30:56.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:32:56.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:34:57.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:36:57.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:38:57.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:40:57.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:42:58.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:44:58.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:46:58.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:48:58.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:50:58.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:52:58.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T17:52:59.037 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-16T17:52:59.141 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-16T17:52:59.142 INFO:teuthology.nuke:Checking targets against current locks 2023-11-16T17:52:59.191 DEBUG:teuthology.nuke:shortname: smithi063 2023-11-16T17:52:59.192 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T17:52:59.213 DEBUG:teuthology.nuke:shortname: smithi093 2023-11-16T17:52:59.213 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T17:52:59.216 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 17:22:13.157369', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-16T17:52:59.235 DEBUG:teuthology.nuke:shortname: smithi125 2023-11-16T17:52:59.235 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T17:52:59.238 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 17:22:13.159187', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-16T17:52:59.270 INFO:teuthology.orchestra.console.smithi063:Power off 2023-11-16T17:52:59.270 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T17:52:59.278 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-16_17:22:00-orch:cephadm-wip-adk-testing-2023-11-16-0243-distro-default-smithi/7460934', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 17:22:13.160842', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-16T17:52:59.291 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2023-11-16T17:52:59.291 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:52:59.302 INFO:teuthology.orchestra.console.smithi093:Power off 2023-11-16T17:52:59.303 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T17:52:59.314 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-11-16T17:52:59.323 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-11-16T17:52:59.323 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:52:59.335 INFO:teuthology.orchestra.console.smithi125:Power off 2023-11-16T17:52:59.335 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T17:52:59.342 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-11-16T17:52:59.358 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-11-16T17:52:59.358 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T17:52:59.378 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-16T17:52:59.415 INFO:teuthology.orchestra.console.smithi063:Power off completed 2023-11-16T17:52:59.443 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-11-16T17:52:59.479 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-11-16T17:52:59.569 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com 2023-11-16T17:52:59.585 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-11-16T17:52:59.627 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com