2023-08-08T16:11:23.080 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T16:11:23.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T16:11:23.230 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe8d51f4f70>, signals=[15]) 2023-08-08T16:11:23.232 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging 2023-08-08T16:11:23.232 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T16:11:23.233 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-08-08T16:11:23.257 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-08-08T16:11:23.258 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T16:11:23.258 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-08-08T16:11:23.262 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /host {"name": "smithi122"} 2023-08-08T16:11:23.283 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-08-08T16:11:23.333 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /image {"name": "smithi_ubuntu_18.04"} 2023-08-08T16:11:23.352 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_ubuntu_18.04"} 2023-08-08T16:11:23.376 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_ubuntu_18.04 (ID 1) 2023-08-08T16:11:23.376 DEBUG:teuthology.provision.fog.smithi122:FOG request: PUT /host/227 {"imageID": 1} 2023-08-08T16:11:23.397 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_ubuntu_18.04 (ID 1) 2023-08-08T16:11:23.398 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 1} 2023-08-08T16:11:23.439 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of ubuntu 18.04 2023-08-08T16:11:23.440 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:11:23.453 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 18.04 2023-08-08T16:11:23.453 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:11:23.518 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T16:11:23.530 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T16:11:23.561 DEBUG:teuthology.provision.fog.smithi122:FOG request: POST /host/227/task {"taskTypeID": 1} 2023-08-08T16:11:23.575 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-08-08T16:11:23.629 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:11:23.632 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:11:23.742 INFO:teuthology.orchestra.console.smithi122:Power off 2023-08-08T16:11:23.743 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T16:11:23.759 INFO:teuthology.orchestra.console.smithi153:Power off 2023-08-08T16:11:23.760 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T16:11:23.771 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2023-08-08T16:11:23.772 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:23.783 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-08-08T16:11:23.784 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:23.793 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-08-08T16:11:23.806 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-08T16:11:27.796 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:27.808 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:27.906 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-08-08T16:11:27.919 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-08T16:11:31.908 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:31.920 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:32.020 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2023-08-08T16:11:32.030 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-08T16:11:32.122 INFO:teuthology.orchestra.console.smithi122:Power off completed 2023-08-08T16:11:32.223 INFO:teuthology.orchestra.console.smithi122:Power on 2023-08-08T16:11:32.223 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T16:11:32.245 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On 2023-08-08T16:11:32.246 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:32.267 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2023-08-08T16:11:36.034 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:36.144 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-08T16:11:36.245 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-08-08T16:11:36.268 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:36.346 INFO:teuthology.orchestra.console.smithi153:Power on 2023-08-08T16:11:36.347 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T16:11:36.367 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-08-08T16:11:36.368 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:36.377 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2023-08-08T16:11:36.388 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-08T16:11:40.380 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:40.389 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:40.491 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on 2023-08-08T16:11:40.499 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-08T16:11:40.592 INFO:teuthology.orchestra.console.smithi122:Power on completed 2023-08-08T16:11:40.693 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2023-08-08T16:11:40.693 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:11:44.503 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:11:44.612 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-08T16:11:44.713 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-08-08T16:11:44.814 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-08-08T16:11:44.814 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:11:55.777 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:11:59.896 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:12:10.856 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:12:15.001 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:12:25.948 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:12:30.104 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:12:41.030 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:12:45.202 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:12:56.145 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:13:00.285 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:13:11.222 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:13:15.368 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:13:26.316 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:13:30.444 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:13:41.400 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:13:45.508 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:13:56.488 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:14:00.572 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:14:11.566 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:14:15.644 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:14:26.644 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:14:30.719 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:14:41.728 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:14:45.796 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-08T16:14:45.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:14:45.943 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: Authentication failed. 2023-08-08T16:14:45.945 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T16:14:45.945 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T16:14:45.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-08T16:14:56.817 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None 2023-08-08T16:14:56.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:14:59.952 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:15:05.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:15:09.012 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:15:15.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:15:18.068 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:15:24.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:15:27.120 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:15:33.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:15:36.176 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:15:42.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:15:45.232 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:15:51.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:16:51.235 WARNING:teuthology.provision.fog.smithi122:timed out 2023-08-08T16:16:57.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:17:15.636 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:17:21.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:17:24.688 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:17:30.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:17:33.744 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:17:39.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:17:42.800 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:17:48.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:17:51.856 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:17:57.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:18:00.912 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:18:06.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:18:09.969 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:18:15.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:18:19.024 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:18:25.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:18:28.084 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:18:34.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:18:37.136 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:18:43.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:18:46.196 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:18:52.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:18:55.248 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:19:01.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:19:04.304 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:19:10.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:19:13.360 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:19:19.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:19:22.420 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:19:28.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:19:31.472 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:19:37.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:19:40.528 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:19:46.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:19:49.584 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:19:55.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:19:58.640 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:20:04.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:20:07.696 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:20:13.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:20:16.756 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:20:22.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:20:25.808 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:20:31.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:20:34.864 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:20:40.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:20:43.924 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-08-08T16:20:49.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:20:50.227 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T16:20:50.228 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T16:21:12.189 INFO:teuthology.provision.fog.smithi122:Node is ready 2023-08-08T16:21:12.189 DEBUG:teuthology.orchestra.run.smithi122:> hostname 2023-08-08T16:21:12.194 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2023-08-08T16:21:12.195 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi122.front.sepia.ceph.com /etc/hosts 2023-08-08T16:21:12.245 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2023-08-08T16:21:12.246 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2023-08-08T16:21:12.311 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hosts 2023-08-08T16:21:12.370 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.122/172.21.15.122/g' /etc/hosts 2023-08-08T16:21:12.425 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi122.front.sepia.ceph.com/smithi122/g' /etc/hostname 2023-08-08T16:21:12.482 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122 2023-08-08T16:21:12.537 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2023-08-08T16:21:12.584 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu" 2023-08-08T16:21:12.585 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2023-08-08T16:21:12.585 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu 2023-08-08T16:21:12.585 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian 2023-08-08T16:21:12.585 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2023-08-08T16:21:12.585 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="18.04" 2023-08-08T16:21:12.585 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-08T16:21:12.586 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-08T16:21:12.586 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-08T16:21:12.586 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-08T16:21:12.586 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=bionic 2023-08-08T16:21:12.586 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=bionic 2023-08-08T16:21:12.587 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2023-08-08T16:21:12.589 DEBUG:teuthology.parallel:result is None 2023-08-08T16:21:58.000 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-08T16:21:58.002 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi153 2023-08-08T16:22:07.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-08T16:22:07.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:22:07.105 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-08-08T16:22:07.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-08T16:22:07.466 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T16:22:07.466 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T16:22:07.513 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-08-08T16:22:07.514 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-08-08T16:22:07.562 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-08-08T16:22:07.563 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-08-08T16:22:07.610 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-08-08T16:22:07.611 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-08-08T16:22:07.675 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-08-08T16:22:07.731 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-08-08T16:22:07.787 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-08-08T16:22:07.840 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-08-08T16:22:07.897 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-08-08T16:22:07.945 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-08-08T16:22:07.945 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2023-08-08T16:22:07.946 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-08-08T16:22:07.946 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-08-08T16:22:07.946 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2023-08-08T16:22:07.946 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="18.04" 2023-08-08T16:22:07.946 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-08T16:22:07.946 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-08T16:22:07.946 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-08T16:22:07.947 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-08T16:22:07.947 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=bionic 2023-08-08T16:22:07.947 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=bionic 2023-08-08T16:22:07.947 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-08-08T16:22:07.948 DEBUG:teuthology.parallel:result is None 2023-08-08T16:22:08.125 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2023-08-08T16:22:08.126 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T16:22:08.151 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-08-08T16:22:08.151 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T16:22:08.169 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2023-08-08T16:22:08.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-08-08T16:22:08.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:22:08.248 DEBUG:teuthology.orchestra.run.smithi122:> true 2023-08-08T16:22:08.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-08-08T16:22:08.413 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2023-08-08T16:22:08.460 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2023-08-08T16:22:08.461 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2023-08-08T16:22:08.509 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu" 2023-08-08T16:22:08.509 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2023-08-08T16:22:08.510 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu 2023-08-08T16:22:08.510 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian 2023-08-08T16:22:08.510 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2023-08-08T16:22:08.510 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="18.04" 2023-08-08T16:22:08.510 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-08T16:22:08.510 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-08T16:22:08.511 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-08T16:22:08.511 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-08T16:22:08.511 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=bionic 2023-08-08T16:22:08.511 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=bionic 2023-08-08T16:22:08.511 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-08-08T16:22:08.535 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-08-08T16:22:08.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-08T16:22:08.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T16:22:08.606 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-08-08T16:22:08.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-08T16:22:08.725 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-08-08T16:22:08.773 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-08-08T16:22:08.774 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-08-08T16:22:08.821 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-08-08T16:22:08.822 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2023-08-08T16:22:08.822 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-08-08T16:22:08.822 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-08-08T16:22:08.822 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2023-08-08T16:22:08.822 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="18.04" 2023-08-08T16:22:08.822 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-08T16:22:08.823 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-08T16:22:08.823 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-08T16:22:08.823 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-08T16:22:08.823 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=bionic 2023-08-08T16:22:08.823 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=bionic 2023-08-08T16:22:08.823 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-08-08T16:22:08.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T16:22:08.945 INFO:teuthology.dispatcher.supervisor:Running job 7362927 2023-08-08T16:22:08.945 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-08_14:45:33-rados-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7362927 --name yuriw-2023-08-08_14:45:33-rados-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi --description rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} -- /home/teuthworker/archive/yuriw-2023-08-08_14:45:33-rados-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7362927/orig.config.yaml 2023-08-08T16:22:08.948 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-08_14:45:33-rados-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7362927 2023-08-08T16:22:08.949 INFO:teuthology.dispatcher.supervisor:Job PID: 15557 2023-08-08T16:22:08.949 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T16:24:09.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T16:26:09.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T16:28:09.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T16:30:09.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T16:32:09.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T16:32:09.828 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T16:32:09.921 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T16:32:09.922 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T16:32:09.965 DEBUG:teuthology.nuke:shortname: smithi122 2023-08-08T16:32:09.966 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T16:32:09.985 DEBUG:teuthology.nuke:shortname: smithi153 2023-08-08T16:32:09.985 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T16:32:09.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-08_14:45:33-rados-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7362927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '18.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 16:11:22.305451', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSAlWjESMc0Gra5f/6dvvbjuYJc2qVK13Ztw1gt4S0hdg9pLl/eAcLsaHQz3OAGEzcbKS0DF4bknjuwe5HHhPE='} 2023-08-08T16:32:10.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-08_14:45:33-rados-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7362927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '18.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 16:11:22.306583', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO1iFc3L7I+8QffZ61Yh05USfQhcDJhG14MCVPraId6H5t/3ncQ7JYnWTLUpdIgxX2uLa6KZHQeEX8siN4zMGCi28x2LIFrKdpeJS4yqa4imXazBSX8SNivVnZe+Grtd2V/dAHrGib95T67VW1a0p/k+6liUZyLFplFq9StkBkIpmwy424rNQRMCHnBRxb2hIKRs9YM36YlRjigLpoyeuptB7/EbLmtx3MxS+JOlLIN2DgjHAu5n7RRzawQlP7K6Iwe2eGPIVCTJsURg5/lJswzxYy7yzm+syJmY3YYQSNAMEunLrz4JDC2xMWWZmqpeBOP4QNSFSaYujTI0PBl1tN'} 2023-08-08T16:32:10.035 INFO:teuthology.orchestra.console.smithi122:Power off 2023-08-08T16:32:10.036 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T16:32:10.060 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off 2023-08-08T16:32:10.061 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:32:10.078 INFO:teuthology.orchestra.console.smithi153:Power off 2023-08-08T16:32:10.079 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T16:32:10.103 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off 2023-08-08T16:32:10.105 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-08-08T16:32:10.106 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T16:32:10.128 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-08T16:32:10.205 INFO:teuthology.orchestra.console.smithi122:Power off completed 2023-08-08T16:32:10.230 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-08-08T16:32:10.369 INFO:teuthology.lock.ops:unlocked: smithi122.front.sepia.ceph.com 2023-08-08T16:32:10.386 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com