2023-08-27T07:42:37.385 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-27T07:42:37.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T07:42:37.540 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c31c171f0>, signals=[15]) 2023-08-27T07:42:37.541 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2023-08-27T07:42:37.541 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T07:42:37.542 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-08-27T07:42:37.563 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-08-27T07:42:37.564 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T07:42:37.564 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-08-27T07:42:37.565 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /host {"name": "smithi082"} 2023-08-27T07:42:37.588 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-08-27T07:42:37.588 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T07:42:37.589 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-08-27T07:42:37.590 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"} 2023-08-27T07:42:37.605 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-08-27T07:42:37.627 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-27T07:42:37.647 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-27T07:42:37.664 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-27T07:42:37.666 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-27T07:42:37.666 DEBUG:teuthology.provision.fog.smithi082:FOG request: PUT /host/187 {"imageID": 2} 2023-08-27T07:42:37.686 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-27T07:42:37.686 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 2} 2023-08-27T07:42:37.705 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-27T07:42:37.705 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 2} 2023-08-27T07:42:37.710 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of ubuntu 20.04 2023-08-27T07:42:37.710 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:42:37.728 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 20.04 2023-08-27T07:42:37.728 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:42:37.744 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of ubuntu 20.04 2023-08-27T07:42:37.745 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:42:37.769 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T07:42:37.784 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T07:42:37.815 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T07:42:37.818 DEBUG:teuthology.provision.fog.smithi082:FOG request: POST /host/187/task {"taskTypeID": 1} 2023-08-27T07:42:37.819 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1} 2023-08-27T07:42:37.854 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-08-27T07:42:37.874 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:42:37.876 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:42:37.931 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:42:37.985 INFO:teuthology.orchestra.console.smithi082:Power off 2023-08-27T07:42:37.985 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T07:42:37.995 INFO:teuthology.orchestra.console.smithi143:Power off 2023-08-27T07:42:37.996 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T07:42:38.006 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-08-27T07:42:38.007 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:38.015 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-08-27T07:42:38.015 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:38.027 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-08-27T07:42:38.036 INFO:teuthology.orchestra.console.smithi159:Power off 2023-08-27T07:42:38.036 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T07:42:38.042 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-08-27T07:42:38.054 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-08-27T07:42:38.054 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:38.072 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-27T07:42:38.128 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-08-27T07:42:38.143 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-08-27T07:42:38.173 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-08-27T07:42:38.229 INFO:teuthology.orchestra.console.smithi082:Power on 2023-08-27T07:42:38.230 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T07:42:38.244 INFO:teuthology.orchestra.console.smithi143:Power on 2023-08-27T07:42:38.244 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T07:42:38.251 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On 2023-08-27T07:42:38.252 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:38.263 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-08-27T07:42:38.264 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:38.270 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-08-27T07:42:38.273 INFO:teuthology.orchestra.console.smithi159:Power on 2023-08-27T07:42:38.274 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T07:42:38.283 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-08-27T07:42:38.293 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2023-08-27T07:42:38.293 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:38.313 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-27T07:42:42.275 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:42.284 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:42.314 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:42.382 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-08-27T07:42:42.391 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-08-27T07:42:42.421 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-27T07:42:42.492 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-08-27T07:42:42.593 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-08-27T07:42:42.593 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:42:46.385 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:46.422 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T07:42:46.493 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-08-27T07:42:46.530 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-08-27T07:42:46.595 INFO:teuthology.orchestra.console.smithi082:Power on completed 2023-08-27T07:42:46.631 INFO:teuthology.orchestra.console.smithi159:Power on completed 2023-08-27T07:42:46.696 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2023-08-27T07:42:46.697 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:42:46.731 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-08-27T07:42:46.732 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:42:57.672 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:43:01.767 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:43:01.792 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:43:12.758 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:43:16.858 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:43:16.875 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:43:27.845 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:43:31.946 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:43:31.962 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:43:42.937 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:43:47.044 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:43:47.051 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:43:58.073 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:44:02.217 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:44:02.221 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:44:13.267 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:44:17.430 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:44:17.431 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:44:28.501 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:44:32.629 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:44:32.634 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:44:43.719 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:44:47.881 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:44:47.890 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:44:59.009 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:45:03.204 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:45:03.212 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:45:14.333 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:45:18.570 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:45:18.584 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:45:29.629 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:45:33.939 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:45:33.944 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:45:44.902 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:45:49.219 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:45:49.223 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:46:00.161 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:46:04.465 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:46:04.481 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:46:15.425 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:46:19.758 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-27T07:46:19.763 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:46:20.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:46:20.140 ERROR:teuthology.orchestra.connection:Error authenticating with smithi082.front.sepia.ceph.com: Authentication failed. 2023-08-27T07:46:20.142 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T07:46:20.143 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T07:46:20.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-27T07:46:30.739 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-08-27T07:46:31.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:46:34.085 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-27T07:46:35.074 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-27T07:46:35.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:46:38.409 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-27T07:46:40.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:46:43.141 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-27T07:46:44.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:46:47.461 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-27T07:46:49.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:46:52.197 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-27T07:46:53.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:46:56.517 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-27T07:46:58.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:01.253 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-27T07:47:02.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:05.573 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-27T07:47:07.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:10.309 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-27T07:47:11.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:14.629 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-27T07:47:16.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:19.365 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-27T07:47:20.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:23.685 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-27T07:47:25.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:29.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:43.749 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-27T07:47:49.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:52.805 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-08-27T07:47:58.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:47:59.456 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T07:47:59.457 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T07:48:10.885 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-27T07:48:10.886 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi082 2023-08-27T07:48:19.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-08-27T07:48:19.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:48:20.093 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-08-27T07:48:20.322 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-08-27T07:48:20.322 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-08-27T07:48:20.328 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-08-27T07:48:20.329 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-08-27T07:48:20.336 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-08-27T07:48:20.336 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-08-27T07:48:20.391 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-08-27T07:48:20.407 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-08-27T07:48:20.420 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-08-27T07:48:20.432 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-08-27T07:48:20.490 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-08-27T07:48:20.497 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2023-08-27T07:48:20.497 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-27T07:48:20.497 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2023-08-27T07:48:20.497 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2023-08-27T07:48:20.497 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-27T07:48:20.498 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04" 2023-08-27T07:48:20.498 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-27T07:48:20.498 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-27T07:48:20.498 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-27T07:48:20.498 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-27T07:48:20.499 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal 2023-08-27T07:48:20.499 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal 2023-08-27T07:48:20.499 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-08-27T07:48:20.501 DEBUG:teuthology.parallel:result is None 2023-08-27T07:48:20.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-08-27T07:48:20.706 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T07:48:20.706 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T07:48:20.712 INFO:teuthology.provision.fog.smithi082:Node is ready 2023-08-27T07:48:20.712 DEBUG:teuthology.orchestra.run.smithi082:> hostname 2023-08-27T07:48:20.768 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2023-08-27T07:48:20.768 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi082.front.sepia.ceph.com /etc/hosts 2023-08-27T07:48:20.781 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2023-08-27T07:48:20.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-08-27T07:48:20.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hosts 2023-08-27T07:48:20.905 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.82/172.21.15.82/g' /etc/hosts 2023-08-27T07:48:20.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hostname 2023-08-27T07:48:20.931 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-08-27T07:48:20.986 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-08-27T07:48:20.991 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2023-08-27T07:48:20.991 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-27T07:48:20.991 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2023-08-27T07:48:20.992 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2023-08-27T07:48:20.992 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-27T07:48:20.992 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="20.04" 2023-08-27T07:48:20.992 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-27T07:48:20.993 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-27T07:48:20.993 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-27T07:48:20.993 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-27T07:48:20.993 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=focal 2023-08-27T07:48:20.993 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=focal 2023-08-27T07:48:20.994 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2023-08-27T07:48:20.994 DEBUG:teuthology.parallel:result is None 2023-08-27T07:48:29.689 WARNING:teuthology.provision.fog.smithi159:timed out 2023-08-27T07:48:35.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:48:35.899 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T07:48:35.899 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T07:48:36.403 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-08-27T07:48:36.403 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-08-27T07:48:36.410 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-08-27T07:48:36.411 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-08-27T07:48:36.419 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-08-27T07:48:36.419 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-08-27T07:48:36.541 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-08-27T07:48:36.557 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-08-27T07:48:36.569 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-08-27T07:48:36.626 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-08-27T07:48:36.636 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-08-27T07:48:36.642 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2023-08-27T07:48:36.643 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-27T07:48:36.643 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2023-08-27T07:48:36.643 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2023-08-27T07:48:36.643 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-27T07:48:36.644 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="20.04" 2023-08-27T07:48:36.644 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-27T07:48:36.644 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-27T07:48:36.645 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-27T07:48:36.645 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-27T07:48:36.645 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=focal 2023-08-27T07:48:36.646 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=focal 2023-08-27T07:48:36.646 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-08-27T07:48:36.647 DEBUG:teuthology.parallel:result is None 2023-08-27T07:48:36.945 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2023-08-27T07:48:36.946 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-27T07:48:36.972 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-08-27T07:48:36.972 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-27T07:48:36.996 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-08-27T07:48:36.997 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-27T07:48:37.014 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2023-08-27T07:48:37.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-08-27T07:48:37.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:48:37.063 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-08-27T07:48:37.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-08-27T07:48:37.187 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-08-27T07:48:37.193 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-08-27T07:48:37.193 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-08-27T07:48:37.199 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2023-08-27T07:48:37.200 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-27T07:48:37.200 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2023-08-27T07:48:37.200 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2023-08-27T07:48:37.200 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-27T07:48:37.200 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="20.04" 2023-08-27T07:48:37.201 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-27T07:48:37.201 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-27T07:48:37.201 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-27T07:48:37.201 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-27T07:48:37.201 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=focal 2023-08-27T07:48:37.202 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=focal 2023-08-27T07:48:37.202 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-08-27T07:48:37.222 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-08-27T07:48:37.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-08-27T07:48:37.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:48:37.269 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-08-27T07:48:37.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-08-27T07:48:37.471 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-08-27T07:48:37.477 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-08-27T07:48:37.478 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-08-27T07:48:37.526 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2023-08-27T07:48:37.526 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-27T07:48:37.526 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2023-08-27T07:48:37.527 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2023-08-27T07:48:37.527 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-27T07:48:37.527 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04" 2023-08-27T07:48:37.527 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-27T07:48:37.528 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-27T07:48:37.528 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-27T07:48:37.528 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-27T07:48:37.528 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal 2023-08-27T07:48:37.529 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal 2023-08-27T07:48:37.529 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-08-27T07:48:37.563 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-08-27T07:48:37.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-08-27T07:48:37.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T07:48:37.613 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-08-27T07:48:37.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-08-27T07:48:37.731 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-08-27T07:48:37.738 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-08-27T07:48:37.739 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-08-27T07:48:37.788 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2023-08-27T07:48:37.788 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-27T07:48:37.789 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2023-08-27T07:48:37.789 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2023-08-27T07:48:37.789 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-27T07:48:37.790 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="20.04" 2023-08-27T07:48:37.790 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-27T07:48:37.790 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-27T07:48:37.790 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-27T07:48:37.791 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-27T07:48:37.791 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=focal 2023-08-27T07:48:37.791 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=focal 2023-08-27T07:48:37.791 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-08-27T07:48:37.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T07:48:37.979 INFO:teuthology.dispatcher.supervisor:Running job 7381979 2023-08-27T07:48:37.979 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-08-27_01:35:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7381979 --name teuthology-2023-08-27_01:35:02-upgrade:quincy-p2p-quincy-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/teuthology-2023-08-27_01:35:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7381979/orig.config.yaml 2023-08-27T07:48:37.982 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-08-27_01:35:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7381979 2023-08-27T07:48:37.983 INFO:teuthology.dispatcher.supervisor:Job PID: 8777 2023-08-27T07:48:37.983 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-27T07:50:38.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T07:52:38.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T07:54:38.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T07:56:38.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T07:58:38.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:00:38.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:02:39.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:04:39.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:06:39.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:08:39.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:10:39.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:12:39.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:14:40.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:16:40.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:18:40.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:20:40.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:22:40.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:24:40.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:26:40.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:28:41.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:30:41.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:32:41.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:34:41.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:36:41.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:38:41.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:40:42.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:42:42.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:44:42.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:46:42.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:48:42.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:50:42.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:52:43.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:54:43.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:56:43.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T08:58:43.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:00:43.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:02:43.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:04:44.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:06:44.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:08:44.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:10:44.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:12:44.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:14:44.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:16:44.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:18:45.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:20:45.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:22:45.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:24:45.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:26:45.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:28:45.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:30:46.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:32:46.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:34:46.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:36:46.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:38:46.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:40:46.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:42:47.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:44:47.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:46:47.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:48:47.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:50:47.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:52:47.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:54:48.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:56:48.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:58:48.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:00:48.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:02:48.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:04:48.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:06:49.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:08:49.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:10:49.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:12:49.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:14:49.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:16:49.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:18:50.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:20:50.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:22:50.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:24:50.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:26:50.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:28:51.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:30:51.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:32:51.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:34:51.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:36:51.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:38:51.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:40:52.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:42:52.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:44:52.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:46:52.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:48:52.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:50:52.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:52:52.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:54:53.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:56:53.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:58:53.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:00:53.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:02:53.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:04:54.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:06:54.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:08:54.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:10:54.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:12:54.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:14:54.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:16:54.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:18:55.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:20:55.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:22:55.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:24:55.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:24:55.718 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-27T11:24:56.059 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-27T11:24:56.059 INFO:teuthology.nuke:Checking targets against current locks 2023-08-27T11:24:56.095 DEBUG:teuthology.nuke:shortname: smithi082 2023-08-27T11:24:56.096 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T11:24:56.119 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-27_01:35:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7381979', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 07:42:36.605610', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-27T11:24:56.122 DEBUG:teuthology.nuke:shortname: smithi143 2023-08-27T11:24:56.123 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T11:24:56.145 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-27_01:35:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7381979', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 07:42:36.604234', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-27T11:24:56.149 DEBUG:teuthology.nuke:shortname: smithi159 2023-08-27T11:24:56.149 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T11:24:56.176 INFO:teuthology.orchestra.console.smithi082:Power off 2023-08-27T11:24:56.177 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T11:24:56.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-27_01:35:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7381979', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 07:42:36.602551', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-27T11:24:56.196 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-08-27T11:24:56.196 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T11:24:56.209 INFO:teuthology.orchestra.console.smithi143:Power off 2023-08-27T11:24:56.210 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T11:24:56.219 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-08-27T11:24:56.230 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-08-27T11:24:56.231 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T11:24:56.242 INFO:teuthology.orchestra.console.smithi159:Power off 2023-08-27T11:24:56.243 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T11:24:56.252 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-08-27T11:24:56.264 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-08-27T11:24:56.264 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T11:24:56.284 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-27T11:24:56.320 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-08-27T11:24:56.353 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-08-27T11:24:56.385 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-08-27T11:24:56.467 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com 2023-08-27T11:24:56.492 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2023-08-27T11:24:56.526 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com