2023-10-19T20:21:43.158 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T20:21:43.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:21:43.340 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffb27f12dc0>, signals=[15]) 2023-10-19T20:21:43.342 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-10-19T20:21:43.342 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T20:21:43.342 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-10-19T20:21:43.364 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-10-19T20:21:43.364 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T20:21:43.365 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-19T20:21:43.366 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-10-19T20:21:43.389 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-10-19T20:21:43.389 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T20:21:43.390 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-19T20:21:43.391 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-10-19T20:21:43.414 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-10-19T20:21:43.441 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-19T20:21:43.469 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-19T20:21:43.486 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-19T20:21:43.494 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-19T20:21:43.494 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 2} 2023-10-19T20:21:43.516 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-19T20:21:43.517 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 2} 2023-10-19T20:21:43.527 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-19T20:21:43.527 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 2} 2023-10-19T20:21:43.539 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of ubuntu 20.04 2023-10-19T20:21:43.540 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:21:43.566 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 20.04 2023-10-19T20:21:43.567 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:21:43.587 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 20.04 2023-10-19T20:21:43.587 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:21:43.597 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T20:21:43.609 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T20:21:43.626 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T20:21:43.635 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-10-19T20:21:43.647 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-10-19T20:21:43.660 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-10-19T20:21:43.699 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:21:43.703 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:21:43.715 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:21:43.793 INFO:teuthology.orchestra.console.smithi061:Power off 2023-10-19T20:21:43.794 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T20:21:43.808 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-19T20:21:43.809 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T20:21:43.822 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-19T20:21:43.823 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T20:21:43.831 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-19T20:21:43.831 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:43.838 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-10-19T20:21:43.839 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:43.846 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-19T20:21:43.847 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:43.855 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-19T20:21:43.859 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-10-19T20:21:43.868 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-19T20:21:47.858 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:47.865 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:47.872 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:47.967 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-19T20:21:47.974 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-10-19T20:21:47.983 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-19T20:21:51.970 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:51.979 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:51.985 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:52.081 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-19T20:21:52.087 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-10-19T20:21:52.093 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-19T20:21:52.183 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-19T20:21:52.284 INFO:teuthology.orchestra.console.smithi099:Power on 2023-10-19T20:21:52.285 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T20:21:52.306 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-10-19T20:21:52.307 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:52.328 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-19T20:21:56.090 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:56.097 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:56.199 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-10-19T20:21:56.205 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-19T20:21:56.301 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-10-19T20:21:56.307 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-19T20:21:56.329 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:56.402 INFO:teuthology.orchestra.console.smithi061:Power on 2023-10-19T20:21:56.403 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T20:21:56.412 INFO:teuthology.orchestra.console.smithi161:Power on 2023-10-19T20:21:56.413 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T20:21:56.425 DEBUG:teuthology.orchestra.console.smithi061:power on output: Chassis Power Control: Up/On 2023-10-19T20:21:56.426 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:56.433 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-10-19T20:21:56.433 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:21:56.441 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-19T20:21:56.448 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-10-19T20:21:56.454 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-19T20:22:00.446 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:22:00.453 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:22:00.461 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T20:22:00.555 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-19T20:22:00.563 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-10-19T20:22:00.569 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-19T20:22:00.658 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-10-19T20:22:00.664 INFO:teuthology.orchestra.console.smithi061:Power on completed 2023-10-19T20:22:00.670 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-10-19T20:22:00.759 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-10-19T20:22:00.760 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:22:00.766 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-10-19T20:22:00.766 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:22:00.772 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-10-19T20:22:00.772 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:22:15.834 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:22:15.836 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:22:15.837 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:22:30.906 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:22:30.908 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:22:30.910 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:22:45.978 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:22:45.979 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:22:45.980 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:23:01.048 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:23:01.050 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:23:01.051 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:23:16.122 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:23:16.124 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:23:16.125 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:23:31.194 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:23:31.196 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:23:31.197 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:23:46.266 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:23:46.268 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:23:46.269 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:24:01.338 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:24:01.340 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:24:01.341 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:24:16.400 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:24:16.402 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:24:16.406 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:24:31.473 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:24:31.476 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:24:31.477 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:24:46.546 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:24:46.548 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:24:46.549 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:25:01.622 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:25:01.624 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:25:01.625 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:25:16.694 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:25:16.696 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:25:16.697 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:25:31.770 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:25:31.772 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:25:31.773 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:25:46.842 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-19T20:25:46.844 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-19T20:25:46.848 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-19T20:25:46.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:25:46.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:25:46.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:05.306 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-19T20:26:05.307 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-19T20:26:05.308 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T20:26:11.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:11.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:11.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:14.394 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-19T20:26:14.398 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T20:26:14.399 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-19T20:26:20.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:20.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:20.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:23.482 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-19T20:26:23.483 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T20:26:23.483 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-19T20:26:29.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:29.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:29.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:32.542 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-19T20:26:32.570 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-19T20:26:32.571 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T20:26:38.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:38.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:38.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:41.630 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-19T20:26:41.631 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-19T20:26:47.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:26:47.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:27:20.246 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T20:27:20.247 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T20:27:20.326 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T20:27:20.327 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T20:27:38.574 WARNING:teuthology.provision.fog.smithi099:timed out 2023-10-19T20:27:41.619 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-10-19T20:27:41.619 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-10-19T20:27:41.626 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-10-19T20:27:41.627 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts 2023-10-19T20:27:41.674 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-10-19T20:27:41.674 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-10-19T20:27:41.751 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts 2023-10-19T20:27:41.764 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-10-19T20:27:41.765 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-10-19T20:27:41.766 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-10-19T20:27:41.771 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-10-19T20:27:41.772 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-10-19T20:27:41.822 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-10-19T20:27:41.822 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-19T20:27:41.823 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname 2023-10-19T20:27:41.834 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-10-19T20:27:41.844 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-10-19T20:27:41.893 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-10-19T20:27:41.893 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-19T20:27:41.894 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-10-19T20:27:41.894 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-10-19T20:27:41.894 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-19T20:27:41.894 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="20.04" 2023-10-19T20:27:41.894 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-19T20:27:41.895 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-19T20:27:41.895 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-19T20:27:41.895 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-19T20:27:41.895 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=focal 2023-10-19T20:27:41.895 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=focal 2023-10-19T20:27:41.896 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-10-19T20:27:41.898 DEBUG:teuthology.parallel:result is None 2023-10-19T20:27:41.913 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-10-19T20:27:41.928 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-10-19T20:27:41.941 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-10-19T20:27:42.003 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-19T20:27:42.013 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-19T20:27:42.019 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-10-19T20:27:42.019 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-19T20:27:42.020 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-10-19T20:27:42.020 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-10-19T20:27:42.020 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-19T20:27:42.020 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="20.04" 2023-10-19T20:27:42.020 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-19T20:27:42.021 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-19T20:27:42.021 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-19T20:27:42.021 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-19T20:27:42.021 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=focal 2023-10-19T20:27:42.022 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=focal 2023-10-19T20:27:42.022 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-10-19T20:27:42.023 DEBUG:teuthology.parallel:result is None 2023-10-19T20:27:44.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:27:44.804 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T20:27:44.805 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T20:27:45.354 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-10-19T20:27:45.354 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-10-19T20:27:45.361 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-10-19T20:27:45.362 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-10-19T20:27:45.412 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-10-19T20:27:45.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-10-19T20:27:45.486 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-10-19T20:27:45.502 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-10-19T20:27:45.560 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-10-19T20:27:45.572 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-10-19T20:27:45.586 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-19T20:27:45.635 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2023-10-19T20:27:45.636 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-19T20:27:45.636 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2023-10-19T20:27:45.636 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2023-10-19T20:27:45.637 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-19T20:27:45.637 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2023-10-19T20:27:45.637 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-19T20:27:45.637 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-19T20:27:45.637 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-19T20:27:45.638 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-19T20:27:45.638 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2023-10-19T20:27:45.638 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2023-10-19T20:27:45.638 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-10-19T20:27:45.639 DEBUG:teuthology.parallel:result is None 2023-10-19T20:27:45.965 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-10-19T20:27:45.965 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T20:27:45.990 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-10-19T20:27:45.991 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T20:27:46.015 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-10-19T20:27:46.015 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T20:27:46.033 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-10-19T20:27:46.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-10-19T20:27:46.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:27:46.087 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-10-19T20:27:46.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-10-19T20:27:46.204 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-10-19T20:27:46.257 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-10-19T20:27:46.257 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-10-19T20:27:46.263 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-10-19T20:27:46.263 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-19T20:27:46.264 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-10-19T20:27:46.264 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-10-19T20:27:46.264 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-19T20:27:46.264 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="20.04" 2023-10-19T20:27:46.264 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-19T20:27:46.265 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-19T20:27:46.265 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-19T20:27:46.265 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-19T20:27:46.265 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=focal 2023-10-19T20:27:46.265 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=focal 2023-10-19T20:27:46.266 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-10-19T20:27:46.290 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-10-19T20:27:46.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-19T20:27:46.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:27:46.340 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-10-19T20:27:46.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-19T20:27:46.466 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-10-19T20:27:46.516 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-10-19T20:27:46.516 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-19T20:27:46.530 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2023-10-19T20:27:46.530 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-19T20:27:46.531 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2023-10-19T20:27:46.531 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2023-10-19T20:27:46.531 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-19T20:27:46.531 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="20.04" 2023-10-19T20:27:46.531 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-19T20:27:46.532 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-19T20:27:46.532 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-19T20:27:46.532 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-19T20:27:46.532 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=focal 2023-10-19T20:27:46.532 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=focal 2023-10-19T20:27:46.533 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-19T20:27:46.574 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-10-19T20:27:46.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-19T20:27:46.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T20:27:46.639 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-10-19T20:27:46.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-19T20:27:46.761 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-10-19T20:27:46.809 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-10-19T20:27:46.810 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-19T20:27:46.817 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-10-19T20:27:46.817 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-19T20:27:46.817 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-10-19T20:27:46.818 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-10-19T20:27:46.818 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-19T20:27:46.818 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="20.04" 2023-10-19T20:27:46.818 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-19T20:27:46.819 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-19T20:27:46.819 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-19T20:27:46.819 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-19T20:27:46.819 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=focal 2023-10-19T20:27:46.820 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=focal 2023-10-19T20:27:46.820 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-19T20:27:46.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:27:46.944 INFO:teuthology.dispatcher.supervisor:Running job 7432644 2023-10-19T20:27:46.944 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-10-19_19:56:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432644 --name lflores-2023-10-19_19:56:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/lflores-2023-10-19_19:56:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432644/orig.config.yaml 2023-10-19T20:27:46.947 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-10-19_19:56:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432644 2023-10-19T20:27:46.948 INFO:teuthology.dispatcher.supervisor:Job PID: 1255548 2023-10-19T20:27:46.949 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T20:29:47.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:31:47.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:33:47.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:35:47.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:37:47.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:39:47.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:41:48.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:43:48.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:45:48.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:47:48.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:49:48.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:51:48.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:53:49.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:55:49.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:57:49.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T20:59:49.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:01:49.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:03:49.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:05:50.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:07:50.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:09:50.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:11:50.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:13:50.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:15:50.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:17:51.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:19:51.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:21:51.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:23:51.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:25:51.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:27:51.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:29:52.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:31:52.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:33:52.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:35:52.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:37:52.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:39:52.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:41:53.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:43:53.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:45:53.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:47:53.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:49:53.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:51:53.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:53:53.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:55:54.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:57:54.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T21:59:54.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:01:54.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:03:54.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:05:54.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:07:55.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:09:55.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:11:55.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:13:55.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:15:55.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:17:55.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:19:56.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:21:56.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:23:56.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:25:56.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:27:56.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:29:56.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:31:57.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:33:57.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:35:57.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:37:57.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T22:37:57.660 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T22:37:57.947 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T22:37:57.948 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T22:37:57.994 DEBUG:teuthology.nuke:shortname: smithi061 2023-10-19T22:37:57.994 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T22:37:58.021 DEBUG:teuthology.nuke:shortname: smithi099 2023-10-19T22:37:58.021 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T22:37:58.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-19_19:56:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 20:21:42.247979', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-19T22:37:58.044 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-19_19:56:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 20:21:42.249388', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-19T22:37:58.049 DEBUG:teuthology.nuke:shortname: smithi161 2023-10-19T22:37:58.049 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T22:37:58.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-19_19:56:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432644', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 20:21:42.250523', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-19T22:37:58.079 INFO:teuthology.orchestra.console.smithi061:Power off 2023-10-19T22:37:58.080 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T22:37:58.101 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-10-19T22:37:58.102 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T22:37:58.119 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-19T22:37:58.119 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T22:37:58.128 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-10-19T22:37:58.139 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-19T22:37:58.140 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T22:37:58.152 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-19T22:37:58.153 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T22:37:58.160 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-19T22:37:58.173 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-19T22:37:58.173 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T22:37:58.193 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-19T22:37:58.229 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-10-19T22:37:58.261 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-19T22:37:58.294 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-19T22:37:58.376 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2023-10-19T22:37:58.400 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-10-19T22:37:58.442 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com