2023-10-21T08:15:28.099 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T08:15:28.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:15:28.274 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8cceea0dc0>, signals=[15]) 2023-10-21T08:15:28.275 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-10-21T08:15:28.276 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T08:15:28.276 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-10-21T08:15:28.301 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-10-21T08:15:28.301 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T08:15:28.301 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-21T08:15:28.303 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-10-21T08:15:28.325 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-10-21T08:15:28.326 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T08:15:28.326 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-21T08:15:28.327 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-10-21T08:15:28.351 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-10-21T08:15:28.377 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-21T08:15:28.404 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-21T08:15:28.422 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-21T08:15:28.422 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 2} 2023-10-21T08:15:28.427 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-21T08:15:28.453 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-21T08:15:28.454 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 2} 2023-10-21T08:15:28.471 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-21T08:15:28.471 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 2} 2023-10-21T08:15:28.488 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 20.04 2023-10-21T08:15:28.488 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:15:28.492 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of ubuntu 20.04 2023-10-21T08:15:28.492 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:15:28.516 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 20.04 2023-10-21T08:15:28.516 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:15:28.547 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T08:15:28.552 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T08:15:28.576 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T08:15:28.583 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-10-21T08:15:28.586 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-10-21T08:15:28.612 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-10-21T08:15:28.640 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:15:28.644 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:15:28.672 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:15:28.751 INFO:teuthology.orchestra.console.smithi133:Power off 2023-10-21T08:15:28.752 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:15:28.765 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-21T08:15:28.765 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:15:28.772 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-10-21T08:15:28.773 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:28.786 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-21T08:15:28.787 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:15:28.795 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-21T08:15:28.796 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:28.803 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-21T08:15:28.811 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-21T08:15:28.811 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:28.822 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-21T08:15:28.838 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-21T08:15:32.806 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:32.824 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:32.840 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:32.915 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-21T08:15:32.932 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-21T08:15:32.948 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-21T08:15:36.920 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:36.933 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:36.949 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:37.029 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-21T08:15:37.042 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-21T08:15:37.058 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-21T08:15:37.130 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-10-21T08:15:37.144 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-21T08:15:37.232 INFO:teuthology.orchestra.console.smithi133:Power on 2023-10-21T08:15:37.232 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T08:15:37.245 INFO:teuthology.orchestra.console.smithi139:Power on 2023-10-21T08:15:37.245 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T08:15:37.253 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-10-21T08:15:37.254 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:37.268 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-10-21T08:15:37.269 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:37.277 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-21T08:15:37.290 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-21T08:15:41.062 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:41.171 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-21T08:15:41.272 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-21T08:15:41.278 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:41.290 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:41.373 INFO:teuthology.orchestra.console.smithi151:Power on 2023-10-21T08:15:41.373 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T08:15:41.387 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-21T08:15:41.395 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2023-10-21T08:15:41.395 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:41.404 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-21T08:15:41.415 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-21T08:15:45.390 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:45.405 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:45.416 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:45.499 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-21T08:15:45.525 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-21T08:15:45.594 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-21T08:15:45.601 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-10-21T08:15:45.695 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-10-21T08:15:45.702 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-10-21T08:15:45.702 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:15:45.796 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-10-21T08:15:45.797 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:15:49.530 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:15:49.639 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-21T08:15:49.740 INFO:teuthology.orchestra.console.smithi151:Power on completed 2023-10-21T08:15:49.841 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-10-21T08:15:49.841 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:16:00.805 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:16:00.860 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:16:04.930 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:16:15.898 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:16:15.917 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:16:20.020 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:16:30.986 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:16:30.988 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:16:35.102 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:16:46.082 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:16:46.084 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:16:50.190 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:17:01.174 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:17:01.176 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:17:05.274 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:17:16.282 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:17:16.284 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:17:20.378 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:17:31.378 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:17:31.379 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:17:35.458 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:17:46.474 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:17:46.476 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:17:50.538 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:18:01.583 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:18:01.584 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:18:05.630 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:18:16.682 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:18:16.684 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:18:20.714 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:18:31.782 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:18:31.783 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:18:35.794 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:18:46.874 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:18:46.875 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:18:50.884 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:19:01.966 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:19:01.968 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:19:05.979 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:19:17.054 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:19:17.056 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-21T08:19:17.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:19:21.066 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:19:32.146 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-21T08:19:32.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:19:35.678 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-21T08:19:36.136 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:19:41.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:19:44.762 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-21T08:19:50.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:19:50.782 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-21T08:19:51.205 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-21T08:19:51.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:19:53.822 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-21T08:19:56.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:19:59.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:19:59.866 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-21T08:20:02.910 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-21T08:20:05.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:20:08.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:20:08.922 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-21T08:20:09.722 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T08:20:11.998 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-21T08:20:14.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:20:15.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:20:17.978 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-21T08:20:18.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:20:18.785 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T08:20:23.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:20:24.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:20:27.870 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T08:20:33.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:20:36.954 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-21T08:20:42.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:21:18.036 WARNING:teuthology.provision.fog.smithi139:timed out 2023-10-21T08:21:23.990 WARNING:teuthology.provision.fog.smithi133:timed out 2023-10-21T08:21:24.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:21:24.248 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T08:21:24.249 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T08:21:24.787 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-10-21T08:21:24.788 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-10-21T08:21:24.795 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-10-21T08:21:24.796 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-10-21T08:21:24.802 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-10-21T08:21:24.802 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-21T08:21:24.937 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-10-21T08:21:24.955 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-10-21T08:21:24.969 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-10-21T08:21:25.029 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-21T08:21:25.045 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-21T08:21:25.051 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-10-21T08:21:25.052 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T08:21:25.052 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-10-21T08:21:25.052 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-10-21T08:21:25.052 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T08:21:25.053 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04" 2023-10-21T08:21:25.053 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T08:21:25.053 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T08:21:25.053 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T08:21:25.054 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T08:21:25.054 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal 2023-10-21T08:21:25.054 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal 2023-10-21T08:21:25.055 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-10-21T08:21:25.057 DEBUG:teuthology.parallel:result is None 2023-10-21T08:21:29.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:21:30.220 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T08:21:30.221 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T08:21:30.671 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-10-21T08:21:30.671 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-10-21T08:21:30.677 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2023-10-21T08:21:30.678 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2023-10-21T08:21:30.733 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2023-10-21T08:21:30.733 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-10-21T08:21:30.823 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2023-10-21T08:21:30.838 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2023-10-21T08:21:30.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2023-10-21T08:21:30.913 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-10-21T08:21:30.928 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-10-21T08:21:30.935 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-10-21T08:21:30.935 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T08:21:30.935 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-10-21T08:21:30.935 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-10-21T08:21:30.935 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T08:21:30.936 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-10-21T08:21:30.936 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T08:21:30.936 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T08:21:30.936 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T08:21:30.936 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T08:21:30.937 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-10-21T08:21:30.937 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-10-21T08:21:30.937 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-10-21T08:21:30.938 DEBUG:teuthology.parallel:result is None 2023-10-21T08:21:42.966 WARNING:teuthology.provision.fog.smithi151:timed out 2023-10-21T08:21:48.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:21:49.173 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T08:21:49.173 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T08:21:49.676 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-10-21T08:21:49.677 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-10-21T08:21:49.683 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-10-21T08:21:49.683 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2023-10-21T08:21:49.691 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-10-21T08:21:49.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-21T08:21:49.784 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2023-10-21T08:21:49.802 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-10-21T08:21:49.818 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2023-10-21T08:21:49.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-21T08:21:49.897 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-21T08:21:49.902 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-10-21T08:21:49.902 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T08:21:49.903 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-10-21T08:21:49.903 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-10-21T08:21:49.903 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T08:21:49.903 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2023-10-21T08:21:49.903 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T08:21:49.904 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T08:21:49.904 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T08:21:49.904 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T08:21:49.904 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2023-10-21T08:21:49.904 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2023-10-21T08:21:49.905 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-10-21T08:21:49.905 DEBUG:teuthology.parallel:result is None 2023-10-21T08:21:50.234 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-10-21T08:21:50.235 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T08:21:50.254 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-10-21T08:21:50.254 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T08:21:50.278 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-10-21T08:21:50.279 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T08:21:50.305 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-10-21T08:21:50.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-21T08:21:50.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:21:50.356 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-10-21T08:21:50.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-21T08:21:50.556 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-10-21T08:21:50.563 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-10-21T08:21:50.563 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-10-21T08:21:50.612 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-10-21T08:21:50.613 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T08:21:50.613 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-10-21T08:21:50.613 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-10-21T08:21:50.614 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T08:21:50.614 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-10-21T08:21:50.614 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T08:21:50.614 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T08:21:50.615 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T08:21:50.615 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T08:21:50.615 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-10-21T08:21:50.615 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-10-21T08:21:50.616 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-10-21T08:21:50.637 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-10-21T08:21:50.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-21T08:21:50.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:21:50.686 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-10-21T08:21:50.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-21T08:21:50.888 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-10-21T08:21:50.894 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-10-21T08:21:50.894 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-21T08:21:50.900 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-10-21T08:21:50.900 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T08:21:50.900 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-10-21T08:21:50.901 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-10-21T08:21:50.901 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T08:21:50.901 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04" 2023-10-21T08:21:50.901 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T08:21:50.901 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T08:21:50.902 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T08:21:50.902 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T08:21:50.902 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal 2023-10-21T08:21:50.902 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal 2023-10-21T08:21:50.903 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-21T08:21:50.920 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-10-21T08:21:50.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-21T08:21:50.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:21:50.968 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-21T08:21:51.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-21T08:21:51.092 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-21T08:21:51.099 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-21T08:21:51.099 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-21T08:21:51.105 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-10-21T08:21:51.105 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T08:21:51.105 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-10-21T08:21:51.105 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-10-21T08:21:51.106 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T08:21:51.106 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2023-10-21T08:21:51.106 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T08:21:51.106 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T08:21:51.106 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T08:21:51.107 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T08:21:51.107 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2023-10-21T08:21:51.107 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2023-10-21T08:21:51.107 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-21T08:21:51.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:21:51.244 INFO:teuthology.dispatcher.supervisor:Running job 7434509 2023-10-21T08:21:51.244 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_pdhange@teuthology --archive /home/teuthworker/archive/pdhange-2023-10-21_08:01:20-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434509 --name pdhange-2023-10-21_08:01:20-upgrade:quincy-p2p-quincy-release-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/pdhange-2023-10-21_08:01:20-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434509/orig.config.yaml 2023-10-21T08:21:51.248 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdhange-2023-10-21_08:01:20-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434509 2023-10-21T08:21:51.248 INFO:teuthology.dispatcher.supervisor:Job PID: 1208234 2023-10-21T08:21:51.249 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T08:23:51.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:25:51.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:27:51.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:29:51.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:31:52.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:31:52.099 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T08:31:52.259 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T08:31:52.260 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T08:31:52.306 DEBUG:teuthology.nuke:shortname: smithi133 2023-10-21T08:31:52.307 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T08:31:52.333 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdhange-2023-10-21_08:01:20-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 08:15:27.241378', 'locked_by': 'scheduled_pdhange@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-21T08:31:52.338 DEBUG:teuthology.nuke:shortname: smithi139 2023-10-21T08:31:52.338 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T08:31:52.359 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdhange-2023-10-21_08:01:20-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 08:15:27.240354', 'locked_by': 'scheduled_pdhange@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-21T08:31:52.364 DEBUG:teuthology.nuke:shortname: smithi151 2023-10-21T08:31:52.364 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T08:31:52.386 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdhange-2023-10-21_08:01:20-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 08:15:27.238642', 'locked_by': 'scheduled_pdhange@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-21T08:31:52.396 INFO:teuthology.orchestra.console.smithi133:Power off 2023-10-21T08:31:52.397 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:31:52.427 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-10-21T08:31:52.428 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:31:52.444 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-21T08:31:52.444 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:31:52.456 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-21T08:31:52.466 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-21T08:31:52.466 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:31:52.482 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-21T08:31:52.483 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:31:52.492 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-21T08:31:52.505 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-21T08:31:52.506 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:31:52.529 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-21T08:31:52.557 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-10-21T08:31:52.593 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-21T08:31:52.630 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-21T08:31:52.705 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2023-10-21T08:31:52.740 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com 2023-10-21T08:31:52.782 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com