2023-10-25T11:30:39.371 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-25T11:30:39.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:30:39.530 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f037291ddc0>, signals=[15]) 2023-10-25T11:30:39.532 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-10-25T11:30:39.532 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T11:30:39.532 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-10-25T11:30:39.556 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-10-25T11:30:39.556 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T11:30:39.556 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-25T11:30:39.558 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-10-25T11:30:39.580 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-10-25T11:30:39.581 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-10-25T11:30:39.581 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-10-25T11:30:39.582 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-10-25T11:30:39.605 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /host {"name": "smithi170"} 2023-10-25T11:30:39.642 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-25T11:30:39.649 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-25T11:30:39.668 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-25T11:30:39.683 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-25T11:30:39.683 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 2} 2023-10-25T11:30:39.690 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-25T11:30:39.690 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 2} 2023-10-25T11:30:39.707 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-25T11:30:39.707 DEBUG:teuthology.provision.fog.smithi170:FOG request: PUT /host/275 {"imageID": 2} 2023-10-25T11:30:39.736 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 20.04 2023-10-25T11:30:39.736 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:30:39.739 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 20.04 2023-10-25T11:30:39.739 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:30:39.747 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of ubuntu 20.04 2023-10-25T11:30:39.747 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:30:39.795 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T11:30:39.799 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T11:30:39.820 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /tasktype {"name": "deploy"} 2023-10-25T11:30:39.832 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-10-25T11:30:39.840 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-10-25T11:30:39.865 DEBUG:teuthology.provision.fog.smithi170:FOG request: POST /host/275/task {"taskTypeID": 1} 2023-10-25T11:30:39.898 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:30:39.901 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:30:39.920 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:30:39.991 INFO:teuthology.orchestra.console.smithi133:Power off 2023-10-25T11:30:39.991 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T11:30:40.004 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-25T11:30:40.004 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T11:30:40.016 INFO:teuthology.orchestra.console.smithi170:Power off 2023-10-25T11:30:40.017 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T11:30:40.024 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-10-25T11:30:40.024 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:40.033 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-25T11:30:40.033 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:40.042 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-10-25T11:30:40.042 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:40.050 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-25T11:30:40.054 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-25T11:30:40.063 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-10-25T11:30:40.151 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-10-25T11:30:40.164 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-10-25T11:30:40.253 INFO:teuthology.orchestra.console.smithi133:Power on 2023-10-25T11:30:40.253 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T11:30:40.265 INFO:teuthology.orchestra.console.smithi170:Power on 2023-10-25T11:30:40.266 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T11:30:40.274 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-10-25T11:30:40.274 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:40.286 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2023-10-25T11:30:40.287 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:40.296 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-25T11:30:40.308 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-10-25T11:30:44.058 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:44.167 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-25T11:30:44.297 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:44.309 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:44.406 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-25T11:30:44.417 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-10-25T11:30:44.518 INFO:teuthology.orchestra.console.smithi170:Power on completed 2023-10-25T11:30:44.619 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-10-25T11:30:44.619 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:30:48.172 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:48.280 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-25T11:30:48.381 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-25T11:30:48.407 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:48.483 INFO:teuthology.orchestra.console.smithi161:Power on 2023-10-25T11:30:48.484 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-25T11:30:48.502 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-10-25T11:30:48.503 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:48.516 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-10-25T11:30:48.553 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-25T11:30:48.618 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-10-25T11:30:48.719 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-10-25T11:30:48.719 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:30:52.558 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T11:30:52.667 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-25T11:30:52.767 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-10-25T11:30:52.868 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-10-25T11:30:52.869 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:30:59.693 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:31:03.794 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:31:07.938 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:31:14.776 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:31:18.874 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:31:23.014 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:31:29.850 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:31:33.947 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:31:38.082 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:31:44.922 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:31:49.026 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:31:53.154 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:32:00.002 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:32:04.102 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:32:08.224 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:32:15.078 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:32:19.172 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:32:23.300 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:32:30.146 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:32:34.238 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:32:38.378 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:32:45.214 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:32:49.322 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:32:53.470 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:33:00.294 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:33:04.402 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:33:08.550 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:33:15.374 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:33:19.487 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:33:23.638 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:33:30.451 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:33:34.565 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:33:38.718 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:33:45.533 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:33:49.638 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:33:53.802 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:34:00.598 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:34:04.713 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:34:08.870 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:34:15.682 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:34:19.782 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:34:23.950 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:34:30.751 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-10-25T11:34:30.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:34:34.858 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-10-25T11:34:34.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:34:39.010 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-25T11:34:39.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:34:49.211 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-10-25T11:34:53.306 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-25T11:34:55.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:34:57.402 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-25T11:34:58.266 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-10-25T11:34:59.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:02.362 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-25T11:35:03.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:04.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:06.458 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-25T11:35:07.322 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-10-25T11:35:08.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:11.422 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-25T11:35:12.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:13.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:15.515 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-25T11:35:16.378 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-10-25T11:35:17.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:20.506 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-25T11:35:21.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:22.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:24.570 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-25T11:35:26.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:30.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:33.630 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-25T11:35:39.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:42.718 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-25T11:35:45.022 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-25T11:35:48.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:51.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:35:54.106 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-10-25T11:36:00.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:36:02.421 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T11:36:02.422 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T11:36:21.047 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T11:36:21.048 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T11:36:22.383 WARNING:teuthology.provision.fog.smithi170:timed out 2023-10-25T11:36:24.233 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-10-25T11:36:24.234 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-10-25T11:36:24.240 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2023-10-25T11:36:24.241 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2023-10-25T11:36:24.291 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2023-10-25T11:36:24.291 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-10-25T11:36:24.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2023-10-25T11:36:24.374 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2023-10-25T11:36:24.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2023-10-25T11:36:24.407 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-10-25T11:36:24.418 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-10-25T11:36:24.424 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-10-25T11:36:24.424 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-25T11:36:24.424 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-10-25T11:36:24.425 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-10-25T11:36:24.425 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-25T11:36:24.426 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-10-25T11:36:24.426 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-25T11:36:24.426 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-25T11:36:24.426 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-25T11:36:24.427 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-25T11:36:24.427 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-10-25T11:36:24.427 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-10-25T11:36:24.428 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-10-25T11:36:24.429 DEBUG:teuthology.parallel:result is None 2023-10-25T11:36:28.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:36:28.599 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T11:36:28.599 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-25T11:36:29.120 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-10-25T11:36:29.120 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-10-25T11:36:29.127 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2023-10-25T11:36:29.127 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2023-10-25T11:36:29.175 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2023-10-25T11:36:29.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-10-25T11:36:29.307 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2023-10-25T11:36:29.325 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-10-25T11:36:29.383 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2023-10-25T11:36:29.397 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-10-25T11:36:29.413 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-10-25T11:36:29.419 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2023-10-25T11:36:29.419 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-25T11:36:29.419 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2023-10-25T11:36:29.419 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2023-10-25T11:36:29.420 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-25T11:36:29.420 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="20.04" 2023-10-25T11:36:29.420 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-25T11:36:29.420 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-25T11:36:29.420 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-25T11:36:29.421 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-25T11:36:29.421 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=focal 2023-10-25T11:36:29.421 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=focal 2023-10-25T11:36:29.421 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-10-25T11:36:29.422 DEBUG:teuthology.parallel:result is None 2023-10-25T11:36:41.857 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-10-25T11:36:41.857 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-10-25T11:36:41.864 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-10-25T11:36:41.864 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-10-25T11:36:41.872 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-10-25T11:36:41.872 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-25T11:36:41.997 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-10-25T11:36:42.013 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-10-25T11:36:42.028 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-10-25T11:36:42.088 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-25T11:36:42.098 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-25T11:36:42.103 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-10-25T11:36:42.104 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-25T11:36:42.104 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-10-25T11:36:42.104 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-10-25T11:36:42.104 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-25T11:36:42.104 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="20.04" 2023-10-25T11:36:42.105 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-25T11:36:42.105 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-25T11:36:42.105 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-25T11:36:42.105 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-25T11:36:42.105 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=focal 2023-10-25T11:36:42.106 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=focal 2023-10-25T11:36:42.106 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-10-25T11:36:42.106 DEBUG:teuthology.parallel:result is None 2023-10-25T11:36:42.393 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-10-25T11:36:42.394 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T11:36:42.419 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-10-25T11:36:42.419 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T11:36:42.435 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-10-25T11:36:42.435 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-25T11:36:42.453 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-10-25T11:36:42.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-25T11:36:42.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:36:42.510 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-10-25T11:36:42.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-10-25T11:36:42.712 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-10-25T11:36:42.718 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-10-25T11:36:42.718 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-10-25T11:36:42.723 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-10-25T11:36:42.724 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-25T11:36:42.724 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-10-25T11:36:42.724 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-10-25T11:36:42.724 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-25T11:36:42.724 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-10-25T11:36:42.725 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-25T11:36:42.725 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-25T11:36:42.725 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-25T11:36:42.725 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-25T11:36:42.725 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-10-25T11:36:42.726 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-10-25T11:36:42.726 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-10-25T11:36:42.752 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-10-25T11:36:42.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-25T11:36:42.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:36:42.800 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-10-25T11:36:42.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-25T11:36:42.924 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-10-25T11:36:42.930 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-10-25T11:36:42.931 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-25T11:36:42.937 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-10-25T11:36:42.937 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-25T11:36:42.938 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-10-25T11:36:42.938 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-10-25T11:36:42.938 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-25T11:36:42.938 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="20.04" 2023-10-25T11:36:42.938 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-25T11:36:42.939 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-25T11:36:42.939 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-25T11:36:42.939 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-25T11:36:42.939 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=focal 2023-10-25T11:36:42.939 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=focal 2023-10-25T11:36:42.940 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-25T11:36:42.968 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-10-25T11:36:42.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-25T11:36:42.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T11:36:43.018 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-10-25T11:36:43.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-25T11:36:43.220 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-10-25T11:36:43.226 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-10-25T11:36:43.226 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-10-25T11:36:43.232 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2023-10-25T11:36:43.233 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-25T11:36:43.233 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2023-10-25T11:36:43.233 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2023-10-25T11:36:43.233 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-25T11:36:43.234 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="20.04" 2023-10-25T11:36:43.234 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-25T11:36:43.234 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-25T11:36:43.234 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-25T11:36:43.234 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-25T11:36:43.235 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=focal 2023-10-25T11:36:43.235 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=focal 2023-10-25T11:36:43.235 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-10-25T11:36:43.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:36:43.365 INFO:teuthology.dispatcher.supervisor:Running job 7436895 2023-10-25T11:36:43.366 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-10-25_11:03:22-upgrade:quincy-p2p:quincy-p2p-stress-split-main-distro-default-smithi/7436895 --name matan-2023-10-25_11:03:22-upgrade:quincy-p2p:quincy-p2p-stress-split-main-distro-default-smithi --description upgrade:quincy-p2p:quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/matan-2023-10-25_11:03:22-upgrade:quincy-p2p:quincy-p2p-stress-split-main-distro-default-smithi/7436895/orig.config.yaml 2023-10-25T11:36:43.369 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-10-25_11:03:22-upgrade:quincy-p2p:quincy-p2p-stress-split-main-distro-default-smithi/7436895 2023-10-25T11:36:43.369 INFO:teuthology.dispatcher.supervisor:Job PID: 1416092 2023-10-25T11:36:43.370 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-25T11:38:43.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:40:43.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:42:43.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:44:43.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:46:44.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:48:44.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:50:44.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:52:44.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:54:44.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:56:44.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T11:58:45.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:00:45.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:02:45.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:04:45.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:06:45.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:08:45.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:10:46.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:12:46.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:14:46.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:16:46.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:18:46.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:20:46.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:22:46.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:24:47.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:26:47.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:28:47.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:30:47.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:32:47.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:34:48.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:36:48.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:38:48.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:40:48.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:42:48.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:44:48.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:46:49.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:48:49.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:50:49.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:52:49.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:54:49.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:56:49.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T12:58:50.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:00:50.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:02:50.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:04:50.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:06:50.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:08:51.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:10:51.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:12:51.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:14:51.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:16:51.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:18:51.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:20:52.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:22:52.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:24:52.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:26:52.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:28:52.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:30:52.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:32:53.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:34:53.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:36:53.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:38:53.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:40:53.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:42:53.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:44:54.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:46:54.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:48:54.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:50:54.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:52:54.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:54:54.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:56:55.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T13:58:55.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:00:55.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:02:55.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:04:55.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:06:55.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:08:56.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:10:56.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:12:56.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:14:56.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:16:56.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:18:56.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:20:57.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:22:57.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:24:57.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:26:57.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:28:57.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:30:57.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:32:58.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:34:58.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T14:34:58.258 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-25T14:34:58.526 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-25T14:34:58.526 INFO:teuthology.nuke:Checking targets against current locks 2023-10-25T14:34:58.584 DEBUG:teuthology.nuke:shortname: smithi133 2023-10-25T14:34:58.585 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T14:34:58.608 DEBUG:teuthology.nuke:shortname: smithi161 2023-10-25T14:34:58.608 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T14:34:58.609 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-25_11:03:22-upgrade:quincy-p2p:quincy-p2p-stress-split-main-distro-default-smithi/7436895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 11:30:38.535945', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-25T14:34:58.636 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-25_11:03:22-upgrade:quincy-p2p:quincy-p2p-stress-split-main-distro-default-smithi/7436895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 11:30:38.537100', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-25T14:34:58.640 DEBUG:teuthology.nuke:shortname: smithi170 2023-10-25T14:34:58.640 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T14:34:58.673 INFO:teuthology.orchestra.console.smithi133:Power off 2023-10-25T14:34:58.674 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T14:34:58.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-10-25_11:03:22-upgrade:quincy-p2p:quincy-p2p-stress-split-main-distro-default-smithi/7436895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 11:30:38.534024', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-25T14:34:58.696 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-10-25T14:34:58.697 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T14:34:58.724 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-25T14:34:58.725 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T14:34:58.732 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-10-25T14:34:58.748 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-25T14:34:58.749 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T14:34:58.763 INFO:teuthology.orchestra.console.smithi170:Power off 2023-10-25T14:34:58.764 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T14:34:58.773 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-25T14:34:58.785 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-10-25T14:34:58.785 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T14:34:58.808 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-10-25T14:34:58.834 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-10-25T14:34:58.875 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-25T14:34:58.909 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-10-25T14:34:58.992 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2023-10-25T14:34:59.024 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2023-10-25T14:34:59.057 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com