2023-08-23T00:36:14.802 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T00:36:14.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:36:14.945 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faee9754310>, signals=[15]) 2023-08-23T00:36:14.947 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-08-23T00:36:14.947 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T00:36:14.947 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-08-23T00:36:14.972 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-08-23T00:36:14.973 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T00:36:14.973 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-08-23T00:36:14.975 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /host {"name": "smithi146"} 2023-08-23T00:36:14.997 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"} 2023-08-23T00:36:15.051 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-23T00:36:15.073 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-23T00:36:15.092 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-23T00:36:15.093 DEBUG:teuthology.provision.fog.smithi146:FOG request: PUT /host/251 {"imageID": 2} 2023-08-23T00:36:15.114 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-23T00:36:15.114 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 2} 2023-08-23T00:36:15.139 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of ubuntu 20.04 2023-08-23T00:36:15.140 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:36:15.162 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of ubuntu 20.04 2023-08-23T00:36:15.163 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:36:15.194 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T00:36:15.218 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T00:36:15.233 DEBUG:teuthology.provision.fog.smithi146:FOG request: POST /host/251/task {"taskTypeID": 1} 2023-08-23T00:36:15.261 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1} 2023-08-23T00:36:15.289 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:36:15.309 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:36:15.386 INFO:teuthology.orchestra.console.smithi146:Power off 2023-08-23T00:36:15.387 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T00:36:15.406 INFO:teuthology.orchestra.console.smithi160:Power off 2023-08-23T00:36:15.410 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T00:36:15.423 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-08-23T00:36:15.424 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:15.437 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-08-23T00:36:15.437 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:15.450 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-23T00:36:15.463 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-23T00:36:19.456 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:19.464 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:19.566 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-23T00:36:19.576 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-23T00:36:23.568 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:23.579 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:23.681 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-23T00:36:23.689 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-23T00:36:23.783 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-08-23T00:36:23.791 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-08-23T00:36:23.884 INFO:teuthology.orchestra.console.smithi146:Power on 2023-08-23T00:36:23.885 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T00:36:23.893 INFO:teuthology.orchestra.console.smithi160:Power on 2023-08-23T00:36:23.893 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T00:36:23.905 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2023-08-23T00:36:23.906 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:23.920 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2023-08-23T00:36:23.921 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:23.931 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-23T00:36:23.942 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-23T00:36:27.936 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:27.945 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:28.047 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-23T00:36:28.056 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-23T00:36:32.052 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:32.062 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:36:32.164 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-23T00:36:32.174 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-23T00:36:32.265 INFO:teuthology.orchestra.console.smithi146:Power on completed 2023-08-23T00:36:32.276 INFO:teuthology.orchestra.console.smithi160:Power on completed 2023-08-23T00:36:32.366 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-08-23T00:36:32.367 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:36:32.377 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-08-23T00:36:32.377 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:36:47.480 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:36:47.483 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:37:02.578 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:37:02.580 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:37:17.704 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:37:17.706 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:37:32.816 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:37:32.818 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:37:47.921 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:37:47.923 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:38:03.048 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:38:03.050 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:38:18.160 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:38:18.162 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:38:33.280 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:38:33.282 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:38:48.388 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:38:48.389 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:39:03.484 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:39:03.485 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:39:18.596 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:39:18.599 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:39:33.680 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:39:33.681 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:39:48.751 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:39:48.753 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:40:03.828 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:40:03.829 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:40:18.907 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T00:40:18.908 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-08-23T00:40:18.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:18.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:22.033 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-23T00:40:22.034 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:40:28.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:28.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:31.120 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-23T00:40:31.121 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:40:37.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:37.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:40.176 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-23T00:40:40.177 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:40:46.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:46.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:49.264 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-23T00:40:49.265 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:40:55.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:55.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:40:58.320 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-23T00:40:58.321 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:41:04.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:04.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:07.376 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:41:07.377 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-23T00:41:13.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:13.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:16.432 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:41:16.468 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-23T00:41:22.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:22.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:32.788 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:41:38.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:41.872 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:41:47.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:50.928 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T00:41:56.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:41:57.619 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T00:41:57.620 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T00:42:13.393 INFO:teuthology.provision.fog.smithi160:Node is ready 2023-08-23T00:42:13.393 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2023-08-23T00:42:13.400 INFO:teuthology.orchestra.run.smithi160.stdout:smithi129 2023-08-23T00:42:13.401 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi129 /etc/hosts 2023-08-23T00:42:13.408 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.129 smithi129 smithi129 2023-08-23T00:42:13.409 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-08-23T00:42:13.496 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi129/smithi160/g' /etc/hosts 2023-08-23T00:42:13.517 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.129/172.21.15.160/g' /etc/hosts 2023-08-23T00:42:13.531 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi129/smithi160/g' /etc/hostname 2023-08-23T00:42:13.542 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-08-23T00:42:13.597 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-08-23T00:42:13.604 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2023-08-23T00:42:13.604 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-23T00:42:13.604 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2023-08-23T00:42:13.604 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2023-08-23T00:42:13.604 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-23T00:42:13.605 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="20.04" 2023-08-23T00:42:13.605 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T00:42:13.605 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T00:42:13.605 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T00:42:13.605 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T00:42:13.605 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=focal 2023-08-23T00:42:13.605 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=focal 2023-08-23T00:42:13.606 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2023-08-23T00:42:13.607 DEBUG:teuthology.parallel:result is None 2023-08-23T00:42:22.472 WARNING:teuthology.provision.fog.smithi146:timed out 2023-08-23T00:42:28.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:42:28.687 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T00:42:28.688 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T00:42:29.237 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-08-23T00:42:29.238 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2023-08-23T00:42:29.244 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-08-23T00:42:29.245 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2023-08-23T00:42:29.292 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-08-23T00:42:29.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-08-23T00:42:29.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2023-08-23T00:42:29.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2023-08-23T00:42:29.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2023-08-23T00:42:29.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-08-23T00:42:29.491 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-08-23T00:42:29.544 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2023-08-23T00:42:29.544 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-23T00:42:29.544 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2023-08-23T00:42:29.544 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2023-08-23T00:42:29.545 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-23T00:42:29.545 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="20.04" 2023-08-23T00:42:29.545 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T00:42:29.545 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T00:42:29.545 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T00:42:29.546 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T00:42:29.546 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=focal 2023-08-23T00:42:29.546 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=focal 2023-08-23T00:42:29.546 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-08-23T00:42:29.547 DEBUG:teuthology.parallel:result is None 2023-08-23T00:42:29.796 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-08-23T00:42:29.797 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T00:42:29.825 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2023-08-23T00:42:29.825 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T00:42:29.843 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-08-23T00:42:29.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-23T00:42:29.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:42:29.893 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-08-23T00:42:30.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-23T00:42:30.018 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-08-23T00:42:30.024 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-08-23T00:42:30.024 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-08-23T00:42:30.029 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2023-08-23T00:42:30.029 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-23T00:42:30.029 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2023-08-23T00:42:30.029 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2023-08-23T00:42:30.029 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-23T00:42:30.029 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="20.04" 2023-08-23T00:42:30.030 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T00:42:30.030 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T00:42:30.030 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T00:42:30.030 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T00:42:30.030 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=focal 2023-08-23T00:42:30.030 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=focal 2023-08-23T00:42:30.031 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-08-23T00:42:30.050 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2023-08-23T00:42:30.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-08-23T00:42:30.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:42:30.103 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-08-23T00:42:30.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-08-23T00:42:30.230 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-08-23T00:42:30.236 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-08-23T00:42:30.237 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-08-23T00:42:30.243 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2023-08-23T00:42:30.243 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-23T00:42:30.243 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2023-08-23T00:42:30.243 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2023-08-23T00:42:30.243 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-23T00:42:30.243 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="20.04" 2023-08-23T00:42:30.244 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T00:42:30.244 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T00:42:30.244 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T00:42:30.244 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T00:42:30.244 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=focal 2023-08-23T00:42:30.244 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=focal 2023-08-23T00:42:30.245 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-08-23T00:42:30.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:42:30.383 INFO:teuthology.dispatcher.supervisor:Running job 7376972 2023-08-23T00:42:30.384 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-22_18:27:27-upgrade:reef-x-main-distro-default-smithi/7376972 --name yuriw-2023-08-22_18:27:27-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/yuriw-2023-08-22_18:27:27-upgrade:reef-x-main-distro-default-smithi/7376972/orig.config.yaml 2023-08-23T00:42:30.387 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-22_18:27:27-upgrade:reef-x-main-distro-default-smithi/7376972 2023-08-23T00:42:30.389 INFO:teuthology.dispatcher.supervisor:Job PID: 29821 2023-08-23T00:42:30.389 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-23T00:44:30.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:46:30.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:48:30.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:50:30.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:52:31.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:54:31.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:54:31.370 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-23T00:54:31.505 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-23T00:54:31.506 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T00:54:31.561 DEBUG:teuthology.nuke:shortname: smithi146 2023-08-23T00:54:31.561 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T00:54:31.586 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-22_18:27:27-upgrade:reef-x-main-distro-default-smithi/7376972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 00:36:13.871820', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-23T00:54:31.590 DEBUG:teuthology.nuke:shortname: smithi160 2023-08-23T00:54:31.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T00:54:31.615 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-22_18:27:27-upgrade:reef-x-main-distro-default-smithi/7376972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 00:36:13.873242', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-23T00:54:31.651 INFO:teuthology.orchestra.console.smithi146:Power off 2023-08-23T00:54:31.652 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T00:54:31.678 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-08-23T00:54:31.679 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:54:31.701 INFO:teuthology.orchestra.console.smithi160:Power off 2023-08-23T00:54:31.702 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T00:54:31.713 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-23T00:54:31.725 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-08-23T00:54:31.726 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:54:31.748 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-23T00:54:31.815 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-08-23T00:54:31.850 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-08-23T00:54:31.968 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2023-08-23T00:54:32.001 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com