2023-08-23T02:29:12.288 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T02:29:12.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:29:12.436 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd05ab3ef70>, signals=[15]) 2023-08-23T02:29:12.438 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-08-23T02:29:12.438 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T02:29:12.438 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-23T02:29:12.461 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-08-23T02:29:12.461 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T02:29:12.462 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-08-23T02:29:12.463 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-08-23T02:29:12.487 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"} 2023-08-23T02:29:12.539 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-23T02:29:12.552 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-23T02:29:12.581 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-23T02:29:12.582 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 6} 2023-08-23T02:29:12.603 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-23T02:29:12.603 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 6} 2023-08-23T02:29:12.620 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 22.04 2023-08-23T02:29:12.620 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:29:12.645 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of ubuntu 22.04 2023-08-23T02:29:12.645 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:29:12.668 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T02:29:12.690 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T02:29:12.700 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-08-23T02:29:12.729 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1} 2023-08-23T02:29:12.745 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:29:12.780 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:29:12.826 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-23T02:29:12.827 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T02:29:12.848 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-23T02:29:12.849 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:12.867 INFO:teuthology.orchestra.console.smithi160:Power off 2023-08-23T02:29:12.868 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T02:29:12.878 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-23T02:29:12.891 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-08-23T02:29:12.891 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:12.913 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-23T02:29:16.880 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:16.914 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:16.993 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-23T02:29:17.025 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-23T02:29:20.996 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:21.026 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:21.106 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-23T02:29:21.137 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-23T02:29:21.238 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-08-23T02:29:21.339 INFO:teuthology.orchestra.console.smithi160:Power on 2023-08-23T02:29:21.339 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T02:29:21.361 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2023-08-23T02:29:21.362 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:21.383 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-23T02:29:25.108 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:25.218 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-23T02:29:25.319 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-23T02:29:25.384 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:25.420 INFO:teuthology.orchestra.console.smithi098:Power on 2023-08-23T02:29:25.421 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T02:29:25.440 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-08-23T02:29:25.441 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:25.461 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-23T02:29:25.494 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-23T02:29:29.464 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:29.496 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T02:29:29.574 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-23T02:29:29.640 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-23T02:29:29.675 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-08-23T02:29:29.741 INFO:teuthology.orchestra.console.smithi160:Power on completed 2023-08-23T02:29:29.776 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-08-23T02:29:29.776 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:29:29.842 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-08-23T02:29:29.843 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:29:44.858 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:29:44.919 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:29:59.940 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:29:59.990 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:30:15.027 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:30:15.057 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:30:30.112 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:30:30.127 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:30:45.200 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:30:45.204 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:31:00.292 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:31:00.293 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:31:15.396 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:31:15.397 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:31:30.504 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:31:30.505 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:31:45.632 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:31:45.634 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:32:00.753 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:32:00.755 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:32:15.860 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:32:15.861 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:32:30.957 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:32:30.958 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:32:46.052 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-23T02:32:46.054 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-23T02:32:46.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:32:46.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:32:49.200 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:32:49.201 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-23T02:32:55.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:32:55.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:32:58.256 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:32:58.257 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-23T02:33:04.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:04.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:07.312 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:33:07.344 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-23T02:33:13.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:13.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:16.400 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:33:16.401 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-23T02:33:22.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:22.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:25.456 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:33:25.457 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-23T02:33:31.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:31.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:34.512 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:33:34.516 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-23T02:33:40.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:40.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:33:43.568 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:33:49.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:08.112 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:34:14.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:17.172 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:34:23.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:26.257 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:34:32.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:32.266 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:34:38.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:38.273 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:34:40.520 WARNING:teuthology.provision.fog.smithi098:timed out 2023-08-23T02:34:44.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:44.277 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:34:46.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:46.795 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T02:34:46.796 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T02:34:47.216 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-08-23T02:34:47.217 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-08-23T02:34:47.265 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-08-23T02:34:47.266 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-08-23T02:34:47.313 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-08-23T02:34:47.314 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-23T02:34:47.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-08-23T02:34:47.458 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-08-23T02:34:47.513 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-08-23T02:34:47.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-23T02:34:47.628 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-23T02:34:47.676 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-23T02:34:47.677 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-08-23T02:34:47.677 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2023-08-23T02:34:47.677 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-23T02:34:47.677 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2023-08-23T02:34:47.677 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-08-23T02:34:47.678 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-08-23T02:34:47.678 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T02:34:47.678 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T02:34:47.678 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T02:34:47.678 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T02:34:47.678 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2023-08-23T02:34:47.679 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-08-23T02:34:47.680 DEBUG:teuthology.parallel:result is None 2023-08-23T02:34:50.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:50.282 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-23T02:34:56.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:56.541 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T02:34:56.542 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T02:34:57.119 INFO:teuthology.provision.fog.smithi160:Node is ready 2023-08-23T02:34:57.119 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2023-08-23T02:34:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2023-08-23T02:34:57.166 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2023-08-23T02:34:57.217 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2023-08-23T02:34:57.218 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-08-23T02:34:57.366 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2023-08-23T02:34:57.379 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2023-08-23T02:34:57.434 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2023-08-23T02:34:57.489 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-08-23T02:34:57.544 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-08-23T02:34:57.591 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-23T02:34:57.592 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2023-08-23T02:34:57.592 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2023-08-23T02:34:57.592 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-23T02:34:57.592 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2023-08-23T02:34:57.592 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2023-08-23T02:34:57.593 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2023-08-23T02:34:57.593 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T02:34:57.593 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T02:34:57.593 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T02:34:57.593 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T02:34:57.594 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2023-08-23T02:34:57.594 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2023-08-23T02:34:57.594 DEBUG:teuthology.parallel:result is None 2023-08-23T02:34:57.757 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-08-23T02:34:57.758 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T02:34:57.783 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2023-08-23T02:34:57.783 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T02:34:57.809 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-08-23T02:34:57.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-23T02:34:57.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:57.882 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-08-23T02:34:57.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-23T02:34:57.985 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-08-23T02:34:58.032 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-08-23T02:34:58.033 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-23T02:34:58.082 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-23T02:34:58.083 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-08-23T02:34:58.083 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2023-08-23T02:34:58.083 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-23T02:34:58.084 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2023-08-23T02:34:58.084 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-08-23T02:34:58.084 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-08-23T02:34:58.084 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T02:34:58.085 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T02:34:58.085 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T02:34:58.085 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T02:34:58.085 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2023-08-23T02:34:58.086 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-23T02:34:58.108 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2023-08-23T02:34:58.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-08-23T02:34:58.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T02:34:58.245 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-08-23T02:34:58.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-08-23T02:34:58.349 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-08-23T02:34:58.393 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-08-23T02:34:58.394 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-08-23T02:34:58.441 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-23T02:34:58.442 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2023-08-23T02:34:58.442 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2023-08-23T02:34:58.442 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-23T02:34:58.442 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2023-08-23T02:34:58.442 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2023-08-23T02:34:58.442 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2023-08-23T02:34:58.443 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T02:34:58.443 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T02:34:58.443 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T02:34:58.443 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T02:34:58.443 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2023-08-23T02:34:58.444 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-08-23T02:34:58.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:34:58.563 INFO:teuthology.dispatcher.supervisor:Running job 7376139 2023-08-23T02:34:58.564 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376139 --name mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376139/orig.config.yaml 2023-08-23T02:34:58.568 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376139 2023-08-23T02:34:58.569 INFO:teuthology.dispatcher.supervisor:Job PID: 9334 2023-08-23T02:34:58.569 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-23T02:36:58.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:38:58.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:40:59.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:42:59.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:44:59.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:46:59.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:48:59.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:50:59.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:53:00.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:55:00.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:57:00.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T02:59:00.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:01:00.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:03:00.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:05:01.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:07:01.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:09:01.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:11:01.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:13:01.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:15:01.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:17:02.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:19:02.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:21:02.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:23:02.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T03:23:02.632 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-23T03:23:02.815 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-23T03:23:02.816 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T03:23:02.861 DEBUG:teuthology.nuke:shortname: smithi098 2023-08-23T03:23:02.862 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T03:23:02.885 DEBUG:teuthology.nuke:shortname: smithi160 2023-08-23T03:23:02.885 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T03:23:02.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376139', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 02:29:11.436479', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwZ1gyU7i9zh5C3x7JiOZ3dn++IaB8IDeuJQuCh1HLel9d1oo/ktH0vHmo6WY3URpA1LLXuQ+HxAj7MJ3JMPw0='} 2023-08-23T03:23:02.911 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-22_11:59:36-rgw-rgw-wip-t62141-valg-supp_i002-distro-default-smithi/7376139', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 02:29:11.438202', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF4JOZuQ1atIR57edEGtbtLzJalbJoOaSbvExIjnmFeu'} 2023-08-23T03:23:02.942 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-23T03:23:02.943 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T03:23:02.966 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-23T03:23:02.966 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:23:02.984 INFO:teuthology.orchestra.console.smithi160:Power off 2023-08-23T03:23:02.985 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T03:23:02.994 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-23T03:23:03.008 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-08-23T03:23:03.009 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T03:23:03.031 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-23T03:23:03.095 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-23T03:23:03.132 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-08-23T03:23:03.249 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-08-23T03:23:03.273 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com