2023-07-18T02:42:39.341 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-18T02:42:39.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:42:39.344 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:42:39.501 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd96b31e50>, signals=[15]) 2023-07-18T02:42:39.503 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2023-07-18T02:42:39.504 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T02:42:39.504 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-07-18T02:42:39.527 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-07-18T02:42:39.527 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T02:42:39.528 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-07-18T02:42:39.529 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /host {"name": "smithi137"} 2023-07-18T02:42:39.552 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-07-18T02:42:39.612 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-18T02:42:39.623 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-18T02:42:39.660 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-18T02:42:39.660 DEBUG:teuthology.provision.fog.smithi137:FOG request: PUT /host/242 {"imageID": 2} 2023-07-18T02:42:39.670 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-18T02:42:39.671 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 2} 2023-07-18T02:42:39.757 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of ubuntu 20.04 2023-07-18T02:42:39.758 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:42:39.761 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of ubuntu 20.04 2023-07-18T02:42:39.761 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:42:39.805 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T02:42:39.808 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T02:42:39.844 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-07-18T02:42:39.846 DEBUG:teuthology.provision.fog.smithi137:FOG request: POST /host/242/task {"taskTypeID": 1} 2023-07-18T02:42:39.904 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:42:39.924 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:42:39.994 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-18T02:42:39.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T02:42:40.011 INFO:teuthology.orchestra.console:Power off smithi188 2023-07-18T02:42:40.013 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T02:42:40.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:40.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:44.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:44.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:49.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:49.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:49.389 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-07-18T02:42:49.490 INFO:teuthology.orchestra.console:Power on smithi188 2023-07-18T02:42:49.491 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T02:42:54.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:54.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:59.395 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:59.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:42:59.607 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-18T02:42:59.708 INFO:teuthology.orchestra.console:Power on smithi137 2023-07-18T02:42:59.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T02:43:04.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:43:04.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:43:09.752 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:43:09.762 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:43:09.965 INFO:teuthology.orchestra.console:Power on for smithi137 completed 2023-07-18T02:43:10.066 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2023-07-18T02:43:10.066 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:43:14.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:43:19.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:43:25.102 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:43:25.126 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:43:30.235 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2023-07-18T02:43:30.335 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-07-18T02:43:30.336 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:43:45.349 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:44:05.420 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:44:05.422 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:44:20.492 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:44:20.493 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:44:35.560 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:44:35.561 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:44:55.641 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:44:55.642 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:45:11.720 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:45:11.722 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:45:36.796 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:45:36.798 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:46:01.880 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:46:01.882 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:46:16.956 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:46:16.957 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:46:38.128 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-18T02:46:38.130 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-18T02:46:48.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:46:53.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:46:58.220 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-18T02:47:01.296 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-07-18T02:47:04.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:47:07.280 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-18T02:47:07.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:47:10.352 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-07-18T02:47:13.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:47:18.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:47:21.360 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-18T02:47:21.364 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-07-18T02:47:27.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:47:32.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:47:37.380 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-18T02:47:40.432 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-07-18T02:47:43.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:47:46.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:48:43.440 WARNING:teuthology.provision.fog.smithi137:timed out 2023-07-18T02:48:46.440 WARNING:teuthology.provision.fog.smithi188:timed out 2023-07-18T02:48:49.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:48:54.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:48:59.637 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T02:48:59.638 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T02:48:59.673 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T02:48:59.673 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T02:49:00.152 INFO:teuthology.provision.fog.smithi137:Node is ready 2023-07-18T02:49:00.152 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2023-07-18T02:49:00.196 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-07-18T02:49:00.196 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-07-18T02:49:00.200 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2023-07-18T02:49:00.200 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2023-07-18T02:49:00.202 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-07-18T02:49:00.202 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-07-18T02:49:00.207 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2023-07-18T02:49:00.208 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-07-18T02:49:00.252 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-07-18T02:49:00.252 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-07-18T02:49:00.323 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2023-07-18T02:49:00.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2023-07-18T02:49:00.353 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2023-07-18T02:49:00.355 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-07-18T02:49:00.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-07-18T02:49:00.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-07-18T02:49:00.427 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-07-18T02:49:00.429 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-07-18T02:49:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2023-07-18T02:49:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-18T02:49:00.433 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2023-07-18T02:49:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2023-07-18T02:49:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-18T02:49:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="20.04" 2023-07-18T02:49:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-18T02:49:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-18T02:49:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-18T02:49:00.434 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-18T02:49:00.435 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=focal 2023-07-18T02:49:00.435 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=focal 2023-07-18T02:49:00.435 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2023-07-18T02:49:00.437 DEBUG:teuthology.parallel:result is None 2023-07-18T02:49:00.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-07-18T02:49:00.457 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-07-18T02:49:00.462 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2023-07-18T02:49:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-18T02:49:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2023-07-18T02:49:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2023-07-18T02:49:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-18T02:49:00.463 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="20.04" 2023-07-18T02:49:00.464 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-18T02:49:00.464 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-18T02:49:00.464 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-18T02:49:00.464 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-18T02:49:00.464 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=focal 2023-07-18T02:49:00.464 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=focal 2023-07-18T02:49:00.465 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-07-18T02:49:00.465 DEBUG:teuthology.parallel:result is None 2023-07-18T02:49:05.688 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2023-07-18T02:49:05.689 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-07-18T02:49:05.689 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T02:49:05.719 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2023-07-18T02:49:05.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-18T02:49:05.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:49:05.769 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-07-18T02:49:05.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-18T02:49:05.898 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2023-07-18T02:49:05.944 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2023-07-18T02:49:05.945 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-07-18T02:49:05.951 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2023-07-18T02:49:05.951 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-18T02:49:05.952 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2023-07-18T02:49:05.952 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2023-07-18T02:49:05.952 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-18T02:49:05.952 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="20.04" 2023-07-18T02:49:05.952 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-18T02:49:05.952 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-18T02:49:05.953 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-18T02:49:05.953 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-18T02:49:05.953 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=focal 2023-07-18T02:49:05.953 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=focal 2023-07-18T02:49:05.954 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-07-18T02:49:05.976 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-07-18T02:49:05.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-07-18T02:49:05.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:49:06.026 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-07-18T02:49:06.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-07-18T02:49:06.142 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-07-18T02:49:06.149 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-07-18T02:49:06.149 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-07-18T02:49:06.154 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Ubuntu" 2023-07-18T02:49:06.155 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-18T02:49:06.155 INFO:teuthology.orchestra.run.smithi188.stdout:ID=ubuntu 2023-07-18T02:49:06.155 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE=debian 2023-07-18T02:49:06.155 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-18T02:49:06.156 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="20.04" 2023-07-18T02:49:06.156 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-18T02:49:06.156 INFO:teuthology.orchestra.run.smithi188.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-18T02:49:06.157 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-18T02:49:06.157 INFO:teuthology.orchestra.run.smithi188.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-18T02:49:06.157 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_CODENAME=focal 2023-07-18T02:49:06.157 INFO:teuthology.orchestra.run.smithi188.stdout:UBUNTU_CODENAME=focal 2023-07-18T02:49:06.158 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-07-18T02:49:06.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:49:06.185 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:49:06.282 INFO:teuthology.dispatcher.supervisor:Running job 7342730 2023-07-18T02:49:06.283 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342730 --name rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} -- /home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342730/orig.config.yaml 2023-07-18T02:49:06.286 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342730 2023-07-18T02:49:06.287 INFO:teuthology.dispatcher.supervisor:Job PID: 18173 2023-07-18T02:49:06.287 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-18T02:51:06.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:51:06.387 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:53:11.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:53:11.155 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:55:16.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:55:16.341 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:57:16.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:57:16.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:59:16.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:59:16.694 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:01:16.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:01:16.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:03:17.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:03:17.029 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:05:17.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:05:17.207 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:07:17.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:07:17.393 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:09:17.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:09:17.569 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:11:19.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:11:19.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:13:19.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:13:19.603 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:15:19.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:15:19.785 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:17:19.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:17:19.970 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:17:20.044 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-18T03:17:20.210 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-18T03:17:20.211 INFO:teuthology.nuke:Checking targets against current locks 2023-07-18T03:17:20.267 DEBUG:teuthology.nuke:shortname: smithi137 2023-07-18T03:17:20.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T03:17:20.291 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 02:42:33.859527', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-18T03:17:20.295 DEBUG:teuthology.nuke:shortname: smithi188 2023-07-18T03:17:20.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T03:17:20.315 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 02:42:33.861627', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-18T03:17:20.343 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-18T03:17:20.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T03:17:20.365 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T03:17:20.386 INFO:teuthology.orchestra.console:Power off smithi188 2023-07-18T03:17:20.387 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T03:17:20.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T03:17:20.495 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-18T03:17:20.526 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-07-18T03:17:20.652 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com 2023-07-18T03:17:20.685 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com