2023-07-21T18:06:37.259 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T18:06:37.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:06:37.261 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:06:57.445 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f356356e8b0>, signals=[15]) 2023-07-21T18:06:57.448 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-07-21T18:06:57.449 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:06:57.449 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-07-21T18:06:57.480 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2023-07-21T18:06:57.480 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:06:57.480 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-07-21T18:06:57.482 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-07-21T18:06:57.503 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /host {"name": "smithi196"} 2023-07-21T18:06:57.552 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-21T18:06:57.570 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-21T18:06:57.603 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-21T18:06:57.604 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 2} 2023-07-21T18:06:57.606 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-21T18:06:57.606 DEBUG:teuthology.provision.fog.smithi196:FOG request: PUT /host/301 {"imageID": 2} 2023-07-21T18:06:57.645 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of ubuntu 20.04 2023-07-21T18:06:57.645 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:06:57.655 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 20.04 2023-07-21T18:06:57.655 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:06:57.695 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:06:57.712 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:06:57.729 DEBUG:teuthology.provision.fog.smithi196:FOG request: POST /host/301/task {"taskTypeID": 1} 2023-07-21T18:06:57.744 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-07-21T18:06:57.773 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:06:57.790 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:06:57.871 INFO:teuthology.orchestra.console:Power off smithi196 2023-07-21T18:06:57.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:06:57.887 INFO:teuthology.orchestra.console:Power off smithi107 2023-07-21T18:06:57.887 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:06:57.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:06:57.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:06:58.029 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2023-07-21T18:06:58.130 INFO:teuthology.orchestra.console:Power on smithi107 2023-07-21T18:06:58.131 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:06:58.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:01.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:02.173 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:07.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:07.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:12.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:12.398 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:12.608 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2023-07-21T18:07:12.709 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-07-21T18:07:12.709 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:07:17.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:22.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:27.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:27.690 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2023-07-21T18:07:27.774 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:07:32.781 INFO:teuthology.orchestra.console:Power on smithi196 2023-07-21T18:07:32.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:07:37.806 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:42.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:07:43.026 INFO:teuthology.orchestra.console:Power on for smithi196 completed 2023-07-21T18:07:43.129 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2023-07-21T18:07:43.129 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:07:47.849 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:07:58.205 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:08:07.916 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:08:18.277 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:08:23.561 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:08:33.342 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:08:43.644 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:08:48.412 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:08:58.716 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:09:08.480 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:09:13.789 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:09:28.352 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:09:33.309 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:09:53.409 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:09:53.410 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:10:18.492 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:10:18.493 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:10:46.852 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-21T18:10:46.853 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:10:46.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:10:50.000 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-21T18:10:56.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:10:59.056 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-21T18:11:01.928 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:11:06.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:11:14.992 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-21T18:11:20.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:11:26.998 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None 2023-07-21T18:11:32.005 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-21T18:11:32.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:11:38.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:11:43.013 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-07-21T18:11:46.064 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-21T18:11:49.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:11:52.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:11:52.080 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-07-21T18:11:58.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:12:01.140 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-07-21T18:12:07.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:12:10.224 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-07-21T18:12:16.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:12:52.099 WARNING:teuthology.provision.fog.smithi107:timed out 2023-07-21T18:12:53.936 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T18:12:53.937 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T18:12:58.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:12:58.321 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T18:12:58.321 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T18:12:58.855 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-07-21T18:12:58.855 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-07-21T18:12:58.861 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-07-21T18:12:58.862 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-07-21T18:12:58.869 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-07-21T18:12:58.869 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-07-21T18:12:58.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-07-21T18:12:59.006 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-07-21T18:12:59.023 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-07-21T18:12:59.039 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-07-21T18:12:59.053 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-07-21T18:12:59.100 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-07-21T18:12:59.100 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T18:12:59.100 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-07-21T18:12:59.100 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-07-21T18:12:59.100 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T18:12:59.101 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04" 2023-07-21T18:12:59.101 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T18:12:59.101 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T18:12:59.101 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T18:12:59.101 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T18:12:59.101 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal 2023-07-21T18:12:59.102 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal 2023-07-21T18:12:59.102 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-07-21T18:12:59.104 DEBUG:teuthology.parallel:result is None 2023-07-21T18:13:15.443 INFO:teuthology.provision.fog.smithi196:Node is ready 2023-07-21T18:13:15.444 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2023-07-21T18:13:15.450 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2023-07-21T18:13:15.450 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2023-07-21T18:13:15.501 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2023-07-21T18:13:15.501 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-07-21T18:13:15.563 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2023-07-21T18:13:15.579 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2023-07-21T18:13:15.593 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2023-07-21T18:13:15.604 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2023-07-21T18:13:15.660 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-07-21T18:13:15.666 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2023-07-21T18:13:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T18:13:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2023-07-21T18:13:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2023-07-21T18:13:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T18:13:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="20.04" 2023-07-21T18:13:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T18:13:15.668 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T18:13:15.668 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T18:13:15.668 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T18:13:15.668 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=focal 2023-07-21T18:13:15.668 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=focal 2023-07-21T18:13:15.668 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2023-07-21T18:13:15.669 DEBUG:teuthology.parallel:result is None 2023-07-21T18:13:20.897 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-07-21T18:13:20.898 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T18:13:25.931 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com 2023-07-21T18:13:25.932 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T18:13:30.966 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-07-21T18:13:30.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-07-21T18:13:30.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:13:36.018 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-07-21T18:13:36.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-07-21T18:13:36.222 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-07-21T18:13:36.228 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-07-21T18:13:36.229 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-07-21T18:13:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-07-21T18:13:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T18:13:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-07-21T18:13:36.236 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-07-21T18:13:36.236 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T18:13:36.236 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04" 2023-07-21T18:13:36.236 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T18:13:36.236 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T18:13:36.236 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T18:13:36.236 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T18:13:36.237 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal 2023-07-21T18:13:36.237 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal 2023-07-21T18:13:36.237 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-07-21T18:13:36.264 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server 2023-07-21T18:13:36.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-07-21T18:13:36.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:13:36.313 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-07-21T18:13:36.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-07-21T18:13:36.522 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2023-07-21T18:13:36.528 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2023-07-21T18:13:36.528 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-07-21T18:13:36.534 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2023-07-21T18:13:36.534 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-21T18:13:36.535 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2023-07-21T18:13:36.535 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2023-07-21T18:13:36.535 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-21T18:13:36.535 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="20.04" 2023-07-21T18:13:36.535 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T18:13:36.535 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T18:13:36.535 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T18:13:36.536 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T18:13:36.536 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=focal 2023-07-21T18:13:36.536 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=focal 2023-07-21T18:13:36.536 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-07-21T18:13:36.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:13:36.556 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:13:36.653 INFO:teuthology.dispatcher.supervisor:Running job 7346862 2023-07-21T18:13:36.654 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346862 --name rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} -- /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346862/orig.config.yaml 2023-07-21T18:13:36.658 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346862 2023-07-21T18:13:36.658 INFO:teuthology.dispatcher.supervisor:Job PID: 1613 2023-07-21T18:13:36.659 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T18:15:36.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:15:36.752 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:17:41.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:17:41.877 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:19:47.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:19:47.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:21:52.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:21:52.218 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:23:57.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:23:57.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:26:02.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:26:02.554 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:28:06.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:28:06.666 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:30:11.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:30:11.850 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:32:17.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:32:17.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:34:22.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:34:22.210 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:36:27.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:36:27.355 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:38:29.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:38:29.102 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:40:29.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:40:29.779 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:42:34.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:42:34.961 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:44:40.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:44:40.145 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:46:43.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:46:43.991 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:48:45.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:48:45.076 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:50:45.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:50:45.250 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:52:45.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:52:45.430 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:52:45.506 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T18:52:45.634 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T18:52:45.635 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T18:52:45.687 DEBUG:teuthology.nuke:shortname: smithi107 2023-07-21T18:52:45.688 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T18:52:45.714 DEBUG:teuthology.nuke:shortname: smithi196 2023-07-21T18:52:45.715 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T18:52:45.718 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:06:36.197262', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-21T18:52:45.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:06:36.195133', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-21T18:52:45.777 INFO:teuthology.orchestra.console:Power off smithi107 2023-07-21T18:52:45.778 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:52:45.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:52:45.831 INFO:teuthology.orchestra.console:Power off smithi196 2023-07-21T18:52:45.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:52:45.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:52:45.925 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2023-07-21T18:52:45.974 INFO:teuthology.orchestra.console:Power off for smithi196 completed 2023-07-21T18:52:46.087 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-07-21T18:52:46.120 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com