2023-06-25T08:10:03.758 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-25T08:10:03.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:10:03.759 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:10:03.971 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7d996e5af0>, signals=[15]) 2023-06-25T08:10:03.972 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-06-25T08:10:03.973 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-06-25T08:10:03.973 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-06-25T08:10:03.997 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-06-25T08:10:03.997 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-06-25T08:10:03.998 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-06-25T08:10:03.999 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-06-25T08:10:04.022 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-06-25T08:10:04.081 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-25T08:10:04.103 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-25T08:10:04.138 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-25T08:10:04.138 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 2} 2023-06-25T08:10:04.155 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-25T08:10:04.155 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 2} 2023-06-25T08:10:04.184 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of ubuntu 20.04 2023-06-25T08:10:04.184 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:10:04.199 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 20.04 2023-06-25T08:10:04.200 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:10:04.231 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-06-25T08:10:04.265 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-06-25T08:10:04.269 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-06-25T08:10:04.303 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-06-25T08:10:04.321 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:10:04.404 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:10:04.586 INFO:teuthology.orchestra.console:Power off smithi139 2023-06-25T08:10:04.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-25T08:10:04.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:04.637 INFO:teuthology.orchestra.console:Power off smithi149 2023-06-25T08:10:04.637 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-25T08:10:04.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:08.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:08.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:12.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:12.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:12.975 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-06-25T08:10:13.011 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-06-25T08:10:13.077 INFO:teuthology.orchestra.console:Power on smithi139 2023-06-25T08:10:13.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-25T08:10:13.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:13.112 INFO:teuthology.orchestra.console:Power on smithi149 2023-06-25T08:10:13.113 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-25T08:10:13.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:17.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:17.160 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:17.340 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-06-25T08:10:17.441 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-06-25T08:10:17.441 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:10:21.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:10:21.484 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-06-25T08:10:21.585 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-06-25T08:10:21.585 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:10:32.508 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:10:36.643 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:10:47.572 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:10:51.696 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:11:02.640 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:11:06.752 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:11:17.707 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:11:21.817 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:11:32.788 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:11:36.900 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:11:47.860 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:11:52.063 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:12:02.932 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:12:07.128 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:12:18.027 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:12:22.188 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:12:33.108 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:12:37.268 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:12:48.178 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:12:52.344 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:13:03.263 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:13:07.417 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:13:18.340 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:13:22.480 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:13:33.424 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:13:37.549 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:13:48.492 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:13:52.612 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:14:03.568 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-25T08:14:03.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:06.676 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-25T08:14:07.667 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-06-25T08:14:07.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:10.800 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-25T08:14:12.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:15.760 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-25T08:14:16.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:19.856 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-25T08:14:21.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:24.816 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-25T08:14:25.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:28.912 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-25T08:14:30.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:33.872 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-25T08:14:34.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:37.968 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-25T08:14:39.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:42.928 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-25T08:14:43.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:47.024 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-25T08:14:48.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:51.984 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-25T08:14:53.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:14:56.080 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-25T08:14:57.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:15:02.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:15:58.044 WARNING:teuthology.provision.fog.smithi139:timed out 2023-06-25T08:16:02.088 WARNING:teuthology.provision.fog.smithi149:timed out 2023-06-25T08:16:04.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:16:04.261 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-25T08:16:04.262 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-25T08:16:04.844 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-06-25T08:16:04.845 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-06-25T08:16:04.851 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-06-25T08:16:04.851 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-06-25T08:16:04.900 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-06-25T08:16:04.901 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-06-25T08:16:04.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-06-25T08:16:05.003 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-06-25T08:16:05.018 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-06-25T08:16:05.078 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-06-25T08:16:05.088 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-06-25T08:16:05.092 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-06-25T08:16:05.092 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-25T08:16:05.093 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-06-25T08:16:05.093 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-06-25T08:16:05.093 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-25T08:16:05.093 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04" 2023-06-25T08:16:05.093 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-25T08:16:05.093 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-25T08:16:05.093 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-25T08:16:05.094 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-25T08:16:05.094 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal 2023-06-25T08:16:05.094 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal 2023-06-25T08:16:05.094 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-06-25T08:16:05.096 DEBUG:teuthology.parallel:result is None 2023-06-25T08:16:08.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:16:08.301 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-25T08:16:08.302 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-25T08:16:08.812 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-06-25T08:16:08.813 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-06-25T08:16:08.819 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-06-25T08:16:08.819 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-06-25T08:16:08.867 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-06-25T08:16:08.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-06-25T08:16:08.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-06-25T08:16:08.978 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-06-25T08:16:09.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-06-25T08:16:09.050 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-06-25T08:16:09.066 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-06-25T08:16:09.071 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-06-25T08:16:09.072 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-25T08:16:09.072 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-06-25T08:16:09.072 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-06-25T08:16:09.080 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-25T08:16:09.080 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-06-25T08:16:09.080 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-25T08:16:09.080 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-25T08:16:09.081 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-25T08:16:09.081 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-25T08:16:09.081 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-06-25T08:16:09.081 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-06-25T08:16:09.081 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-06-25T08:16:09.082 DEBUG:teuthology.parallel:result is None 2023-06-25T08:16:09.445 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-06-25T08:16:09.446 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-06-25T08:16:09.448 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-06-25T08:16:09.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-06-25T08:16:09.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:16:09.498 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-06-25T08:16:09.620 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-06-25T08:16:09.629 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-06-25T08:16:09.630 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-06-25T08:16:09.675 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-06-25T08:16:09.676 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-25T08:16:09.676 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-06-25T08:16:09.676 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-06-25T08:16:09.676 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-25T08:16:09.676 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04" 2023-06-25T08:16:09.676 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-25T08:16:09.677 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-25T08:16:09.677 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-25T08:16:09.677 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-25T08:16:09.677 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal 2023-06-25T08:16:09.677 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal 2023-06-25T08:16:09.678 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-06-25T08:16:09.707 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-06-25T08:16:09.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-25T08:16:09.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-25T08:16:09.759 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-06-25T08:16:09.877 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-06-25T08:16:09.926 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-06-25T08:16:09.926 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-06-25T08:16:09.932 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-06-25T08:16:09.932 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-25T08:16:09.933 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-06-25T08:16:09.933 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-06-25T08:16:09.933 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-25T08:16:09.933 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-06-25T08:16:09.933 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-25T08:16:09.933 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-25T08:16:09.933 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-25T08:16:09.934 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-25T08:16:09.934 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-06-25T08:16:09.934 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-06-25T08:16:09.934 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-06-25T08:16:09.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:16:09.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:16:10.056 INFO:teuthology.dispatcher.supervisor:Running job 7315745 2023-06-25T08:16:10.057 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-24_16:51:34-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7315745 --name rishabh-2023-06-24_16:51:34-fs-CephManager-in-CephFSTestCase-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} -- /home/teuthworker/archive/rishabh-2023-06-24_16:51:34-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7315745/orig.config.yaml 2023-06-25T08:16:10.062 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-24_16:51:34-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7315745 2023-06-25T08:16:10.062 INFO:teuthology.dispatcher.supervisor:Job PID: 22260 2023-06-25T08:16:10.063 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-25T08:18:10.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:18:10.161 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:20:10.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:20:10.333 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:22:10.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:22:10.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:24:10.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:24:10.689 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:26:10.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:26:10.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:28:11.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:28:11.022 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:30:11.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:30:11.214 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:32:11.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:32:11.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:34:11.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:34:11.559 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:36:11.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:36:11.737 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:38:11.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:38:11.910 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:40:12.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-25T08:40:12.086 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-25T08:40:12.168 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-25T08:40:12.320 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-25T08:40:12.321 INFO:teuthology.nuke:Checking targets against current locks 2023-06-25T08:40:12.377 DEBUG:teuthology.nuke:shortname: smithi139 2023-06-25T08:40:12.377 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-25T08:40:12.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-24_16:51:34-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7315745', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-25 08:10:02.892198', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-25T08:40:12.406 DEBUG:teuthology.nuke:shortname: smithi149 2023-06-25T08:40:12.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-25T08:40:12.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-24_16:51:34-fs-CephManager-in-CephFSTestCase-testing-default-smithi/7315745', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-25 08:10:02.890265', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-25T08:40:12.466 INFO:teuthology.orchestra.console:Power off smithi139 2023-06-25T08:40:12.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-25T08:40:12.484 INFO:teuthology.orchestra.console:Power off smithi149 2023-06-25T08:40:12.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-25T08:40:12.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:40:12.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-25T08:40:12.617 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-06-25T08:40:12.629 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-06-25T08:40:12.775 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com 2023-06-25T08:40:12.783 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com