2023-06-20T11:43:58.470 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T11:43:58.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T11:43:58.472 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T11:43:58.624 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c8e2aeaf0>, signals=[15]) 2023-06-20T11:43:58.626 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-06-20T11:43:58.626 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T11:43:58.626 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-06-20T11:43:58.652 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-06-20T11:43:58.652 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T11:43:58.652 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-06-20T11:43:58.654 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-06-20T11:43:58.677 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-06-20T11:43:58.730 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-20T11:43:58.750 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-20T11:43:58.773 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-20T11:43:58.773 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 6} 2023-06-20T11:43:58.795 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-20T11:43:58.795 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 6} 2023-06-20T11:43:58.825 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of ubuntu 22.04 2023-06-20T11:43:58.825 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:43:58.839 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of ubuntu 22.04 2023-06-20T11:43:58.840 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:43:58.881 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T11:43:58.884 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T11:43:58.915 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-06-20T11:43:58.920 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-06-20T11:43:59.069 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:43:59.075 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:43:59.163 INFO:teuthology.orchestra.console:Power off smithi101 2023-06-20T11:43:59.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T11:43:59.178 INFO:teuthology.orchestra.console:Power off smithi139 2023-06-20T11:43:59.179 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T11:43:59.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:43:59.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:03.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:03.226 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:07.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:07.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:07.538 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-06-20T11:44:07.547 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-06-20T11:44:07.640 INFO:teuthology.orchestra.console:Power on smithi101 2023-06-20T11:44:07.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T11:44:07.650 INFO:teuthology.orchestra.console:Power on smithi139 2023-06-20T11:44:07.650 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T11:44:07.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:07.673 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:11.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:11.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:15.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:15.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T11:44:16.016 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-06-20T11:44:16.025 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-06-20T11:44:16.117 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-06-20T11:44:16.118 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:44:16.126 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-06-20T11:44:16.126 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:44:31.188 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:44:31.189 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:44:46.256 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:44:46.258 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:45:01.324 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:45:01.325 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:45:16.397 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:45:16.398 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:45:31.463 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:45:31.464 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:45:46.528 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:45:46.529 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:46:01.592 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:46:01.594 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:46:16.674 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:46:16.675 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:46:31.744 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:46:31.745 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:46:46.816 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:46:46.817 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:47:01.881 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:47:01.882 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:47:16.968 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-06-20T11:47:16.969 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:47:17.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:47:17.500 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: Authentication failed. 2023-06-20T11:47:32.027 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-06-20T11:47:32.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:47:35.156 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-20T11:47:41.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:47:44.208 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-20T11:47:50.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:47:53.264 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-20T11:47:59.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:48:02.320 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-20T11:48:08.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:48:11.376 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-20T11:48:17.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:48:18.504 WARNING:teuthology.provision.fog.smithi139:timed out 2023-06-20T11:48:24.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:48:42.992 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-20T11:48:48.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:48:52.052 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-20T11:48:58.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:48:58.055 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-20T11:49:04.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:49:04.058 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-20T11:49:10.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:49:10.060 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-20T11:49:16.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:49:16.063 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-06-20T11:49:17.379 WARNING:teuthology.provision.fog.smithi101:timed out 2023-06-20T11:49:22.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:49:22.239 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T11:49:22.240 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T11:49:22.705 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-06-20T11:49:22.705 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-06-20T11:49:22.750 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-06-20T11:49:22.750 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-06-20T11:49:22.798 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-06-20T11:49:22.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-06-20T11:49:22.921 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-06-20T11:49:22.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-06-20T11:49:22.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-06-20T11:49:23.051 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-06-20T11:49:23.104 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-06-20T11:49:23.149 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-20T11:49:23.150 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-06-20T11:49:23.150 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2023-06-20T11:49:23.150 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-20T11:49:23.150 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2023-06-20T11:49:23.150 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-06-20T11:49:23.150 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-06-20T11:49:23.150 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-20T11:49:23.151 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-20T11:49:23.151 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-20T11:49:23.151 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-20T11:49:23.151 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2023-06-20T11:49:23.152 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-06-20T11:49:23.153 DEBUG:teuthology.parallel:result is None 2023-06-20T11:49:23.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:49:23.635 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T11:49:23.636 DEBUG:teuthology.orchestra.run.smithi101:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T11:49:24.092 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-06-20T11:49:24.092 DEBUG:teuthology.orchestra.run.smithi101:> hostname 2023-06-20T11:49:24.136 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2023-06-20T11:49:24.137 DEBUG:teuthology.orchestra.run.smithi101:> grep smithi101.front.sepia.ceph.com /etc/hosts 2023-06-20T11:49:24.184 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2023-06-20T11:49:24.185 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-06-20T11:49:24.324 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hosts 2023-06-20T11:49:24.337 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/172.21.15.101/172.21.15.101/g' /etc/hosts 2023-06-20T11:49:24.392 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hostname 2023-06-20T11:49:24.449 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-06-20T11:49:24.504 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-06-20T11:49:24.553 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-20T11:49:24.553 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Ubuntu" 2023-06-20T11:49:24.553 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="22.04" 2023-06-20T11:49:24.553 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-20T11:49:24.553 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_CODENAME=jammy 2023-06-20T11:49:24.553 INFO:teuthology.orchestra.run.smithi101.stdout:ID=ubuntu 2023-06-20T11:49:24.554 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE=debian 2023-06-20T11:49:24.554 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-20T11:49:24.554 INFO:teuthology.orchestra.run.smithi101.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-20T11:49:24.554 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-20T11:49:24.554 INFO:teuthology.orchestra.run.smithi101.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-20T11:49:24.554 INFO:teuthology.orchestra.run.smithi101.stdout:UBUNTU_CODENAME=jammy 2023-06-20T11:49:24.554 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2023-06-20T11:49:24.555 DEBUG:teuthology.parallel:result is None 2023-06-20T11:49:24.722 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2023-06-20T11:49:24.722 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T11:49:24.753 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-06-20T11:49:24.753 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T11:49:24.778 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2023-06-20T11:49:24.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-06-20T11:49:24.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:49:24.858 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-06-20T11:49:24.963 DEBUG:teuthology.orchestra.run.smithi101:> uname -m 2023-06-20T11:49:25.008 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-06-20T11:49:25.009 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-06-20T11:49:25.056 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-20T11:49:25.056 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Ubuntu" 2023-06-20T11:49:25.056 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="22.04" 2023-06-20T11:49:25.057 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-20T11:49:25.057 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_CODENAME=jammy 2023-06-20T11:49:25.057 INFO:teuthology.orchestra.run.smithi101.stdout:ID=ubuntu 2023-06-20T11:49:25.057 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE=debian 2023-06-20T11:49:25.057 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-20T11:49:25.057 INFO:teuthology.orchestra.run.smithi101.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-20T11:49:25.058 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-20T11:49:25.058 INFO:teuthology.orchestra.run.smithi101.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-20T11:49:25.058 INFO:teuthology.orchestra.run.smithi101.stdout:UBUNTU_CODENAME=jammy 2023-06-20T11:49:25.058 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-06-20T11:49:25.111 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-06-20T11:49:25.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-06-20T11:49:25.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T11:49:25.187 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-06-20T11:49:25.280 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-06-20T11:49:25.325 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-06-20T11:49:25.325 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-06-20T11:49:25.369 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-20T11:49:25.369 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-06-20T11:49:25.370 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2023-06-20T11:49:25.370 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-20T11:49:25.370 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2023-06-20T11:49:25.370 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-06-20T11:49:25.370 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-06-20T11:49:25.370 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-20T11:49:25.370 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-20T11:49:25.371 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-20T11:49:25.371 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-20T11:49:25.371 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2023-06-20T11:49:25.371 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-06-20T11:49:25.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T11:49:25.395 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T11:49:25.615 INFO:teuthology.dispatcher.supervisor:Running job 7308043 2023-06-20T11:49:25.615 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7308043 --name rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}} -- /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7308043/orig.config.yaml 2023-06-20T11:49:25.619 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7308043 2023-06-20T11:49:25.620 INFO:teuthology.dispatcher.supervisor:Job PID: 30826 2023-06-20T11:49:25.620 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T11:51:25.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T11:51:25.623 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T11:53:25.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T11:53:25.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T11:55:25.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T11:55:25.778 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T11:57:25.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T11:57:25.851 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T11:59:25.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T11:59:25.932 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T12:01:26.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T12:01:26.008 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T12:03:26.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T12:03:26.090 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T12:05:26.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T12:05:26.168 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T12:05:26.246 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T12:05:26.388 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-20T12:05:26.389 INFO:teuthology.nuke:Checking targets against current locks 2023-06-20T12:05:26.439 DEBUG:teuthology.nuke:shortname: smithi101 2023-06-20T12:05:26.440 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T12:05:26.464 DEBUG:teuthology.nuke:shortname: smithi139 2023-06-20T12:05:26.465 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T12:05:26.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7308043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 11:43:57.599236', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAe6HowpjIuyIXlKkYmAJys8VESIjvIfPRMN84P8p36k'} 2023-06-20T12:05:26.491 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7308043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 11:43:57.597643', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB9ZcvJHNrc0D1xKVGUUEim3lZHmGi4STHLvEhadf8JV'} 2023-06-20T12:05:26.522 INFO:teuthology.orchestra.console:Power off smithi101 2023-06-20T12:05:26.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T12:05:26.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T12:05:26.570 INFO:teuthology.orchestra.console:Power off smithi139 2023-06-20T12:05:26.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T12:05:26.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T12:05:26.683 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-06-20T12:05:26.718 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-06-20T12:05:26.844 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-06-20T12:05:26.869 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com