2023-07-05T21:20:15.285 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-05T21:20:15.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:20:15.287 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:20:15.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f290be7a8b0>, signals=[15]) 2023-07-05T21:20:15.444 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-07-05T21:20:15.445 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-07-05T21:20:15.445 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-07-05T21:20:15.472 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2023-07-05T21:20:15.473 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2023-07-05T21:20:15.473 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-07-05T21:20:15.475 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"} 2023-07-05T21:20:15.496 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /host {"name": "smithi137"} 2023-07-05T21:20:15.549 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-05T21:20:15.568 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-05T21:20:15.588 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-05T21:20:15.589 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 6} 2023-07-05T21:20:15.611 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-05T21:20:15.611 DEBUG:teuthology.provision.fog.smithi137:FOG request: PUT /host/242 {"imageID": 6} 2023-07-05T21:20:15.628 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of ubuntu 22.04 2023-07-05T21:20:15.628 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:20:15.656 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of ubuntu 22.04 2023-07-05T21:20:15.657 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:20:15.685 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"} 2023-07-05T21:20:15.709 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /tasktype {"name": "deploy"} 2023-07-05T21:20:15.720 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1} 2023-07-05T21:20:15.749 DEBUG:teuthology.provision.fog.smithi137:FOG request: POST /host/242/task {"taskTypeID": 1} 2023-07-05T21:20:15.771 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:20:15.792 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:20:15.863 INFO:teuthology.orchestra.console:Power off smithi097 2023-07-05T21:20:15.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T21:20:15.879 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-05T21:20:15.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T21:20:15.890 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:15.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:19.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:19.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:24.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:24.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:24.252 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-05T21:20:24.353 INFO:teuthology.orchestra.console:Power on smithi137 2023-07-05T21:20:24.354 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-05T21:20:24.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:28.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:28.358 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-07-05T21:20:28.433 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:28.459 INFO:teuthology.orchestra.console:Power on smithi097 2023-07-05T21:20:28.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-05T21:20:28.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:32.504 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:32.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:20:32.716 INFO:teuthology.orchestra.console:Power on for smithi097 completed 2023-07-05T21:20:32.753 INFO:teuthology.orchestra.console:Power on for smithi137 completed 2023-07-05T21:20:32.818 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-07-05T21:20:32.818 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:20:32.855 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2023-07-05T21:20:32.856 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:20:47.900 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:20:47.914 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:21:02.984 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:21:02.985 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:21:18.074 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:21:18.076 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:21:33.164 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:21:33.166 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:21:48.248 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:21:48.249 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:22:03.332 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:22:03.333 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:22:18.400 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:22:18.402 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:22:33.472 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:22:33.474 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:22:48.552 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:22:48.554 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:23:03.629 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:23:03.630 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:23:18.700 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:23:18.701 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:23:33.788 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:23:33.789 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:23:48.868 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T21:23:48.870 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-05T21:23:48.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:23:48.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:23:51.984 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:23:51.986 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T21:23:57.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:23:57.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:01.049 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:24:01.051 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T21:24:07.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:07.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:10.128 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:24:10.129 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T21:24:16.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:16.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:19.184 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:24:19.220 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T21:24:25.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:25.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:28.240 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:24:28.272 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T21:24:34.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:34.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:37.296 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:24:37.332 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T21:24:43.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:24:43.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:01.680 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:25:07.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:10.736 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:25:16.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:19.792 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:25:25.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:25.798 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:25:31.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:31.805 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:25:37.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:37.813 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:25:43.340 WARNING:teuthology.provision.fog.smithi097:timed out 2023-07-05T21:25:43.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:43.817 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-05T21:25:49.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:49.569 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-05T21:25:49.570 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-05T21:25:49.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:50.014 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-07-05T21:25:50.014 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-07-05T21:25:50.015 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-05T21:25:50.015 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-05T21:25:50.061 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2023-07-05T21:25:50.062 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2023-07-05T21:25:50.110 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-07-05T21:25:50.111 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-07-05T21:25:50.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2023-07-05T21:25:50.254 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-07-05T21:25:50.309 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2023-07-05T21:25:50.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-07-05T21:25:50.420 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-07-05T21:25:50.469 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-05T21:25:50.469 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2023-07-05T21:25:50.469 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2023-07-05T21:25:50.469 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-05T21:25:50.469 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2023-07-05T21:25:50.470 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2023-07-05T21:25:50.470 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2023-07-05T21:25:50.470 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-05T21:25:50.470 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-05T21:25:50.470 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-05T21:25:50.470 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-05T21:25:50.470 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2023-07-05T21:25:50.471 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-07-05T21:25:50.473 DEBUG:teuthology.parallel:result is None 2023-07-05T21:25:50.474 INFO:teuthology.provision.fog.smithi137:Node is ready 2023-07-05T21:25:50.474 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2023-07-05T21:25:50.524 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2023-07-05T21:25:50.524 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2023-07-05T21:25:50.572 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2023-07-05T21:25:50.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-07-05T21:25:50.710 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2023-07-05T21:25:50.724 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2023-07-05T21:25:50.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2023-07-05T21:25:50.840 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-07-05T21:25:50.895 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-07-05T21:25:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-05T21:25:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2023-07-05T21:25:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="22.04" 2023-07-05T21:25:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-05T21:25:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=jammy 2023-07-05T21:25:50.948 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2023-07-05T21:25:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2023-07-05T21:25:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-05T21:25:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-05T21:25:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-05T21:25:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-05T21:25:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=jammy 2023-07-05T21:25:50.950 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2023-07-05T21:25:50.950 DEBUG:teuthology.parallel:result is None 2023-07-05T21:25:51.117 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-07-05T21:25:51.118 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-05T21:25:51.144 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2023-07-05T21:25:51.145 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-05T21:25:51.170 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-07-05T21:25:51.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-07-05T21:25:51.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:51.248 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-07-05T21:25:51.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-07-05T21:25:51.340 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-07-05T21:25:51.389 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-07-05T21:25:51.389 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-07-05T21:25:51.437 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-05T21:25:51.438 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2023-07-05T21:25:51.438 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2023-07-05T21:25:51.438 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-05T21:25:51.438 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2023-07-05T21:25:51.438 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2023-07-05T21:25:51.438 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2023-07-05T21:25:51.438 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-05T21:25:51.439 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-05T21:25:51.439 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-05T21:25:51.439 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-05T21:25:51.439 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2023-07-05T21:25:51.439 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-07-05T21:25:51.461 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2023-07-05T21:25:51.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-05T21:25:51.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T21:25:51.537 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-07-05T21:25:51.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-05T21:25:51.640 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2023-07-05T21:25:51.687 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2023-07-05T21:25:51.687 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-07-05T21:25:51.735 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-05T21:25:51.736 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2023-07-05T21:25:51.736 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="22.04" 2023-07-05T21:25:51.736 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-05T21:25:51.736 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=jammy 2023-07-05T21:25:51.736 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2023-07-05T21:25:51.736 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2023-07-05T21:25:51.736 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-05T21:25:51.737 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-05T21:25:51.737 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-05T21:25:51.737 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-05T21:25:51.737 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=jammy 2023-07-05T21:25:51.737 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-07-05T21:25:51.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:25:51.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:25:51.873 INFO:teuthology.dispatcher.supervisor:Running job 7327492 2023-07-05T21:25:51.873 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327492 --name rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} -- /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327492/orig.config.yaml 2023-07-05T21:25:51.877 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327492 2023-07-05T21:25:51.879 INFO:teuthology.dispatcher.supervisor:Job PID: 32321 2023-07-05T21:25:51.879 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-05T21:27:51.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:27:51.913 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:29:52.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:29:52.094 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:31:52.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:31:52.270 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:33:52.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:33:52.423 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:36:07.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:36:07.602 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:38:12.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:38:12.790 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:40:17.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T21:40:17.962 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T21:40:23.035 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-05T21:40:27.099 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-05T21:40:27.100 INFO:teuthology.nuke:Checking targets against current locks 2023-07-05T21:40:27.161 DEBUG:teuthology.nuke:shortname: smithi097 2023-07-05T21:40:27.162 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-05T21:40:27.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327492', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 21:20:14.513502', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJtJ7LxQkU6GGWliDyGBVzqIXwDeyar6J/cKIaAU1kItLYiIKHPkFAxHd0qN7sM0/OXI8ZMgGhmJblo4okvM/jM='} 2023-07-05T21:40:27.193 DEBUG:teuthology.nuke:shortname: smithi137 2023-07-05T21:40:27.193 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-05T21:40:27.211 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_18:32:52-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7327492', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 21:20:14.511472', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJdFsGSPi7qgPmxZ9RZWlmdiJzFc/fVmzSkgdA7dT8+szShBUrenMR49F7iOzDrNu/F4UFqky2I37nl8IXy4fzM='} 2023-07-05T21:40:27.233 INFO:teuthology.orchestra.console:Power off smithi097 2023-07-05T21:40:27.234 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T21:40:27.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:40:27.269 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-05T21:40:27.270 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T21:40:32.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:40:32.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T21:40:32.412 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-05T21:40:42.549 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-07-05T21:40:42.572 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com 2023-07-05T21:40:52.713 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com