2023-06-23T19:39:15.272 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T19:39:15.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:39:15.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T19:39:15.422 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f78a835d8b0>, signals=[15]) 2023-06-23T19:39:15.423 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-06-23T19:39:15.423 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T19:39:15.424 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-06-23T19:39:15.445 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-06-23T19:39:15.445 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T19:39:15.446 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-06-23T19:39:15.447 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-06-23T19:39:15.469 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-06-23T19:39:15.521 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-23T19:39:15.551 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-23T19:39:15.560 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-23T19:39:15.560 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 6} 2023-06-23T19:39:15.596 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-23T19:39:15.597 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 6} 2023-06-23T19:39:15.614 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of ubuntu 22.04 2023-06-23T19:39:15.614 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:39:15.640 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 22.04 2023-06-23T19:39:15.640 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:39:15.674 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T19:39:15.700 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T19:39:15.711 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-06-23T19:39:15.737 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-06-23T19:39:15.760 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:39:15.788 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:39:15.841 INFO:teuthology.orchestra.console:Power off smithi104 2023-06-23T19:39:15.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T19:39:15.869 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:15.890 INFO:teuthology.orchestra.console:Power off smithi125 2023-06-23T19:39:15.891 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T19:39:15.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:16.037 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-06-23T19:39:16.138 INFO:teuthology.orchestra.console:Power on smithi125 2023-06-23T19:39:16.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T19:39:16.161 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:19.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:20.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:20.394 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2023-06-23T19:39:20.495 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-06-23T19:39:20.496 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:39:24.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:24.229 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-06-23T19:39:24.330 INFO:teuthology.orchestra.console:Power on smithi104 2023-06-23T19:39:24.330 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T19:39:24.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:28.374 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:32.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T19:39:32.733 INFO:teuthology.orchestra.console:Power on for smithi104 completed 2023-06-23T19:39:32.834 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-06-23T19:39:32.834 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:39:35.568 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:39:47.920 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:39:50.637 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:40:03.000 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:40:05.708 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:40:18.080 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:40:20.784 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:40:33.169 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:40:35.856 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:40:48.252 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:40:50.932 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:41:03.328 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:41:05.994 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:41:18.407 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:41:21.072 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:41:33.482 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:41:36.139 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:41:48.563 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:41:51.204 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:42:03.632 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:42:06.280 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:42:18.716 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:42:21.348 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:42:33.785 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-06-23T19:42:33.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:42:33.909 ERROR:teuthology.orchestra.connection:Error authenticating with smithi104.front.sepia.ceph.com: Authentication failed. 2023-06-23T19:42:36.425 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-06-23T19:42:36.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:42:39.536 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T19:42:45.104 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:42:45.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:42:48.592 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T19:42:51.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:42:54.160 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:42:54.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:42:57.648 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T19:43:00.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:43:03.216 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:43:03.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:43:06.704 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T19:43:09.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:43:12.272 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:43:12.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:43:15.760 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-06-23T19:43:18.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:43:21.328 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:43:21.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:43:27.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:43:30.384 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:43:36.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:43:54.736 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:44:00.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:03.792 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:44:09.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:09.795 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:44:15.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:15.797 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:44:21.764 WARNING:teuthology.provision.fog.smithi125:timed out 2023-06-23T19:44:21.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:21.800 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:44:27.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:27.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:27.802 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:44:27.966 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T19:44:27.967 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T19:44:28.402 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-06-23T19:44:28.403 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-06-23T19:44:28.449 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-06-23T19:44:28.450 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-06-23T19:44:28.502 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-06-23T19:44:28.503 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-06-23T19:44:28.616 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-06-23T19:44:28.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-06-23T19:44:28.685 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-06-23T19:44:28.745 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-06-23T19:44:28.800 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-06-23T19:44:28.849 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T19:44:28.849 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2023-06-23T19:44:28.849 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="22.04" 2023-06-23T19:44:28.850 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T19:44:28.850 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=jammy 2023-06-23T19:44:28.850 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2023-06-23T19:44:28.850 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2023-06-23T19:44:28.850 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T19:44:28.851 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T19:44:28.851 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T19:44:28.851 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T19:44:28.851 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=jammy 2023-06-23T19:44:28.852 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-06-23T19:44:28.853 DEBUG:teuthology.parallel:result is None 2023-06-23T19:44:33.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:33.805 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-06-23T19:44:39.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:39.996 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T19:44:39.997 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T19:44:40.447 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-06-23T19:44:40.447 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-06-23T19:44:40.494 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-06-23T19:44:40.495 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-06-23T19:44:40.542 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-06-23T19:44:40.543 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-06-23T19:44:40.719 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-06-23T19:44:40.733 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-06-23T19:44:40.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-06-23T19:44:40.843 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-06-23T19:44:40.897 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-06-23T19:44:40.942 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T19:44:40.943 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-06-23T19:44:40.943 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2023-06-23T19:44:40.943 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T19:44:40.944 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2023-06-23T19:44:40.944 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-06-23T19:44:40.945 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-06-23T19:44:40.946 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T19:44:40.946 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T19:44:40.946 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T19:44:40.946 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T19:44:40.946 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2023-06-23T19:44:40.947 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-06-23T19:44:40.947 DEBUG:teuthology.parallel:result is None 2023-06-23T19:44:41.118 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-06-23T19:44:41.118 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T19:44:41.144 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-06-23T19:44:41.144 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T19:44:41.170 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-06-23T19:44:41.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-06-23T19:44:41.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:41.247 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-06-23T19:44:41.355 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-06-23T19:44:41.401 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-06-23T19:44:41.401 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-06-23T19:44:41.449 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T19:44:41.450 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-06-23T19:44:41.450 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2023-06-23T19:44:41.450 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T19:44:41.450 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2023-06-23T19:44:41.450 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-06-23T19:44:41.450 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-06-23T19:44:41.451 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T19:44:41.451 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T19:44:41.451 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T19:44:41.451 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T19:44:41.451 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2023-06-23T19:44:41.452 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-06-23T19:44:41.505 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-06-23T19:44:41.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-06-23T19:44:41.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T19:44:41.583 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-06-23T19:44:41.804 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-06-23T19:44:41.848 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-06-23T19:44:41.849 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-06-23T19:44:41.897 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-23T19:44:41.897 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2023-06-23T19:44:41.897 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="22.04" 2023-06-23T19:44:41.897 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-23T19:44:41.897 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=jammy 2023-06-23T19:44:41.898 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2023-06-23T19:44:41.898 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2023-06-23T19:44:41.898 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T19:44:41.898 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T19:44:41.898 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T19:44:41.898 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T19:44:41.898 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=jammy 2023-06-23T19:44:41.899 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-06-23T19:44:41.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:44:41.929 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T19:44:42.028 INFO:teuthology.dispatcher.supervisor:Running job 7313664 2023-06-23T19:44:42.028 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-23_16:20:29-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi/7313664 --name yuriw-2023-06-23_16:20:29-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/yuriw-2023-06-23_16:20:29-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi/7313664/orig.config.yaml 2023-06-23T19:44:42.032 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-23_16:20:29-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi/7313664 2023-06-23T19:44:42.033 INFO:teuthology.dispatcher.supervisor:Job PID: 19766 2023-06-23T19:44:42.034 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-23T19:46:42.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:46:42.036 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T19:48:42.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:48:42.115 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T19:50:42.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:50:42.201 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T19:52:42.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:52:42.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T19:54:42.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:54:42.349 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T19:56:42.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:56:42.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T19:58:42.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T19:58:42.523 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:00:42.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:00:42.599 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:02:42.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:02:42.672 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:04:42.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:04:42.769 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:06:42.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:06:42.845 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:08:42.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:08:42.917 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:10:42.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:10:42.999 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:12:43.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:12:43.075 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:14:43.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:14:43.140 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:16:43.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:16:43.223 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:18:43.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T20:18:43.299 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T20:18:43.378 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-23T20:18:43.592 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-23T20:18:43.593 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T20:18:43.650 DEBUG:teuthology.nuke:shortname: smithi104 2023-06-23T20:18:43.650 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T20:18:43.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_16:20:29-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi/7313664', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 19:39:14.496772', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMA3TrEMKYozGbx8nppVNWTTfmDWuBRQdnB2xawosAsA'} 2023-06-23T20:18:43.677 DEBUG:teuthology.nuke:shortname: smithi125 2023-06-23T20:18:43.678 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T20:18:43.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_16:20:29-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi/7313664', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 19:39:14.497982', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPKxtd07+VaEzTZ84uxxG9ELuvvKlVK3kBSvht2J38lOEDeTJzcYZdNsMfmoE8mGlgMO3hMp8yHlm5xAsOtOJL0='} 2023-06-23T20:18:43.735 INFO:teuthology.orchestra.console:Power off smithi104 2023-06-23T20:18:43.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T20:18:43.755 INFO:teuthology.orchestra.console:Power off smithi125 2023-06-23T20:18:43.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T20:18:43.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T20:18:43.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T20:18:43.889 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-06-23T20:18:43.898 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-06-23T20:18:44.041 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2023-06-23T20:18:44.059 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com