2023-06-26T21:20:23.205 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-26T21:20:23.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:20:23.207 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:20:23.381 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbf6f20d8b0>, signals=[15]) 2023-06-26T21:20:23.382 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-06-26T21:20:23.383 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T21:20:23.383 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-06-26T21:20:23.407 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-06-26T21:20:23.408 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T21:20:23.409 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-06-26T21:20:23.411 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-06-26T21:20:23.440 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"} 2023-06-26T21:20:23.492 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-26T21:20:23.515 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-26T21:20:23.530 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-26T21:20:23.530 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 6} 2023-06-26T21:20:23.558 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-26T21:20:23.558 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 6} 2023-06-26T21:20:23.578 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of ubuntu 22.04 2023-06-26T21:20:23.578 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:20:23.605 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of ubuntu 22.04 2023-06-26T21:20:23.606 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:20:23.635 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T21:20:23.657 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T21:20:23.685 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-06-26T21:20:23.702 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1} 2023-06-26T21:20:23.755 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:20:23.766 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:20:23.876 INFO:teuthology.orchestra.console:Power off smithi089 2023-06-26T21:20:23.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T21:20:23.892 INFO:teuthology.orchestra.console:Power off smithi026 2023-06-26T21:20:23.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T21:20:23.903 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:23.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:27.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:27.940 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:32.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:32.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:37.157 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:37.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:37.376 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-06-26T21:20:37.477 INFO:teuthology.orchestra.console:Power on smithi026 2023-06-26T21:20:37.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T21:20:37.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:41.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:41.742 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-06-26T21:20:41.843 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-06-26T21:20:41.844 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:20:46.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:47.606 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2023-06-26T21:20:47.708 INFO:teuthology.orchestra.console:Power on smithi089 2023-06-26T21:20:47.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T21:20:47.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:51.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:20:56.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:21:01.588 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:21:11.598 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:21:11.807 INFO:teuthology.orchestra.console:Power on for smithi089 completed 2023-06-26T21:21:11.908 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-06-26T21:21:11.909 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:21:26.676 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:21:31.686 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:21:41.732 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:21:51.769 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:21:56.793 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:22:16.812 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:22:21.817 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:22:41.892 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:22:41.894 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:23:06.972 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:23:06.974 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:23:32.052 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:23:32.053 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:23:47.568 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-06-26T21:23:47.569 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:23:47.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:23:50.704 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-26T21:23:56.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:23:59.760 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-26T21:24:02.634 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-06-26T21:24:02.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:24:05.744 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:24:05.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:24:08.816 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-26T21:24:11.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:24:14.800 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:24:14.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:24:20.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:24:22.896 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-26T21:24:23.856 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:24:28.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:24:33.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:24:41.968 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:24:47.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:24:51.056 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:24:57.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:25:05.520 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-06-26T21:25:11.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:25:20.624 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:25:26.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:25:32.084 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T21:25:32.085 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T21:25:32.556 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-06-26T21:25:32.557 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-06-26T21:25:32.605 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-06-26T21:25:32.605 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-06-26T21:25:32.652 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-06-26T21:25:32.653 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-06-26T21:25:32.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-06-26T21:25:32.842 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-06-26T21:25:32.902 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-06-26T21:25:32.958 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-06-26T21:25:33.012 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-06-26T21:25:33.061 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T21:25:33.062 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2023-06-26T21:25:33.062 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2023-06-26T21:25:33.062 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T21:25:33.062 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2023-06-26T21:25:33.062 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2023-06-26T21:25:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2023-06-26T21:25:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T21:25:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T21:25:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T21:25:33.063 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T21:25:33.064 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2023-06-26T21:25:33.064 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-06-26T21:25:33.066 DEBUG:teuthology.parallel:result is None 2023-06-26T21:25:33.684 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:25:39.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:25:39.693 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:25:45.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:25:50.705 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:25:56.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:25:56.713 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-26T21:26:02.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:26:02.992 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T21:26:02.992 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T21:26:03.577 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-06-26T21:26:03.577 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-06-26T21:26:03.622 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-06-26T21:26:03.623 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2023-06-26T21:26:03.671 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-06-26T21:26:03.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-06-26T21:26:03.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2023-06-26T21:26:03.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2023-06-26T21:26:03.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2023-06-26T21:26:03.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-06-26T21:26:03.978 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-06-26T21:26:04.031 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T21:26:04.031 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-06-26T21:26:04.032 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2023-06-26T21:26:04.032 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T21:26:04.032 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2023-06-26T21:26:04.032 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-06-26T21:26:04.032 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-06-26T21:26:04.032 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T21:26:04.033 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T21:26:04.033 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T21:26:04.033 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T21:26:04.033 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2023-06-26T21:26:04.033 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-06-26T21:26:04.034 DEBUG:teuthology.parallel:result is None 2023-06-26T21:26:04.674 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-06-26T21:26:04.675 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T21:26:04.696 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-06-26T21:26:04.697 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T21:26:04.731 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-06-26T21:26:04.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-06-26T21:26:04.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:26:04.812 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-06-26T21:26:05.028 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-06-26T21:26:05.075 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-06-26T21:26:05.075 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-06-26T21:26:05.119 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T21:26:05.121 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2023-06-26T21:26:05.121 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2023-06-26T21:26:05.121 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T21:26:05.121 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2023-06-26T21:26:05.121 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2023-06-26T21:26:05.121 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2023-06-26T21:26:05.122 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T21:26:05.122 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T21:26:05.122 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T21:26:05.122 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T21:26:05.122 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2023-06-26T21:26:05.122 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-06-26T21:26:05.146 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-06-26T21:26:05.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-06-26T21:26:05.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T21:26:05.220 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-06-26T21:26:05.331 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-06-26T21:26:05.379 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-06-26T21:26:05.379 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-06-26T21:26:05.427 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T21:26:05.427 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-06-26T21:26:05.428 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2023-06-26T21:26:05.428 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T21:26:05.428 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2023-06-26T21:26:05.429 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-06-26T21:26:05.429 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-06-26T21:26:05.429 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T21:26:05.429 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T21:26:05.430 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T21:26:05.430 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T21:26:05.430 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2023-06-26T21:26:05.431 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-06-26T21:26:05.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:26:05.456 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:26:05.545 INFO:teuthology.dispatcher.supervisor:Running job 7316943 2023-06-26T21:26:05.545 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi/7316943 --name yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi --description rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} -- /home/teuthworker/archive/yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi/7316943/orig.config.yaml 2023-06-26T21:26:05.548 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi/7316943 2023-06-26T21:26:05.549 INFO:teuthology.dispatcher.supervisor:Job PID: 17470 2023-06-26T21:26:05.550 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-26T21:28:05.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:28:05.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:30:15.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:30:15.839 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:32:16.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:32:16.020 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:34:17.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:34:17.035 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:36:19.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:36:19.676 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:38:21.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:38:21.077 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:40:26.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T21:40:26.259 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T21:40:31.336 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-26T21:40:41.491 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-26T21:40:41.491 INFO:teuthology.nuke:Checking targets against current locks 2023-06-26T21:40:47.089 DEBUG:teuthology.nuke:shortname: smithi026 2023-06-26T21:40:47.090 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T21:40:47.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi/7316943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 21:20:22.380214', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrsgHPy8RmEZvWXssbEyQjUeo2WlwOElf+qkpanXSoYFxDtGdcRhvyWNN3J9017fl7nX+HMSBf24QqUc19/los='} 2023-06-26T21:40:47.121 DEBUG:teuthology.nuke:shortname: smithi089 2023-06-26T21:40:47.122 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T21:40:47.150 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi/7316943', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 21:20:22.378305', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQyGsupyk5NpS+lbA0YPv/CsFhiDaeEn7h49qVBiuStsvKngEp91MSbSpY22zqB7p6L9SoJGkMinqjh4BF8NXo='} 2023-06-26T21:40:47.171 INFO:teuthology.orchestra.console:Power off smithi026 2023-06-26T21:40:47.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T21:40:47.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:40:47.218 INFO:teuthology.orchestra.console:Power off smithi089 2023-06-26T21:40:47.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T21:40:52.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:40:52.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:40:57.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:40:57.323 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:02.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:02.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:07.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:07.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:07.695 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2023-06-26T21:41:07.941 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2023-06-26T21:41:12.658 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:17.769 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:22.879 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:27.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:33.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:38.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:43.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:48.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:53.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:58.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T21:41:59.776 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-06-26T21:41:59.777 ERROR:teuthology.orchestra.console:Failed to power off smithi026 2023-06-26T21:42:06.934 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com