2023-06-18T18:56:12.188 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-18T18:56:12.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T18:56:12.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T18:56:12.349 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1e892604c0>, signals=[15]) 2023-06-18T18:56:12.351 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-06-18T18:56:12.351 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-06-18T18:56:12.351 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-06-18T18:56:12.373 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-06-18T18:56:12.373 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-06-18T18:56:12.374 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-06-18T18:56:12.375 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-06-18T18:56:12.397 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-06-18T18:56:12.447 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-18T18:56:12.463 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-18T18:56:12.491 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-18T18:56:12.491 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 6} 2023-06-18T18:56:12.507 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-18T18:56:12.507 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 6} 2023-06-18T18:56:12.542 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of ubuntu 22.04 2023-06-18T18:56:12.542 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:56:12.553 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of ubuntu 22.04 2023-06-18T18:56:12.553 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:56:12.602 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-06-18T18:56:12.607 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-06-18T18:56:12.641 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-06-18T18:56:12.644 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-06-18T18:56:12.710 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:56:12.733 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:56:12.818 INFO:teuthology.orchestra.console:Power off smithi116 2023-06-18T18:56:12.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T18:56:12.831 INFO:teuthology.orchestra.console:Power off smithi064 2023-06-18T18:56:12.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T18:56:12.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:12.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:16.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:16.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:20.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:20.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:21.192 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-06-18T18:56:21.293 INFO:teuthology.orchestra.console:Power on smithi116 2023-06-18T18:56:21.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-18T18:56:21.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:25.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:25.310 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2023-06-18T18:56:25.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:25.412 INFO:teuthology.orchestra.console:Power on smithi064 2023-06-18T18:56:25.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-18T18:56:25.434 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:29.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:29.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T18:56:29.666 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2023-06-18T18:56:29.676 INFO:teuthology.orchestra.console:Power on for smithi064 completed 2023-06-18T18:56:29.767 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-06-18T18:56:29.768 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:56:29.777 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-06-18T18:56:29.777 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:56:44.848 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:56:44.852 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:56:59.920 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:56:59.921 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:57:15.005 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:57:15.006 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:57:30.086 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:57:30.087 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:57:45.152 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:57:45.153 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:58:00.229 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:58:00.231 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:58:15.316 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:58:15.317 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:58:30.400 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:58:30.401 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:58:45.487 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:58:45.489 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:59:00.564 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:59:00.565 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:59:15.668 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:59:15.669 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:59:30.774 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:59:30.775 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:59:45.873 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-06-18T18:59:45.874 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-06-18T18:59:45.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:59:45.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:59:49.044 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-06-18T18:59:49.045 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-18T18:59:55.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:59:55.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T18:59:58.132 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-06-18T18:59:58.133 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-18T19:00:04.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:04.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:07.220 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-06-18T19:00:07.221 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-18T19:00:13.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:13.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:16.304 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-06-18T19:00:16.305 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-18T19:00:22.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:22.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:25.360 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-06-18T19:00:25.361 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-18T19:00:31.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:31.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:34.448 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-06-18T19:00:34.449 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-18T19:00:40.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:40.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:00:43.504 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-06-18T19:00:49.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:01:40.499 WARNING:teuthology.provision.fog.smithi116:timed out 2023-06-18T19:01:46.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:01:46.789 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-18T19:01:46.790 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-18T19:01:47.239 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-06-18T19:01:47.239 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-06-18T19:01:47.284 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-06-18T19:01:47.285 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-06-18T19:01:47.329 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-06-18T19:01:47.329 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-06-18T19:01:47.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-06-18T19:01:47.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-06-18T19:01:47.494 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-06-18T19:01:47.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-06-18T19:01:47.604 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-06-18T19:01:47.649 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-18T19:01:47.650 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2023-06-18T19:01:47.650 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="22.04" 2023-06-18T19:01:47.650 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-18T19:01:47.650 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=jammy 2023-06-18T19:01:47.650 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2023-06-18T19:01:47.650 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2023-06-18T19:01:47.651 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-18T19:01:47.651 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-18T19:01:47.651 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-18T19:01:47.651 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-18T19:01:47.651 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=jammy 2023-06-18T19:01:47.652 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-06-18T19:01:47.653 DEBUG:teuthology.parallel:result is None 2023-06-18T19:01:49.511 WARNING:teuthology.provision.fog.smithi064:timed out 2023-06-18T19:01:55.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:01:55.793 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-18T19:01:55.794 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-18T19:01:56.263 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-06-18T19:01:56.264 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-06-18T19:01:56.315 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-06-18T19:01:56.316 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-06-18T19:01:56.364 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-06-18T19:01:56.365 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-06-18T19:01:56.489 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-06-18T19:01:56.503 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-06-18T19:01:56.557 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-06-18T19:01:56.612 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-06-18T19:01:56.667 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-06-18T19:01:56.712 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-18T19:01:56.712 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Ubuntu" 2023-06-18T19:01:56.712 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="22.04" 2023-06-18T19:01:56.713 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-18T19:01:56.713 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_CODENAME=jammy 2023-06-18T19:01:56.713 INFO:teuthology.orchestra.run.smithi064.stdout:ID=ubuntu 2023-06-18T19:01:56.713 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE=debian 2023-06-18T19:01:56.713 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-18T19:01:56.713 INFO:teuthology.orchestra.run.smithi064.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-18T19:01:56.713 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-18T19:01:56.713 INFO:teuthology.orchestra.run.smithi064.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-18T19:01:56.714 INFO:teuthology.orchestra.run.smithi064.stdout:UBUNTU_CODENAME=jammy 2023-06-18T19:01:56.714 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-06-18T19:01:56.714 DEBUG:teuthology.parallel:result is None 2023-06-18T19:01:56.880 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-06-18T19:01:56.881 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-18T19:01:56.909 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-06-18T19:01:56.909 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-18T19:01:56.935 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-06-18T19:01:56.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-06-18T19:01:56.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:01:57.008 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-06-18T19:01:57.104 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-06-18T19:01:57.155 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-06-18T19:01:57.156 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-06-18T19:01:57.207 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-18T19:01:57.208 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Ubuntu" 2023-06-18T19:01:57.208 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="22.04" 2023-06-18T19:01:57.208 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-18T19:01:57.208 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_CODENAME=jammy 2023-06-18T19:01:57.208 INFO:teuthology.orchestra.run.smithi064.stdout:ID=ubuntu 2023-06-18T19:01:57.208 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE=debian 2023-06-18T19:01:57.209 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-18T19:01:57.209 INFO:teuthology.orchestra.run.smithi064.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-18T19:01:57.209 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-18T19:01:57.209 INFO:teuthology.orchestra.run.smithi064.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-18T19:01:57.209 INFO:teuthology.orchestra.run.smithi064.stdout:UBUNTU_CODENAME=jammy 2023-06-18T19:01:57.210 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-06-18T19:01:57.234 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-06-18T19:01:57.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-06-18T19:01:57.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-18T19:01:57.306 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-06-18T19:01:57.399 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-06-18T19:01:57.444 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-06-18T19:01:57.445 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-06-18T19:01:57.488 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-18T19:01:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2023-06-18T19:01:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="22.04" 2023-06-18T19:01:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-18T19:01:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=jammy 2023-06-18T19:01:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2023-06-18T19:01:57.489 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2023-06-18T19:01:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-18T19:01:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-18T19:01:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-18T19:01:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-18T19:01:57.490 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=jammy 2023-06-18T19:01:57.490 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-06-18T19:01:57.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:01:57.509 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:01:57.608 INFO:teuthology.dispatcher.supervisor:Running job 7307179 2023-06-18T19:01:57.608 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-06-18_18:23:06-rbd-wip-61616-distro-default-smithi/7307179 --name dis-2023-06-18_18:23:06-rbd-wip-61616-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} -- /home/teuthworker/archive/dis-2023-06-18_18:23:06-rbd-wip-61616-distro-default-smithi/7307179/orig.config.yaml 2023-06-18T19:01:57.611 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-06-18_18:23:06-rbd-wip-61616-distro-default-smithi/7307179 2023-06-18T19:01:57.612 INFO:teuthology.dispatcher.supervisor:Job PID: 23180 2023-06-18T19:01:57.612 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-18T19:03:57.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:03:57.714 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:05:57.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:05:57.881 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:07:58.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:07:58.047 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:09:58.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:09:58.259 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:11:58.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:11:58.441 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:13:58.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:13:58.629 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:15:58.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:15:58.810 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:17:58.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:17:58.985 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:19:59.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:19:59.166 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:21:59.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:21:59.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:23:59.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:23:59.608 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:25:59.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:25:59.777 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:27:59.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:27:59.946 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:30:00.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:30:00.122 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:32:00.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:32:00.293 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:34:00.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:34:00.466 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:36:00.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:36:00.640 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:38:00.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:38:00.809 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:40:00.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:40:00.979 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:42:01.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:42:01.162 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:44:01.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:44:01.334 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:46:01.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:46:01.505 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:48:01.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:48:01.678 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:50:01.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:50:01.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:52:02.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:52:02.042 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:54:02.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:54:02.227 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:56:02.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:56:02.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T19:58:02.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T19:58:02.589 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T20:00:02.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-18T20:00:02.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-18T20:00:02.832 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-18T20:00:02.952 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-18T20:00:02.953 INFO:teuthology.nuke:Checking targets against current locks 2023-06-18T20:00:03.001 DEBUG:teuthology.nuke:shortname: smithi064 2023-06-18T20:00:03.002 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-18T20:00:03.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-06-18_18:23:06-rbd-wip-61616-distro-default-smithi/7307179', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-18 18:56:11.395931', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBS81IBCmgYfhwx0O5EtR3fj5+E1/t28sdfHtMgr40L9'} 2023-06-18T20:00:03.030 DEBUG:teuthology.nuke:shortname: smithi116 2023-06-18T20:00:03.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-18T20:00:03.050 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-06-18_18:23:06-rbd-wip-61616-distro-default-smithi/7307179', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-18 18:56:11.397963', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO90UDnvCvwbu9HkWhUF5ru5KRvZtXCNCtF8QW4XuJXNYq8TlatVjxgFiT4Gez289Qk8j8Z+lrmeITrZrskU5Hw='} 2023-06-18T20:00:03.076 INFO:teuthology.orchestra.console:Power off smithi064 2023-06-18T20:00:03.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T20:00:03.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T20:00:03.121 INFO:teuthology.orchestra.console:Power off smithi116 2023-06-18T20:00:03.122 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-18T20:00:03.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-18T20:00:03.232 INFO:teuthology.orchestra.console:Power off for smithi064 completed 2023-06-18T20:00:03.263 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-06-18T20:00:03.389 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-06-18T20:00:03.414 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com