2023-06-23T08:29:20.100 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T08:29:20.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:29:20.101 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:29:20.256 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f70f66078b0>, signals=[15]) 2023-06-23T08:29:20.258 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-06-23T08:29:20.258 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T08:29:20.259 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-06-23T08:29:20.281 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-06-23T08:29:20.281 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T08:29:20.282 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-06-23T08:29:20.283 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /host {"name": "smithi078"} 2023-06-23T08:29:20.306 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"} 2023-06-23T08:29:20.363 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-23T08:29:20.374 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-23T08:29:20.407 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-23T08:29:20.407 DEBUG:teuthology.provision.fog.smithi078:FOG request: PUT /host/183 {"imageID": 2} 2023-06-23T08:29:20.416 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-23T08:29:20.416 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 2} 2023-06-23T08:29:20.446 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of ubuntu 20.04 2023-06-23T08:29:20.447 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:29:20.455 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of ubuntu 20.04 2023-06-23T08:29:20.455 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:29:20.502 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T08:29:20.508 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T08:29:20.535 DEBUG:teuthology.provision.fog.smithi078:FOG request: POST /host/183/task {"taskTypeID": 1} 2023-06-23T08:29:20.548 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1} 2023-06-23T08:29:20.601 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:29:20.610 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:29:20.702 INFO:teuthology.orchestra.console:Power off smithi078 2023-06-23T08:29:20.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T08:29:20.716 INFO:teuthology.orchestra.console:Power off smithi154 2023-06-23T08:29:20.716 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T08:29:20.726 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:20.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:24.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:24.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:28.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:28.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:29.085 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-06-23T08:29:29.186 INFO:teuthology.orchestra.console:Power on smithi154 2023-06-23T08:29:29.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T08:29:29.208 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:32.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:33.190 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-06-23T08:29:33.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:33.292 INFO:teuthology.orchestra.console:Power on smithi078 2023-06-23T08:29:33.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T08:29:33.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:33.443 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2023-06-23T08:29:33.544 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-06-23T08:29:33.545 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:29:37.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T08:29:37.547 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2023-06-23T08:29:37.648 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-06-23T08:29:37.648 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:29:48.620 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:29:52.712 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:30:03.688 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:30:07.775 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:30:18.776 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:30:22.844 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:30:33.856 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:30:37.912 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:30:48.932 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:30:52.982 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:31:04.012 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:31:08.045 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:31:19.081 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:31:23.112 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:31:34.148 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:31:38.168 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:31:49.210 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:31:53.228 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:32:04.276 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:32:08.284 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:32:19.340 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:32:23.343 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:32:34.393 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:32:38.405 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:32:49.456 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:32:53.466 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:33:04.520 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:33:08.529 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:33:19.586 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:33:23.592 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-06-23T08:33:23.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:33:34.648 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-06-23T08:33:34.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:33:42.000 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-23T08:33:48.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:33:51.056 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-23T08:33:53.264 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-06-23T08:33:57.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:33:59.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:00.112 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-23T08:34:02.320 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-06-23T08:34:06.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:08.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:09.168 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-23T08:34:11.376 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-06-23T08:34:15.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:17.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:18.224 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-23T08:34:20.432 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-06-23T08:34:24.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:26.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:29.488 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-06-23T08:34:35.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:42.672 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-23T08:34:48.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:51.732 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-23T08:34:57.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:34:58.412 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T08:34:58.413 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T08:35:07.686 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T08:35:07.687 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T08:35:19.501 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-06-23T08:35:19.502 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2023-06-23T08:35:19.508 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2023-06-23T08:35:19.508 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts 2023-06-23T08:35:19.515 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2023-06-23T08:35:19.515 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-06-23T08:35:19.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts 2023-06-23T08:35:19.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2023-06-23T08:35:19.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname 2023-06-23T08:35:19.725 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-06-23T08:35:19.734 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-06-23T08:35:19.740 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2023-06-23T08:35:19.741 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T08:35:19.741 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2023-06-23T08:35:19.741 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2023-06-23T08:35:19.741 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T08:35:19.741 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="20.04" 2023-06-23T08:35:19.741 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T08:35:19.741 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T08:35:19.742 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T08:35:19.742 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T08:35:19.742 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=focal 2023-06-23T08:35:19.742 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=focal 2023-06-23T08:35:19.743 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-06-23T08:35:19.744 DEBUG:teuthology.parallel:result is None 2023-06-23T08:35:28.732 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-06-23T08:35:28.733 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-06-23T08:35:28.740 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-06-23T08:35:28.740 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2023-06-23T08:35:28.747 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-06-23T08:35:28.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-06-23T08:35:28.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2023-06-23T08:35:28.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-06-23T08:35:28.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2023-06-23T08:35:28.908 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-06-23T08:35:28.918 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-06-23T08:35:28.922 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2023-06-23T08:35:28.922 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T08:35:28.922 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2023-06-23T08:35:28.923 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2023-06-23T08:35:28.923 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T08:35:28.923 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="20.04" 2023-06-23T08:35:28.923 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T08:35:28.923 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T08:35:28.923 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T08:35:28.923 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T08:35:28.924 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=focal 2023-06-23T08:35:28.924 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=focal 2023-06-23T08:35:28.924 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-06-23T08:35:28.925 DEBUG:teuthology.parallel:result is None 2023-06-23T08:35:29.194 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2023-06-23T08:35:29.195 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T08:35:29.225 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-06-23T08:35:29.225 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T08:35:29.251 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2023-06-23T08:35:29.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-23T08:35:29.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:35:29.301 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-06-23T08:35:29.421 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-06-23T08:35:29.427 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-06-23T08:35:29.428 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-06-23T08:35:29.433 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2023-06-23T08:35:29.433 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T08:35:29.434 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2023-06-23T08:35:29.434 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2023-06-23T08:35:29.434 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T08:35:29.434 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="20.04" 2023-06-23T08:35:29.434 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T08:35:29.434 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T08:35:29.434 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T08:35:29.435 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T08:35:29.435 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=focal 2023-06-23T08:35:29.435 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=focal 2023-06-23T08:35:29.435 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-06-23T08:35:29.458 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-06-23T08:35:29.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-06-23T08:35:29.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T08:35:29.505 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-06-23T08:35:29.625 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-06-23T08:35:29.672 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-06-23T08:35:29.672 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-06-23T08:35:29.678 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2023-06-23T08:35:29.678 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T08:35:29.678 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2023-06-23T08:35:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2023-06-23T08:35:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T08:35:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="20.04" 2023-06-23T08:35:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T08:35:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T08:35:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T08:35:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T08:35:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=focal 2023-06-23T08:35:29.680 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=focal 2023-06-23T08:35:29.680 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-06-23T08:35:29.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:35:29.700 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:35:29.805 INFO:teuthology.dispatcher.supervisor:Running job 7312895 2023-06-23T08:35:29.806 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_20:26:47-rbd-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7312895 --name yuriw-2023-06-22_20:26:47-rbd-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_20.04} workloads/rbd-mirror-journal-stress-workunit} -- /home/teuthworker/archive/yuriw-2023-06-22_20:26:47-rbd-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7312895/orig.config.yaml 2023-06-23T08:35:29.810 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_20:26:47-rbd-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7312895 2023-06-23T08:35:29.811 INFO:teuthology.dispatcher.supervisor:Job PID: 9227 2023-06-23T08:35:29.811 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-23T08:37:29.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:37:29.909 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:39:30.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:39:30.086 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:41:30.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:41:30.259 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:43:30.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:43:30.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:45:30.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:45:30.606 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:47:30.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:47:30.778 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:49:30.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:49:30.949 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:51:31.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:51:31.114 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:53:31.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:53:31.272 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:55:31.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:55:31.382 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:57:31.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:57:31.528 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T08:59:31.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T08:59:31.673 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:01:31.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:01:31.846 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:03:32.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:03:32.010 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:05:32.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:05:32.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:07:32.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:07:32.372 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:09:32.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:09:32.538 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:11:32.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:11:32.714 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:13:32.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:13:32.886 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:15:33.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:15:33.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:17:33.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:17:33.252 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:19:33.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:19:33.429 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:21:33.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T09:21:33.602 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T09:21:33.675 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-23T09:21:33.888 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-23T09:21:33.889 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T09:21:33.950 DEBUG:teuthology.nuke:shortname: smithi078 2023-06-23T09:21:33.950 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T09:21:33.976 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_20:26:47-rbd-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7312895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 08:29:19.291457', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-23T09:21:33.979 DEBUG:teuthology.nuke:shortname: smithi154 2023-06-23T09:21:33.979 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T09:21:34.007 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_20:26:47-rbd-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7312895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 08:29:19.289134', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-23T09:21:34.041 INFO:teuthology.orchestra.console:Power off smithi078 2023-06-23T09:21:34.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T09:21:34.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T09:21:34.086 INFO:teuthology.orchestra.console:Power off smithi154 2023-06-23T09:21:34.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T09:21:34.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T09:21:34.197 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-06-23T09:21:34.228 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-06-23T09:21:34.360 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2023-06-23T09:21:34.382 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com