2023-07-20T11:30:03.990 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T11:30:03.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:30:03.992 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:30:04.161 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbc00fa58b0>, signals=[15]) 2023-07-20T11:30:04.162 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-20T11:30:04.162 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T11:30:04.163 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-20T11:30:04.186 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-20T11:30:04.186 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T11:30:04.187 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-20T11:30:04.188 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-20T11:30:04.211 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-20T11:30:04.279 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-20T11:30:04.298 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-20T11:30:04.322 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-20T11:30:04.322 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 2} 2023-07-20T11:30:04.340 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-20T11:30:04.341 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 2} 2023-07-20T11:30:04.365 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of ubuntu 20.04 2023-07-20T11:30:04.365 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:30:04.380 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 20.04 2023-07-20T11:30:04.380 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:30:04.420 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T11:30:04.437 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T11:30:04.452 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-20T11:30:04.475 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-20T11:30:04.506 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:30:04.531 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:30:04.596 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-20T11:30:04.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T11:30:04.614 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-20T11:30:04.615 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T11:30:04.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:30:04.637 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:30:04.751 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-20T11:30:04.760 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-20T11:30:04.853 INFO:teuthology.orchestra.console:Power on smithi026 2023-07-20T11:30:04.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T11:30:04.862 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-20T11:30:04.863 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T11:30:04.879 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:30:04.894 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:30:08.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:30:08.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:30:09.127 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-07-20T11:30:09.136 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-20T11:30:09.229 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-20T11:30:09.229 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:30:09.237 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-20T11:30:09.237 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:30:24.288 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:30:24.290 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:30:39.352 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:30:39.353 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:30:54.428 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:30:54.429 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:31:09.504 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:31:09.506 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:31:24.569 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:31:24.571 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:31:39.634 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:31:39.635 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:31:54.704 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:31:54.705 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:32:09.773 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:32:09.774 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:32:24.844 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:32:24.845 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:32:39.916 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:32:39.917 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:32:54.986 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:32:54.988 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:33:10.060 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:33:10.061 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:33:25.116 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:33:25.117 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:33:40.196 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:33:40.197 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-20T11:33:40.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:33:43.348 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:33:49.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:33:52.432 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:33:55.270 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-20T11:33:55.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:33:58.384 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:33:58.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:01.488 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:34:04.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:07.440 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:34:07.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:10.548 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:34:13.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:16.496 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:34:16.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:19.600 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-20T11:34:22.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:25.552 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:34:25.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:31.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:34.608 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:34:40.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:34:43.664 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-20T11:34:49.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:35:25.638 WARNING:teuthology.provision.fog.smithi026:timed out 2023-07-20T11:35:31.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:35:31.782 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T11:35:31.783 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T11:35:32.295 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-20T11:35:32.296 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-20T11:35:32.343 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-07-20T11:35:32.344 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-07-20T11:35:32.351 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-07-20T11:35:32.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-20T11:35:32.446 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-07-20T11:35:32.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-07-20T11:35:32.477 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-07-20T11:35:32.489 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-20T11:35:32.550 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-20T11:35:32.554 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2023-07-20T11:35:32.554 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-20T11:35:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2023-07-20T11:35:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2023-07-20T11:35:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-20T11:35:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="20.04" 2023-07-20T11:35:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T11:35:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T11:35:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T11:35:32.556 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T11:35:32.556 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=focal 2023-07-20T11:35:32.556 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=focal 2023-07-20T11:35:32.556 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-20T11:35:32.558 DEBUG:teuthology.parallel:result is None 2023-07-20T11:35:49.684 WARNING:teuthology.provision.fog.smithi149:timed out 2023-07-20T11:35:55.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:35:55.906 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T11:35:55.906 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T11:35:56.395 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-20T11:35:56.395 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-20T11:35:56.442 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-20T11:35:56.443 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-20T11:35:56.449 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-20T11:35:56.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-20T11:35:56.542 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-20T11:35:56.557 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-20T11:35:56.615 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-20T11:35:56.627 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-20T11:35:56.641 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-20T11:35:56.645 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-07-20T11:35:56.645 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-20T11:35:56.645 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-07-20T11:35:56.645 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-07-20T11:35:56.645 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-20T11:35:56.645 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-07-20T11:35:56.646 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T11:35:56.646 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T11:35:56.646 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T11:35:56.646 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T11:35:56.646 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-07-20T11:35:56.646 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-07-20T11:35:56.647 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-20T11:35:56.647 DEBUG:teuthology.parallel:result is None 2023-07-20T11:35:56.893 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-07-20T11:35:56.894 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T11:35:56.919 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-20T11:35:56.919 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T11:35:56.945 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-07-20T11:35:56.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-20T11:35:56.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:35:56.993 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-07-20T11:35:57.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-20T11:35:57.198 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-07-20T11:35:57.203 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-07-20T11:35:57.204 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-20T11:35:57.252 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2023-07-20T11:35:57.252 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-20T11:35:57.252 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2023-07-20T11:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2023-07-20T11:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-20T11:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="20.04" 2023-07-20T11:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T11:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T11:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T11:35:57.253 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T11:35:57.254 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=focal 2023-07-20T11:35:57.254 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=focal 2023-07-20T11:35:57.254 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-20T11:35:57.286 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-20T11:35:57.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-20T11:35:57.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T11:35:57.336 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-20T11:35:57.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-20T11:35:57.466 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-20T11:35:57.472 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-20T11:35:57.473 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-20T11:35:57.478 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-07-20T11:35:57.479 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-20T11:35:57.479 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-07-20T11:35:57.479 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-07-20T11:35:57.479 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-20T11:35:57.479 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-07-20T11:35:57.479 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T11:35:57.480 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T11:35:57.480 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T11:35:57.480 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T11:35:57.480 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-07-20T11:35:57.480 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-07-20T11:35:57.481 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-20T11:35:57.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:35:57.520 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:35:57.626 INFO:teuthology.dispatcher.supervisor:Running job 7344647 2023-07-20T11:35:57.627 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344647 --name vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} -- /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344647/orig.config.yaml 2023-07-20T11:35:57.630 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344647 2023-07-20T11:35:57.631 INFO:teuthology.dispatcher.supervisor:Job PID: 3784 2023-07-20T11:35:57.632 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-20T11:37:57.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:37:57.734 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:39:57.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:39:57.925 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:41:58.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:41:58.094 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:43:58.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:43:58.264 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:45:58.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:45:58.433 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:47:58.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:47:58.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:49:58.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:49:58.779 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:51:58.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:51:58.943 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:53:59.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:53:59.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:55:59.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:55:59.214 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:57:59.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:57:59.375 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T11:59:59.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:59:59.546 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T12:01:59.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T12:01:59.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T12:03:59.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T12:03:59.977 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T12:06:00.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T12:06:00.147 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T12:08:00.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T12:08:00.334 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T12:08:00.401 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-20T12:08:00.563 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-20T12:08:00.563 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T12:08:00.621 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-20T12:08:00.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T12:08:00.642 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-20T12:08:00.643 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T12:08:00.645 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344647', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 11:30:03.103483', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-20T12:08:00.666 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344647', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 11:30:03.101986', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-20T12:08:00.695 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-20T12:08:00.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T12:08:00.713 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-20T12:08:00.714 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T12:08:00.723 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T12:08:00.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T12:08:00.845 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-20T12:08:00.854 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-20T12:08:01.008 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-07-20T12:08:01.017 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com