2023-07-04T03:59:07.580 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-04T03:59:07.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T03:59:07.584 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T03:59:07.743 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f10f7b4ad30>, signals=[15]) 2023-07-04T03:59:07.744 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-07-04T03:59:07.745 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-07-04T03:59:07.745 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-07-04T03:59:07.766 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-07-04T03:59:07.767 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-07-04T03:59:07.767 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-04T03:59:07.768 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-07-04T03:59:07.791 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-07-04T03:59:07.850 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-04T03:59:07.860 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-04T03:59:07.889 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-04T03:59:07.890 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 6} 2023-07-04T03:59:07.911 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-04T03:59:07.912 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 6} 2023-07-04T03:59:07.938 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of ubuntu 22.04 2023-07-04T03:59:07.939 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T03:59:07.956 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 22.04 2023-07-04T03:59:07.957 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T03:59:08.002 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-07-04T03:59:08.018 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-07-04T03:59:08.043 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-07-04T03:59:08.048 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-07-04T03:59:08.105 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T03:59:08.108 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T03:59:08.210 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-04T03:59:08.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T03:59:08.228 INFO:teuthology.orchestra.console:Power off smithi104 2023-07-04T03:59:08.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T03:59:08.240 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:08.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:12.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:12.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:16.384 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:16.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:16.596 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-04T03:59:16.604 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-07-04T03:59:16.698 INFO:teuthology.orchestra.console:Power on smithi123 2023-07-04T03:59:16.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-04T03:59:16.708 INFO:teuthology.orchestra.console:Power on smithi104 2023-07-04T03:59:16.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-04T03:59:16.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:16.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:20.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:20.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:24.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:24.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T03:59:25.126 INFO:teuthology.orchestra.console:Power on for smithi104 completed 2023-07-04T03:59:25.175 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2023-07-04T03:59:25.228 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-07-04T03:59:25.229 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T03:59:25.276 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-07-04T03:59:25.277 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T03:59:40.312 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T03:59:40.342 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T03:59:55.404 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T03:59:55.415 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:00:10.484 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:00:10.486 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:00:25.572 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:00:25.573 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:00:40.668 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:00:40.670 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:00:55.760 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:00:55.762 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:01:10.853 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:01:10.854 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:01:25.936 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:01:25.938 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:01:41.008 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:01:41.009 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:01:56.108 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:01:56.109 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:02:11.201 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:02:11.202 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:02:26.296 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:02:26.297 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:02:41.388 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-07-04T04:02:41.390 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-04T04:02:41.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:02:41.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:02:44.528 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-04T04:02:44.560 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-04T04:02:50.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:02:50.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:02:53.584 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-04T04:02:53.620 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-04T04:02:59.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:02:59.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:03:02.676 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-04T04:03:02.677 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-04T04:03:08.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:03:08.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:03:11.760 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-04T04:03:11.761 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-04T04:03:17.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:03:17.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:03:20.816 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-04T04:03:20.817 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-04T04:03:26.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:03:26.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:03:29.872 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-07-04T04:03:29.873 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-04T04:03:35.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:03:35.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:35.936 WARNING:teuthology.provision.fog.smithi123:timed out 2023-07-04T04:04:35.938 WARNING:teuthology.provision.fog.smithi104:timed out 2023-07-04T04:04:41.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:41.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:42.210 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-04T04:04:42.211 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-04T04:04:42.219 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-04T04:04:42.219 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-04T04:04:42.668 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-07-04T04:04:42.669 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-07-04T04:04:42.713 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-07-04T04:04:42.714 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-07-04T04:04:42.762 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-07-04T04:04:42.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-07-04T04:04:42.769 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-07-04T04:04:42.769 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-07-04T04:04:42.816 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-07-04T04:04:42.816 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-07-04T04:04:42.864 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-07-04T04:04:42.865 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-07-04T04:04:42.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-07-04T04:04:42.902 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-07-04T04:04:42.961 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-07-04T04:04:43.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-07-04T04:04:43.018 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-07-04T04:04:43.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-07-04T04:04:43.077 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-07-04T04:04:43.088 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-07-04T04:04:43.126 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-04T04:04:43.126 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-07-04T04:04:43.126 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2023-07-04T04:04:43.126 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-04T04:04:43.127 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2023-07-04T04:04:43.127 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-07-04T04:04:43.127 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-07-04T04:04:43.127 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-04T04:04:43.127 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-04T04:04:43.127 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-04T04:04:43.127 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-04T04:04:43.128 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2023-07-04T04:04:43.128 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-07-04T04:04:43.130 DEBUG:teuthology.parallel:result is None 2023-07-04T04:04:43.148 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-07-04T04:04:43.207 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-07-04T04:04:43.256 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-04T04:04:43.256 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-07-04T04:04:43.256 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2023-07-04T04:04:43.256 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-04T04:04:43.256 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2023-07-04T04:04:43.257 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-07-04T04:04:43.257 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-07-04T04:04:43.257 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-04T04:04:43.257 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-04T04:04:43.257 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-04T04:04:43.257 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-04T04:04:43.257 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2023-07-04T04:04:43.258 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-07-04T04:04:43.258 DEBUG:teuthology.parallel:result is None 2023-07-04T04:04:43.453 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-07-04T04:04:43.454 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-04T04:04:43.482 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-07-04T04:04:43.483 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-04T04:04:43.508 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-07-04T04:04:43.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-07-04T04:04:43.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:43.584 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-07-04T04:04:43.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-07-04T04:04:43.692 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-07-04T04:04:43.740 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-07-04T04:04:43.740 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-07-04T04:04:43.789 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-04T04:04:43.789 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2023-07-04T04:04:43.789 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="22.04" 2023-07-04T04:04:43.789 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-04T04:04:43.790 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=jammy 2023-07-04T04:04:43.790 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2023-07-04T04:04:43.790 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2023-07-04T04:04:43.790 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-04T04:04:43.791 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-04T04:04:43.791 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-04T04:04:43.791 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-04T04:04:43.791 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=jammy 2023-07-04T04:04:43.792 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-07-04T04:04:43.824 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-07-04T04:04:43.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-04T04:04:43.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:43.898 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-07-04T04:04:43.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-07-04T04:04:43.992 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-07-04T04:04:44.037 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-07-04T04:04:44.037 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-07-04T04:04:44.085 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-04T04:04:44.085 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-07-04T04:04:44.085 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2023-07-04T04:04:44.085 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-04T04:04:44.085 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2023-07-04T04:04:44.086 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-07-04T04:04:44.086 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-07-04T04:04:44.086 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-04T04:04:44.086 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-04T04:04:44.086 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-04T04:04:44.086 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-04T04:04:44.086 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2023-07-04T04:04:44.087 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-07-04T04:04:44.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:04:44.108 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:04:44.212 INFO:teuthology.dispatcher.supervisor:Running job 7325920 2023-07-04T04:04:44.212 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325920 --name prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325920/orig.config.yaml 2023-07-04T04:04:44.215 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325920 2023-07-04T04:04:44.216 INFO:teuthology.dispatcher.supervisor:Job PID: 5670 2023-07-04T04:04:44.216 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-04T04:06:44.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:06:44.317 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:08:44.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:08:44.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:10:44.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:10:44.671 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:12:44.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:12:44.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:14:45.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:14:45.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:16:45.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:16:45.234 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:18:45.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:18:45.418 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:20:45.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:20:45.589 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:22:45.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:22:45.772 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:24:45.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:24:45.960 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:26:46.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:26:46.130 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:28:46.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:28:46.304 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:30:46.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:30:46.479 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:32:46.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:32:46.657 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:34:46.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:34:46.826 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:36:47.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:36:47.002 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:38:47.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:38:47.172 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:40:47.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:40:47.345 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:42:47.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:42:47.522 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:44:47.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:44:47.690 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:46:47.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:46:47.865 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:46:47.943 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-04T04:46:48.063 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-04T04:46:48.064 INFO:teuthology.nuke:Checking targets against current locks 2023-07-04T04:46:48.113 DEBUG:teuthology.nuke:shortname: smithi104 2023-07-04T04:46:48.114 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-04T04:46:48.139 DEBUG:teuthology.nuke:shortname: smithi123 2023-07-04T04:46:48.139 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-04T04:46:48.144 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325920', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 03:59:06.770111', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILH1tyVyx4JVNOFiqdEf0n27d0wmPUXk8g5nvtgyNMqQ'} 2023-07-04T04:46:48.163 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325920', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 03:59:06.772239', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8KqZh6x8oM3Ute0nDsSfg2ON6Hl55LMiBMT6ndEwVl6stkOt0CadlYkTBNleD2rDCtueiVDzWH9nxgA2OWOYw='} 2023-07-04T04:46:48.203 INFO:teuthology.orchestra.console:Power off smithi104 2023-07-04T04:46:48.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T04:46:48.221 INFO:teuthology.orchestra.console:Power off smithi123 2023-07-04T04:46:48.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T04:46:48.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:46:48.243 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:46:48.356 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-07-04T04:46:48.367 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-07-04T04:46:48.517 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com 2023-07-04T04:46:48.527 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com