2023-07-24T05:12:49.907 INFO:root:teuthology version: 0.0.1.dev158+g1426592 2023-07-24T05:12:49.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:12:49.909 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:12:50.069 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa35c5903a0>, signals=[15]) 2023-07-24T05:12:50.071 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-07-24T05:12:50.071 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:12:50.071 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-24T05:12:50.097 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-07-24T05:12:50.097 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:12:50.097 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-24T05:12:50.099 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-07-24T05:12:50.122 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-07-24T05:12:50.179 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-24T05:12:50.208 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-24T05:12:50.230 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-24T05:12:50.230 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 6} 2023-07-24T05:12:50.258 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-24T05:12:50.259 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 6} 2023-07-24T05:12:50.287 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of ubuntu 22.04 2023-07-24T05:12:50.287 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:12:50.319 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of ubuntu 22.04 2023-07-24T05:12:50.319 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:12:50.618 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:12:50.623 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:12:50.666 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-07-24T05:12:50.670 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-07-24T05:12:50.737 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:12:50.755 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:12:51.105 INFO:teuthology.orchestra.console:Power off smithi012 2023-07-24T05:12:51.107 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:12:51.122 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-24T05:12:51.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:12:51.132 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:12:51.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:12:51.146 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:12:51.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:12:51.155 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:12:51.166 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:12:51.257 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-07-24T05:12:51.267 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-24T05:12:51.358 INFO:teuthology.orchestra.console:Power on smithi012 2023-07-24T05:12:51.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:12:51.368 INFO:teuthology.orchestra.console:Power on smithi118 2023-07-24T05:12:51.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:12:51.379 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:12:51.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:12:51.389 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:12:51.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:12:51.401 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:12:51.410 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:12:55.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:12:55.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:12:55.513 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:12:55.521 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:12:59.516 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:12:59.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:12:59.627 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:12:59.686 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:12:59.728 INFO:teuthology.orchestra.console:Power on for smithi012 completed 2023-07-24T05:12:59.787 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-07-24T05:12:59.830 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-07-24T05:12:59.830 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:12:59.889 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-07-24T05:12:59.889 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:13:15.179 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:13:15.193 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:13:30.500 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:13:30.501 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:13:45.832 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:13:45.893 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:14:01.128 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:14:01.165 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:14:16.488 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:14:16.493 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:14:31.756 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:14:31.757 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:14:47.072 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:14:47.073 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:15:02.408 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:15:02.492 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:15:17.652 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:15:17.672 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:15:32.878 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:15:32.879 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:15:48.108 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:15:48.110 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:16:03.313 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:16:03.314 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:16:18.548 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:16:18.593 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:16:33.764 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:16:33.765 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:16:48.936 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:16:48.937 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:17:04.120 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:17:04.121 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:17:19.288 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:17:19.290 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:17:34.484 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:17:34.485 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:17:49.667 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-24T05:17:49.668 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-24T05:17:49.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:17:49.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:17:52.880 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:17:52.912 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:17:58.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:17:58.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:01.936 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:18:01.972 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:18:07.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:07.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:10.992 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:18:11.024 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:18:16.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:17.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:20.084 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:18:20.085 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:18:26.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:26.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:29.168 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:18:29.169 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:18:35.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:35.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:38.224 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:18:44.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:47.280 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:18:53.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:53.552 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:18:56.336 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:18:59.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:02.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:02.612 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:19:05.392 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:19:08.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:10.672 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:19:11.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:16.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:16.680 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:19:22.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:22.686 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-24T05:19:28.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:42.964 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:19:44.150 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:19:44.152 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:19:44.598 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-07-24T05:19:44.599 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-07-24T05:19:44.646 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-07-24T05:19:44.646 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-07-24T05:19:44.694 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-07-24T05:19:44.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-07-24T05:19:44.840 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-07-24T05:19:44.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-07-24T05:19:44.910 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-07-24T05:19:44.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-07-24T05:19:45.029 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-07-24T05:19:45.082 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-24T05:19:45.082 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-07-24T05:19:45.082 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="22.04" 2023-07-24T05:19:45.083 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-24T05:19:45.083 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=jammy 2023-07-24T05:19:45.083 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-07-24T05:19:45.083 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-07-24T05:19:45.083 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-24T05:19:45.083 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-24T05:19:45.083 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-24T05:19:45.084 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-24T05:19:45.084 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=jammy 2023-07-24T05:19:45.084 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-07-24T05:19:45.086 DEBUG:teuthology.parallel:result is None 2023-07-24T05:19:48.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:48.967 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:19:54.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:54.970 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:20:00.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:00.978 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:20:06.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:06.987 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-24T05:20:12.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:13.194 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:20:13.195 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:20:13.651 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-07-24T05:20:13.652 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-07-24T05:20:13.699 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2023-07-24T05:20:13.699 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2023-07-24T05:20:13.747 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-07-24T05:20:13.747 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-24T05:20:13.891 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2023-07-24T05:20:13.905 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2023-07-24T05:20:13.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2023-07-24T05:20:14.020 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-24T05:20:14.078 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-24T05:20:14.123 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-24T05:20:14.123 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-07-24T05:20:14.124 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="22.04" 2023-07-24T05:20:14.124 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-24T05:20:14.124 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=jammy 2023-07-24T05:20:14.124 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-07-24T05:20:14.124 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-07-24T05:20:14.124 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-24T05:20:14.124 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-24T05:20:14.125 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-24T05:20:14.125 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-24T05:20:14.125 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=jammy 2023-07-24T05:20:14.125 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-07-24T05:20:14.126 DEBUG:teuthology.parallel:result is None 2023-07-24T05:20:14.307 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-07-24T05:20:14.308 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:20:14.339 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-07-24T05:20:14.339 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:20:14.365 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:20:14.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-24T05:20:14.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:14.446 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-07-24T05:20:14.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-24T05:20:14.669 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-07-24T05:20:14.717 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-07-24T05:20:14.717 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-07-24T05:20:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-24T05:20:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-07-24T05:20:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="22.04" 2023-07-24T05:20:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-24T05:20:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=jammy 2023-07-24T05:20:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-07-24T05:20:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-07-24T05:20:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-24T05:20:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-24T05:20:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-24T05:20:14.767 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-24T05:20:14.767 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=jammy 2023-07-24T05:20:14.767 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-24T05:20:14.789 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:20:14.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-24T05:20:14.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:14.865 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-07-24T05:20:14.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-24T05:20:14.988 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-07-24T05:20:15.035 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-07-24T05:20:15.035 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-24T05:20:15.086 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-24T05:20:15.087 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-07-24T05:20:15.087 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="22.04" 2023-07-24T05:20:15.087 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-24T05:20:15.087 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=jammy 2023-07-24T05:20:15.087 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-07-24T05:20:15.088 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-07-24T05:20:15.088 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-24T05:20:15.088 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-24T05:20:15.088 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-24T05:20:15.088 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-24T05:20:15.088 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=jammy 2023-07-24T05:20:15.089 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-24T05:20:15.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:20:15.115 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:20:15.212 INFO:teuthology.dispatcher.supervisor:Running job 7349275 2023-07-24T05:20:15.213 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_1426592083662fef3e03bbeec33624331f0fdbc1/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349275 --name vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} -- /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349275/orig.config.yaml 2023-07-24T05:20:15.216 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349275 2023-07-24T05:20:15.217 INFO:teuthology.dispatcher.supervisor:Job PID: 29485 2023-07-24T05:20:15.217 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-24T05:22:15.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:22:15.219 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:24:15.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:24:15.314 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:26:15.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:26:15.381 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:28:15.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:28:15.454 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:30:15.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:30:15.526 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:32:15.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:32:15.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:34:15.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:34:15.787 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:36:15.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:36:15.961 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:38:16.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:38:16.137 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:40:16.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:40:16.318 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:42:16.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:42:16.477 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:44:16.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:44:16.624 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:46:16.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:46:16.736 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:48:16.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:48:16.903 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:50:17.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:50:17.049 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:52:17.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:52:17.201 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:52:17.259 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-24T05:52:17.356 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-24T05:52:17.356 INFO:teuthology.nuke:Checking targets against current locks 2023-07-24T05:52:17.395 DEBUG:teuthology.nuke:shortname: smithi012 2023-07-24T05:52:17.396 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-24T05:52:17.416 DEBUG:teuthology.nuke:shortname: smithi118 2023-07-24T05:52:17.417 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-24T05:52:17.419 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:12:49.083720', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4BdCY99VTgWc/RPVjDIaimytrryixgTD95Kju70O3aekv4ONnsc7WyAYzujikuUnVDm72c/iUrEpu3cyFUt3Q='} 2023-07-24T05:52:17.440 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349275', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:12:49.085450', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJNbSdpPgewR/at1A632B8qLdr/e5asCNazhiJEb7CXVYExQtqfka+qK0iFoPSPwWJIUVNP6j8+WeXG77i2TpnQ='} 2023-07-24T05:52:17.468 INFO:teuthology.orchestra.console:Power off smithi012 2023-07-24T05:52:17.469 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:52:17.482 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-24T05:52:17.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:52:17.491 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:52:17.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:52:17.502 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:52:17.503 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:52:17.513 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:52:17.525 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:52:17.615 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-07-24T05:52:17.627 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-24T05:52:17.769 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-07-24T05:52:17.775 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com