2023-06-26T17:00:47.067 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-26T17:00:47.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:00:47.069 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:01:01.809 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3ca68d1430>, signals=[15]) 2023-06-26T17:01:01.810 INFO:teuthology.lock.ops:Start node 'smithi182.front.sepia.ceph.com' reimaging 2023-06-26T17:01:01.811 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T17:01:01.811 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2023-06-26T17:01:01.831 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-06-26T17:01:01.833 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T17:01:01.833 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-06-26T17:01:01.834 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /host {"name": "smithi182"} 2023-06-26T17:01:06.864 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-06-26T17:01:11.971 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-26T17:01:22.011 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-26T17:01:27.017 DEBUG:teuthology.provision.fog.smithi182:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-26T17:01:27.017 DEBUG:teuthology.provision.fog.smithi182:FOG request: PUT /host/287 {"imageID": 6} 2023-06-26T17:01:32.072 INFO:teuthology.provision.fog.smithi182:Scheduling deploy of ubuntu 22.04 2023-06-26T17:01:32.073 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:01:37.078 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-26T17:01:37.079 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 6} 2023-06-26T17:01:37.142 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of ubuntu 22.04 2023-06-26T17:01:37.142 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-26T17:01:37.151 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T17:01:37.184 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T17:01:37.187 DEBUG:teuthology.provision.fog.smithi182:FOG request: POST /host/287/task {"taskTypeID": 1} 2023-06-26T17:01:37.227 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-06-26T17:01:37.233 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:01:42.293 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-26T17:01:47.031 INFO:teuthology.orchestra.console:Power off smithi182 2023-06-26T17:01:47.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T17:01:52.062 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:01:52.097 INFO:teuthology.orchestra.console:Power off smithi187 2023-06-26T17:01:52.097 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T17:01:57.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:01:57.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:01:57.290 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2023-06-26T17:01:57.391 INFO:teuthology.orchestra.console:Power on smithi182 2023-06-26T17:01:57.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T17:02:02.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:02.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:06.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:07.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:10.557 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:10.768 INFO:teuthology.orchestra.console:Power on for smithi182 completed 2023-06-26T17:02:10.869 INFO:teuthology.provision.fog.smithi182:Waiting for deploy to finish 2023-06-26T17:02:10.870 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:02:12.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:17.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:22.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:27.340 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:02:27.701 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:32.813 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:37.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:42.408 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:02:43.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:48.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:48.362 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2023-06-26T17:02:48.464 INFO:teuthology.orchestra.console:Power on smithi187 2023-06-26T17:02:48.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T17:02:48.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:52.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:02:57.484 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:03:02.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:03:07.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:03:12.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:03:12.937 INFO:teuthology.orchestra.console:Power on for smithi187 completed 2023-06-26T17:03:13.040 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-06-26T17:03:13.041 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-06-26T17:03:16.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:03:17.585 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:03:20.048 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:03:26.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:03:32.662 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:03:37.669 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:03:43.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:03:46.740 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:03:52.732 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:03:57.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:04:00.817 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:04:06.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:04:12.830 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:04:30.320 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:04:32.319 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:04:37.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:04:42.402 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:04:48.481 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:04:49.593 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:04:55.670 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:05:01.677 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:05:06.757 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:05:11.379 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:05:17.499 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:05:23.505 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None 2023-06-26T17:05:28.575 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:05:28.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:05:38.610 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-06-26T17:05:38.681 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:05:44.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:05:49.760 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:05:49.761 WARNING:teuthology.provision.fog.smithi187:'connect to smithi187.front.sepia.ceph.com' reached maximum tries (11) after waiting for 10 seconds 2023-06-26T17:05:52.756 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-06-26T17:05:55.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:05:59.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:05:59.859 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:06:00.973 ERROR:teuthology.orchestra.connection:Error authenticating with smithi187.front.sepia.ceph.com: Authentication failed. 2023-06-26T17:06:01.976 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-26T17:06:01.977 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-26T17:06:01.978 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-26T17:06:01.978 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-26T17:06:01.978 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-26T17:06:01.978 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-26T17:06:01.979 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-26T17:06:01.979 ERROR:paramiko.transport: raise EOFError() 2023-06-26T17:06:01.979 ERROR:paramiko.transport:EOFError 2023-06-26T17:06:01.979 ERROR:paramiko.transport: 2023-06-26T17:06:01.979 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-26T17:06:01.980 ERROR:paramiko.transport: 2023-06-26T17:06:01.980 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-26T17:06:01.980 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-26T17:06:01.981 ERROR:paramiko.transport: self._check_banner() 2023-06-26T17:06:01.981 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-26T17:06:01.981 ERROR:paramiko.transport: raise SSHException( 2023-06-26T17:06:01.981 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-26T17:06:01.981 ERROR:paramiko.transport: 2023-06-26T17:06:01.982 WARNING:teuthology.provision.fog.smithi187:Error reading SSH protocol banner 2023-06-26T17:06:02.800 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-06-26T17:06:07.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:06:12.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:06:36.528 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-06-26T17:06:42.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:06:45.584 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-06-26T17:06:47.536 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:06:51.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:06:51.591 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-06-26T17:06:53.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:06:58.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:07:03.549 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182 2023-06-26T17:07:03.549 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:07:09.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:07:14.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:07:19.860 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T17:07:19.861 DEBUG:teuthology.orchestra.run.smithi182:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T17:07:20.329 INFO:teuthology.provision.fog.smithi182:Node is ready 2023-06-26T17:07:20.329 DEBUG:teuthology.orchestra.run.smithi182:> hostname 2023-06-26T17:07:20.374 INFO:teuthology.orchestra.run.smithi182.stdout:smithi182.front.sepia.ceph.com 2023-06-26T17:07:20.374 DEBUG:teuthology.orchestra.run.smithi182:> grep smithi182.front.sepia.ceph.com /etc/hosts 2023-06-26T17:07:20.422 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.15.182 smithi182.front.sepia.ceph.com smithi182 2023-06-26T17:07:20.423 DEBUG:teuthology.orchestra.run.smithi182:> sudo hostname smithi182 2023-06-26T17:07:20.608 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/smithi182.front.sepia.ceph.com/smithi182/g' /etc/hosts 2023-06-26T17:07:20.622 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/172.21.15.182/172.21.15.182/g' /etc/hosts 2023-06-26T17:07:20.683 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/smithi182.front.sepia.ceph.com/smithi182/g' /etc/hostname 2023-06-26T17:07:20.743 DEBUG:teuthology.orchestra.run.smithi182:> sudo hostname smithi182 2023-06-26T17:07:20.802 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2023-06-26T17:07:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T17:07:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="Ubuntu" 2023-06-26T17:07:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="22.04" 2023-06-26T17:07:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T17:07:20.850 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_CODENAME=jammy 2023-06-26T17:07:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:ID=ubuntu 2023-06-26T17:07:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE=debian 2023-06-26T17:07:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T17:07:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T17:07:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T17:07:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T17:07:20.851 INFO:teuthology.orchestra.run.smithi182.stdout:UBUNTU_CODENAME=jammy 2023-06-26T17:07:20.852 INFO:teuthology.provision.fog.smithi182:Deploy complete! 2023-06-26T17:07:20.854 DEBUG:teuthology.parallel:result is None 2023-06-26T17:07:51.024 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:07:57.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:07:57.028 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:08:03.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:08:03.032 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-06-26T17:08:09.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:08:14.339 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T17:08:14.339 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T17:08:14.844 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-06-26T17:08:14.844 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-06-26T17:08:14.892 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-06-26T17:08:14.892 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-06-26T17:08:14.941 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-06-26T17:08:14.941 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-06-26T17:08:15.074 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-06-26T17:08:15.086 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-06-26T17:08:15.138 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-06-26T17:08:15.189 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-06-26T17:08:15.241 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-06-26T17:08:15.287 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T17:08:15.288 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2023-06-26T17:08:15.288 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2023-06-26T17:08:15.288 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T17:08:15.288 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2023-06-26T17:08:15.288 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2023-06-26T17:08:15.288 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2023-06-26T17:08:15.289 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T17:08:15.289 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T17:08:15.289 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T17:08:15.289 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T17:08:15.289 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2023-06-26T17:08:15.289 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-06-26T17:08:15.290 DEBUG:teuthology.parallel:result is None 2023-06-26T17:08:30.480 INFO:teuthology.lock.ops:Checking smithi182.front.sepia.ceph.com 2023-06-26T17:08:30.481 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T17:08:32.202 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-06-26T17:08:32.202 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T17:08:32.219 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: set os type and version on server 2023-06-26T17:08:32.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2023-06-26T17:08:32.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:08:32.294 DEBUG:teuthology.orchestra.run.smithi182:> true 2023-06-26T17:08:32.504 DEBUG:teuthology.orchestra.run.smithi182:> uname -m 2023-06-26T17:08:32.553 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2023-06-26T17:08:32.553 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2023-06-26T17:08:32.601 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T17:08:32.601 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="Ubuntu" 2023-06-26T17:08:32.601 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="22.04" 2023-06-26T17:08:32.601 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T17:08:32.602 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_CODENAME=jammy 2023-06-26T17:08:32.602 INFO:teuthology.orchestra.run.smithi182.stdout:ID=ubuntu 2023-06-26T17:08:32.602 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE=debian 2023-06-26T17:08:32.602 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T17:08:32.602 INFO:teuthology.orchestra.run.smithi182.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T17:08:32.603 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T17:08:32.603 INFO:teuthology.orchestra.run.smithi182.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T17:08:32.603 INFO:teuthology.orchestra.run.smithi182.stdout:UBUNTU_CODENAME=jammy 2023-06-26T17:08:32.603 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2023-06-26T17:08:32.628 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-06-26T17:08:32.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-06-26T17:08:32.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T17:08:32.705 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-06-26T17:08:32.928 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-06-26T17:08:32.976 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-06-26T17:08:32.976 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-06-26T17:08:33.023 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T17:08:33.023 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2023-06-26T17:08:33.023 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2023-06-26T17:08:33.024 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T17:08:33.024 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2023-06-26T17:08:33.024 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2023-06-26T17:08:33.024 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2023-06-26T17:08:33.024 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T17:08:33.025 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T17:08:33.025 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T17:08:33.025 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T17:08:33.025 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2023-06-26T17:08:33.025 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-06-26T17:08:33.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:08:33.052 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:08:33.150 INFO:teuthology.dispatcher.supervisor:Running job 7316585 2023-06-26T17:08:33.150 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316585 --name yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316585/orig.config.yaml 2023-06-26T17:08:33.154 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316585 2023-06-26T17:08:33.155 INFO:teuthology.dispatcher.supervisor:Job PID: 24512 2023-06-26T17:08:33.155 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-26T17:10:33.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:10:33.157 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:12:38.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:12:38.233 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:14:43.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:14:43.307 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:16:48.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:16:48.381 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:18:51.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:18:51.013 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:20:56.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T17:20:56.105 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T17:21:01.177 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-26T17:21:11.308 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-26T17:21:11.308 INFO:teuthology.nuke:Checking targets against current locks 2023-06-26T17:21:16.305 DEBUG:teuthology.nuke:shortname: smithi182 2023-06-26T17:21:16.306 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T17:21:16.331 DEBUG:teuthology.nuke:shortname: smithi187 2023-06-26T17:21:16.332 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T17:21:16.336 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi182.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316585', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 17:00:41.258612', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUjIs2N5YgfLcwj3c2yMGfeDVBmyq0+ankZ29/LOzr4dwrmhS/FWoaON+O/eJI90yO452lcjxF4xYErk+Rh7PM='} 2023-06-26T17:21:16.382 INFO:teuthology.orchestra.console:Power off smithi182 2023-06-26T17:21:16.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T17:21:16.394 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316585', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 17:00:41.260517', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKly3TOlrWdkXPS45RzbnPZPYvtRCBNwIJB9ozj58TSaiQq0FB53tZR1SX0iTVJ6V6O71ZJESLSJHuYQiWaXIkQ='} 2023-06-26T17:21:16.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:21:16.452 INFO:teuthology.orchestra.console:Power off smithi187 2023-06-26T17:21:16.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T17:21:16.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T17:21:16.537 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2023-06-26T17:21:16.600 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2023-06-26T17:21:16.691 INFO:teuthology.lock.ops:unlocked: smithi182.front.sepia.ceph.com 2023-06-26T17:21:16.751 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com