2024-02-14T16:37:32.507 INFO:root:teuthology version: 0.0.1.dev258+g9e44c16 2024-02-14T16:37:32.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:37:32.693 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7b73db5c10>, signals=[15]) 2024-02-14T16:37:32.694 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2024-02-14T16:37:32.694 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T16:37:32.694 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-02-14T16:37:32.713 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2024-02-14T16:37:32.714 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T16:37:32.714 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-02-14T16:37:32.730 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2024-02-14T16:37:32.730 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T16:37:32.730 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-02-14T16:37:32.746 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2024-02-14T16:37:32.746 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T16:37:32.746 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-02-14T16:37:32.834 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-14T16:37:32.870 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-14T16:37:32.873 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-14T16:37:32.919 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of ubuntu 22.04 2024-02-14T16:37:32.928 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-14T16:37:32.951 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of ubuntu 22.04 2024-02-14T16:37:32.963 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of ubuntu 22.04 2024-02-14T16:37:32.984 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 22.04 2024-02-14T16:37:33.513 INFO:teuthology.orchestra.console.smithi139:Power off 2024-02-14T16:37:33.514 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T16:37:33.526 INFO:teuthology.orchestra.console.smithi003:Power off 2024-02-14T16:37:33.527 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T16:37:33.539 INFO:teuthology.orchestra.console.smithi026:Power off 2024-02-14T16:37:33.539 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T16:37:33.548 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2024-02-14T16:37:33.548 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:33.555 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2024-02-14T16:37:33.555 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:33.563 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-02-14T16:37:33.563 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:33.578 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2024-02-14T16:37:33.578 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-02-14T16:37:33.583 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-02-14T16:37:33.600 INFO:teuthology.orchestra.console.smithi151:Power off 2024-02-14T16:37:33.600 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T16:37:33.620 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2024-02-14T16:37:33.621 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:33.642 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-02-14T16:37:33.679 INFO:teuthology.orchestra.console.smithi139:Power off completed 2024-02-14T16:37:33.684 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-02-14T16:37:33.743 INFO:teuthology.orchestra.console.smithi151:Power off completed 2024-02-14T16:37:33.780 INFO:teuthology.orchestra.console.smithi139:Power on 2024-02-14T16:37:33.780 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T16:37:33.788 INFO:teuthology.orchestra.console.smithi026:Power on 2024-02-14T16:37:33.788 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T16:37:33.802 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2024-02-14T16:37:33.802 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:33.810 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2024-02-14T16:37:33.811 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:33.822 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2024-02-14T16:37:33.831 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-02-14T16:37:33.844 INFO:teuthology.orchestra.console.smithi151:Power on 2024-02-14T16:37:33.844 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T16:37:33.869 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2024-02-14T16:37:33.869 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:33.891 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-02-14T16:37:37.583 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:37.691 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-02-14T16:37:37.824 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:37.832 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:37.892 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:37.933 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-02-14T16:37:37.941 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-02-14T16:37:38.000 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-02-14T16:37:38.034 INFO:teuthology.orchestra.console.smithi139:Power on completed 2024-02-14T16:37:38.042 INFO:teuthology.orchestra.console.smithi026:Power on completed 2024-02-14T16:37:38.135 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2024-02-14T16:37:38.143 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2024-02-14T16:37:41.696 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:41.804 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-02-14T16:37:41.905 INFO:teuthology.orchestra.console.smithi003:Power off completed 2024-02-14T16:37:42.001 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:42.008 INFO:teuthology.orchestra.console.smithi003:Power on 2024-02-14T16:37:42.009 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T16:37:42.031 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2024-02-14T16:37:42.032 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:42.054 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-02-14T16:37:42.110 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-02-14T16:37:42.210 INFO:teuthology.orchestra.console.smithi151:Power on completed 2024-02-14T16:37:42.311 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2024-02-14T16:37:42.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:37:45.596 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:37:46.056 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:46.167 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-02-14T16:37:50.171 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:37:50.287 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-02-14T16:37:50.387 INFO:teuthology.orchestra.console.smithi003:Power on completed 2024-02-14T16:37:50.488 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2024-02-14T16:37:51.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:37:54.652 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:38:00.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:38:03.708 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:38:09.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:38:12.764 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:38:18.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:38:21.852 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:38:27.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:38:30.908 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:38:36.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:38:39.968 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:38:45.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:38:49.052 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:38:55.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:39:13.468 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:39:19.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:39:22.556 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:39:28.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:39:28.690 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:39:32.821 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:39:39.948 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:39:50.075 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:40:03.239 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:40:19.364 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:40:38.367 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2024-02-14T16:40:38.368 ERROR:paramiko.transport:Traceback (most recent call last): 2024-02-14T16:40:38.368 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2327, in _check_banner 2024-02-14T16:40:38.368 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2024-02-14T16:40:38.368 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 381, in readline 2024-02-14T16:40:38.369 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2024-02-14T16:40:38.369 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 618, in _read_timeout 2024-02-14T16:40:38.369 ERROR:paramiko.transport: raise EOFError() 2024-02-14T16:40:38.369 ERROR:paramiko.transport:EOFError 2024-02-14T16:40:38.369 ERROR:paramiko.transport: 2024-02-14T16:40:38.369 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2024-02-14T16:40:38.369 ERROR:paramiko.transport: 2024-02-14T16:40:38.369 ERROR:paramiko.transport:Traceback (most recent call last): 2024-02-14T16:40:38.369 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2143, in run 2024-02-14T16:40:38.369 ERROR:paramiko.transport: self._check_banner() 2024-02-14T16:40:38.369 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2331, in _check_banner 2024-02-14T16:40:38.369 ERROR:paramiko.transport: raise SSHException( 2024-02-14T16:40:38.369 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2024-02-14T16:40:38.369 ERROR:paramiko.transport: 2024-02-14T16:40:38.370 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: SSHException('Error reading SSH protocol banner') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2327, in _check_banner buf = self.packetizer.readline(timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 381, in readline buf += self._read_timeout(timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 618, in _read_timeout raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 451, in connect t.start_client(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 738, in start_client raise e File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2143, in run self._check_banner() File "/home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2331, in _check_banner raise SSHException( paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2024-02-14T16:40:42.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:40:46.012 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:40:52.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:40:55.068 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:41:00.455 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:41:01.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:04.128 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:41:10.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:13.184 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:41:19.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:22.240 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:41:25.544 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:41:26.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:28.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:44.768 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-14T16:41:46.556 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:41:50.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:52.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:53.670 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-14T16:41:53.671 WARNING:teuthology.provision.fog.smithi151:'connect to smithi151.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2024-02-14T16:41:53.820 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-14T16:41:55.616 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:41:59.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:59.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:01.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:01.619 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:42:02.876 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-14T16:42:07.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:07.623 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:42:08.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:11.932 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-14T16:42:13.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:13.626 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-02-14T16:42:16.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:17.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:19.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:34.172 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:42:35.157 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T16:42:35.157 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T16:42:35.196 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-02-14T16:42:35.628 INFO:teuthology.provision.fog.smithi026:Node is ready 2024-02-14T16:42:35.629 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2024-02-14T16:42:35.674 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2024-02-14T16:42:35.674 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2024-02-14T16:42:35.726 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2024-02-14T16:42:35.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-02-14T16:42:35.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2024-02-14T16:42:35.854 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2024-02-14T16:42:35.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2024-02-14T16:42:35.967 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2024-02-14T16:42:36.022 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-02-14T16:42:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:42:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2024-02-14T16:42:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2024-02-14T16:42:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:42:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2024-02-14T16:42:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2024-02-14T16:42:36.070 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2024-02-14T16:42:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:42:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:42:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:42:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:42:36.071 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:42:36.071 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2024-02-14T16:42:36.073 DEBUG:teuthology.parallel:result is None 2024-02-14T16:42:40.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:41.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:42.108 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:42:44.252 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-02-14T16:42:48.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:50.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:51.164 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:42:53.308 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-02-14T16:42:57.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:59.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:43:00.220 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-02-14T16:43:02.364 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-02-14T16:43:06.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:43:08.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:43:11.420 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-02-14T16:43:17.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:43:17.935 WARNING:teuthology.provision.fog.smithi003:timed out 2024-02-14T16:43:23.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:43:39.386 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T16:43:39.386 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T16:43:39.831 INFO:teuthology.provision.fog.smithi003:Node is ready 2024-02-14T16:43:39.831 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2024-02-14T16:43:39.878 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2024-02-14T16:43:39.878 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2024-02-14T16:43:39.926 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2024-02-14T16:43:39.926 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-02-14T16:43:40.086 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2024-02-14T16:43:40.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2024-02-14T16:43:40.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2024-02-14T16:43:40.219 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-02-14T16:43:40.278 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-02-14T16:43:40.330 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:43:40.330 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2024-02-14T16:43:40.330 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="22.04" 2024-02-14T16:43:40.330 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:43:40.330 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=jammy 2024-02-14T16:43:40.330 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2024-02-14T16:43:40.331 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2024-02-14T16:43:40.331 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:43:40.331 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:43:40.331 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:43:40.331 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:43:40.331 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:43:40.331 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2024-02-14T16:43:40.332 DEBUG:teuthology.parallel:result is None 2024-02-14T16:44:06.224 WARNING:teuthology.provision.fog.smithi151:timed out 2024-02-14T16:44:12.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:44:12.461 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T16:44:12.462 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T16:44:12.987 INFO:teuthology.provision.fog.smithi151:Node is ready 2024-02-14T16:44:12.987 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2024-02-14T16:44:13.034 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2024-02-14T16:44:13.035 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2024-02-14T16:44:13.080 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2024-02-14T16:44:13.080 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2024-02-14T16:44:13.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2024-02-14T16:44:13.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2024-02-14T16:44:13.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2024-02-14T16:44:13.333 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2024-02-14T16:44:13.384 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:44:13.432 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:44:13.433 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:44:13.433 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:44:13.433 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2024-02-14T16:44:13.434 DEBUG:teuthology.parallel:result is None 2024-02-14T16:44:17.424 WARNING:teuthology.provision.fog.smithi139:timed out 2024-02-14T16:44:23.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:44:23.637 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T16:44:23.637 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T16:44:24.111 INFO:teuthology.provision.fog.smithi139:Node is ready 2024-02-14T16:44:24.111 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2024-02-14T16:44:24.157 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2024-02-14T16:44:24.158 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2024-02-14T16:44:24.207 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2024-02-14T16:44:24.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2024-02-14T16:44:24.352 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2024-02-14T16:44:24.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2024-02-14T16:44:24.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2024-02-14T16:44:24.483 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2024-02-14T16:44:24.536 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:44:24.586 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:44:24.587 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:44:24.587 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2024-02-14T16:44:24.587 DEBUG:teuthology.parallel:result is None 2024-02-14T16:44:24.882 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2024-02-14T16:44:24.882 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T16:44:24.912 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2024-02-14T16:44:24.912 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T16:44:24.927 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2024-02-14T16:44:24.928 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T16:44:24.953 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2024-02-14T16:44:24.953 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T16:44:24.979 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2024-02-14T16:44:24.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-02-14T16:44:24.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:44:25.060 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-02-14T16:44:25.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-02-14T16:44:25.312 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-02-14T16:44:25.357 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-02-14T16:44:25.358 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-02-14T16:44:25.405 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="22.04" 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=jammy 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:44:25.406 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:44:25.407 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-02-14T16:44:25.437 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2024-02-14T16:44:25.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-02-14T16:44:25.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:44:25.521 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-02-14T16:44:25.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-02-14T16:44:25.744 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-02-14T16:44:25.788 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-02-14T16:44:25.789 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-02-14T16:44:25.837 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:44:25.837 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2024-02-14T16:44:25.837 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2024-02-14T16:44:25.837 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:44:25.838 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2024-02-14T16:44:25.838 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2024-02-14T16:44:25.838 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2024-02-14T16:44:25.838 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:44:25.838 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:44:25.838 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:44:25.838 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:44:25.838 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:44:25.838 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-02-14T16:44:25.861 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2024-02-14T16:44:25.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-02-14T16:44:25.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:44:25.936 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-02-14T16:44:26.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-02-14T16:44:26.060 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-02-14T16:44:26.109 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-02-14T16:44:26.110 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-02-14T16:44:26.156 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:44:26.157 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:44:26.158 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-02-14T16:44:26.178 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2024-02-14T16:44:26.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-02-14T16:44:26.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:44:26.262 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-02-14T16:44:26.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-02-14T16:44:26.496 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-02-14T16:44:26.546 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-02-14T16:44:26.547 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-02-14T16:44:26.594 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:44:26.594 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:44:26.595 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:44:26.595 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-02-14T16:44:26.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:44:26.719 INFO:teuthology.dispatcher.supervisor:Running job 7559666 2024-02-14T16:44:26.719 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2024-02-14_06:29:27-rados:thrash-erasure-code-main-distro-default-smithi/7559666 --name nmordech-2024-02-14_06:29:27-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-4 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/nmordech-2024-02-14_06:29:27-rados:thrash-erasure-code-main-distro-default-smithi/7559666/orig.config.yaml 2024-02-14T16:44:26.722 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2024-02-14_06:29:27-rados:thrash-erasure-code-main-distro-default-smithi/7559666 2024-02-14T16:44:26.722 INFO:teuthology.dispatcher.supervisor:Job PID: 1485988 2024-02-14T16:44:26.723 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-14T16:46:26.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:48:26.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:48:26.862 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-14T16:48:27.012 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi151 but it was locked by another job: /home/teuthworker/archive/gabrioux-2024-02-14_13:54:10-orch:cephadm-wip-guits-testing-2024-02-14-1033-distro-default-smithi/7559755