2024-03-21T09:23:23.531 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-21T09:23:23.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:23:23.708 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f712aeaac10>, signals=[15]) 2024-03-21T09:23:23.708 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2024-03-21T09:23:23.708 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T09:23:23.708 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-03-21T09:23:23.733 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2024-03-21T09:23:23.733 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T09:23:23.734 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-03-21T09:23:23.757 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2024-03-21T09:23:23.757 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T09:23:23.757 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-21T09:23:23.847 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_8.stream (ID 3) 2024-03-21T09:23:23.871 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3) 2024-03-21T09:23:23.883 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_8.stream (ID 3) 2024-03-21T09:23:23.887 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 8.stream 2024-03-21T09:23:23.914 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream 2024-03-21T09:23:23.927 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 8.stream 2024-03-21T09:23:24.109 INFO:teuthology.orchestra.console.smithi098:Power off 2024-03-21T09:23:24.109 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T09:23:24.124 INFO:teuthology.orchestra.console.smithi070:Power off 2024-03-21T09:23:24.125 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T09:23:24.135 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-03-21T09:23:24.135 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:24.145 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-03-21T09:23:24.145 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:24.158 INFO:teuthology.orchestra.console.smithi177:Power off 2024-03-21T09:23:24.158 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T09:23:24.165 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-21T09:23:24.165 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-21T09:23:24.178 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-03-21T09:23:24.178 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:24.199 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-21T09:23:28.168 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:28.175 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:28.200 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:28.277 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-21T09:23:28.284 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-21T09:23:28.308 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-21T09:23:32.282 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:32.289 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:32.308 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:32.392 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-21T09:23:32.398 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-21T09:23:32.416 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-21T09:23:32.499 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-03-21T09:23:32.600 INFO:teuthology.orchestra.console.smithi098:Power on 2024-03-21T09:23:32.600 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T09:23:32.621 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2024-03-21T09:23:32.622 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:32.641 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-21T09:23:36.397 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:36.417 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:36.507 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-21T09:23:36.528 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-21T09:23:36.608 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-03-21T09:23:36.629 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-03-21T09:23:36.642 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:36.710 INFO:teuthology.orchestra.console.smithi070:Power on 2024-03-21T09:23:36.710 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T09:23:36.730 INFO:teuthology.orchestra.console.smithi177:Power on 2024-03-21T09:23:36.730 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T09:23:36.738 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2024-03-21T09:23:36.739 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:36.751 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2024-03-21T09:23:36.751 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:36.759 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-21T09:23:36.760 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-21T09:23:36.771 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-21T09:23:40.763 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:40.770 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:40.777 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:40.879 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-21T09:23:40.883 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-21T09:23:40.885 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-21T09:23:40.984 INFO:teuthology.orchestra.console.smithi098:Power on completed 2024-03-21T09:23:40.986 INFO:teuthology.orchestra.console.smithi177:Power on completed 2024-03-21T09:23:41.085 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2024-03-21T09:23:41.089 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2024-03-21T09:23:44.880 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T09:23:44.989 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-21T09:23:45.089 INFO:teuthology.orchestra.console.smithi070:Power on completed 2024-03-21T09:23:45.190 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2024-03-21T09:26:11.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:15.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:18.974 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-21T09:26:24.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:26.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:28.030 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-21T09:26:29.982 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T09:26:34.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:35.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:37.086 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-21T09:26:39.038 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T09:26:43.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:45.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:46.142 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-21T09:26:48.094 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T09:26:52.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:54.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:26:55.202 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-21T09:26:57.150 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T09:27:01.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:27:03.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:27:04.254 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-21T09:27:06.206 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T09:27:10.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:27:12.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:27:15.262 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T09:27:21.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:27:39.806 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T09:27:42.353 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-03-21T09:27:45.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:27:48.433 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:27:48.862 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T09:27:54.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:27:55.508 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:27:55.809 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T09:27:55.810 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T09:28:05.525 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:28:10.257 WARNING:teuthology.provision.fog.smithi070:timed out 2024-03-21T09:28:15.906 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-03-21T09:28:16.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:28:16.568 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T09:28:16.568 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T09:28:16.834 INFO:teuthology.provision.fog.smithi070:Node is ready 2024-03-21T09:28:16.834 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2024-03-21T09:28:16.853 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2024-03-21T09:28:16.854 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2024-03-21T09:28:16.912 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2024-03-21T09:28:16.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-03-21T09:28:17.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2024-03-21T09:28:17.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2024-03-21T09:28:17.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2024-03-21T09:28:17.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-03-21T09:28:17.247 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-03-21T09:28:17.305 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-03-21T09:28:17.305 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2024-03-21T09:28:17.305 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-03-21T09:28:17.305 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-03-21T09:28:17.305 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2024-03-21T09:28:17.305 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2024-03-21T09:28:17.305 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-21T09:28:17.306 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-03-21T09:28:17.306 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-21T09:28:17.306 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-03-21T09:28:17.306 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T09:28:17.306 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-21T09:28:17.306 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T09:28:17.307 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2024-03-21T09:28:17.308 DEBUG:teuthology.parallel:result is None 2024-03-21T09:28:18.544 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:28:21.381 INFO:teuthology.provision.fog.smithi177:Node is ready 2024-03-21T09:28:21.381 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2024-03-21T09:28:21.405 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2024-03-21T09:28:21.406 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2024-03-21T09:28:21.466 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2024-03-21T09:28:21.466 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-03-21T09:28:21.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2024-03-21T09:28:21.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2024-03-21T09:28:21.685 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2024-03-21T09:28:21.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-03-21T09:28:21.820 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-21T09:28:21.878 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-21T09:28:21.878 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-21T09:28:21.879 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T09:28:21.880 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2024-03-21T09:28:21.880 DEBUG:teuthology.parallel:result is None 2024-03-21T09:28:34.561 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:28:53.580 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:29:15.597 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:29:40.616 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:30:08.633 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: BadHostKeyException('smithi098.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:5ZcqYeA9U4GJvT25Z+gtmI67jq2VWfDjPQ42qS+39PM), PKey(alg=ED25519, bits=256, fp=SHA256:opqTzYCCGsJ2cWaP4RXVlGtoZYCMCufxhA3bunhRBCw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi098.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM4cO3GSXpL9YI26hN+s+IFHELmhfZs1AjLa51faL6iZeFJcwAkirK2IReRxUsV4wuUGpVv7L2upr3Rbqujs00=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIPsxVfrBB2HzKHB59DNJYv1cZtakpDQP3hMutmxKUJsy' 2024-03-21T09:30:08.634 WARNING:teuthology.provision.fog.smithi098:'connect to smithi098.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2024-03-21T09:30:14.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:30:14.840 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T09:30:14.841 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T09:30:15.040 INFO:teuthology.provision.fog.smithi098:Node is ready 2024-03-21T09:30:15.041 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2024-03-21T09:30:15.059 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2024-03-21T09:30:15.059 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2024-03-21T09:30:15.119 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2024-03-21T09:30:15.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-03-21T09:30:15.233 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2024-03-21T09:30:15.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2024-03-21T09:30:15.332 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2024-03-21T09:30:15.401 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-03-21T09:30:15.469 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-21T09:30:15.527 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-03-21T09:30:15.528 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T09:30:15.528 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-21T09:30:15.528 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T09:30:15.528 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2024-03-21T09:30:15.529 DEBUG:teuthology.parallel:result is None 2024-03-21T09:30:15.751 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2024-03-21T09:30:15.751 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T09:30:15.777 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2024-03-21T09:30:15.777 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T09:30:15.802 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2024-03-21T09:30:15.802 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T09:30:15.844 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2024-03-21T09:30:15.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-03-21T09:30:15.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:30:15.917 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-03-21T09:30:16.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-03-21T09:30:16.053 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-03-21T09:30:16.111 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-03-21T09:30:16.111 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-21T09:30:16.170 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-03-21T09:30:16.171 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T09:30:16.171 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-21T09:30:16.171 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T09:30:16.171 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-03-21T09:30:16.193 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2024-03-21T09:30:16.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-03-21T09:30:16.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:30:16.266 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-03-21T09:30:16.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-03-21T09:30:16.333 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-03-21T09:30:16.391 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-03-21T09:30:16.391 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-03-21T09:30:16.449 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-21T09:30:16.450 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-03-21T09:30:16.450 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T09:30:16.450 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-21T09:30:16.450 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T09:30:16.450 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-03-21T09:30:16.468 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2024-03-21T09:30:16.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-21T09:30:16.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T09:30:16.546 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-03-21T09:30:16.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-21T09:30:16.682 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-03-21T09:30:16.740 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-03-21T09:30:16.740 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-21T09:30:16.799 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-21T09:30:16.799 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-21T09:30:16.800 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T09:30:16.801 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-21T09:30:16.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:30:16.930 INFO:teuthology.dispatcher.supervisor:Running job 7612187 2024-03-21T09:30:16.930 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-20_11:21:18-fs-wip-vshankar-testing-20240320.053002-testing-default-smithi/7612187 --name vshankar-2024-03-20_11:21:18-fs-wip-vshankar-testing-20240320.053002-testing-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/vshankar-2024-03-20_11:21:18-fs-wip-vshankar-testing-20240320.053002-testing-default-smithi/7612187/orig.config.yaml 2024-03-21T09:30:16.934 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-20_11:21:18-fs-wip-vshankar-testing-20240320.053002-testing-default-smithi/7612187 2024-03-21T09:30:16.934 INFO:teuthology.dispatcher.supervisor:Job PID: 4030427 2024-03-21T09:30:16.934 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-21T09:32:16.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:34:17.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:36:17.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:38:17.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:40:17.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:42:17.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:44:17.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:46:18.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:48:18.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:50:18.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:52:18.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:54:18.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:56:18.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T09:58:19.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T10:00:19.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T10:00:19.326 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1